AutoPrompt

AutoPrompt copied to clipboard

how to set the eval part in generation tasks

14

In face of generation situations, I guess we should set function name to ranking. And as so we should set function_params. That's not so obvious. the following not works for...

tfk12

Modify the code for chinese prompt

1

If my prompt is in Chinese instead of English, how should I modify the code

Chain-Mao

how to support qwen

1

use qwen-1.5 model command: > python run_pipeline.py --prompt "Does this movie review contain a spoiler? answer Yes or No" --task_description " Your task is to check if a movie review...

xyhuo7788

Generation with custom data & evaluator

3

Hi, We'd like to use AutoPrompt for a generation task where both the input and output are text. We've also developed an evaluator that scores the input-output pairs (e.g., a...

amitshermann

Exception: Failed to connect to argilla, check connection details

2

Hi, I'm encountering an error while trying to run "run_pipeline.py". This is the error: Exception: Failed to connect to argilla, check connection details More information: I'm using conda. I'm using...

amitshermann

Is it possible to use with Amazon Bedrock as well? Thanks

1

Hi, I am using Sage Maker and bedrock like this : from langchain.llms.bedrock import Bedrock Is there a way to use the LLM supplied by Bedrock? Thanks

nitzantal