Eladlev

Hi, Observe that you modify the annotator to be an LLM estimator. However, the prompt for the annotator asks the model to classify 'Yes' or 'No', where the ranker labels...

Hi @danielliu99, 1. At least the predictor should not be blank (after the iteration is completed) 2. If you are using an LLM ranker, then you should skip the ranking...

Could you provide the exact configuration? In which mode did you try to run the code?

When working with huggingfacepipeline you should change the meta prompts to the completion format in the config_default file (the default meta prompts are using openAI functions): ``` meta_prompts: folder: 'prompts/meta_prompts_completion'...