SimPO icon indicating copy to clipboard operation
SimPO copied to clipboard

Question about the `annotators_config` and `reference_outputs` in alpaca_eval

Open AIR-hl opened this issue 6 months ago • 1 comments

I would like to determine if the default configuration annotators_config=weighted_alpaca_eval_gpt4_turbo and reference_outputs=gpt4_turbo used when evaluating with alpaca_eval. Thank you!

AIR-hl avatar Aug 01 '24 06:08 AIR-hl