llama-recipes icon indicating copy to clipboard operation
llama-recipes copied to clipboard

Evaluation details for MultiPL-E

Open devanshrj opened this issue 6 months ago • 0 comments

🚀 The feature, motivation and pitch

Hey folks, big fan of your work, especially all the details provided around evaluations! I am trying to reproduce results for MultiPL-E without much success. Would it be possible to share evaluation details, especially the input prompts and the post-generation parsing? Thanks.

Alternatives

No response

Additional context

No response

devanshrj avatar Aug 23 '24 19:08 devanshrj