opencompass icon indicating copy to clipboard operation
opencompass copied to clipboard

Published 20 hours ago • verified publisher icon open-compass

[Feature] 是否可以对arc-e和arc-c的base模型评估增加25-shot with choice

Open siftxxx opened this issue 10 months ago • 0 comments

描述该功能

with choice和wo choice差几十个点，希望可以对齐llama3中的评估方式

https://github.com/meta-llama/llama3/blob/main/eval_details.md

是否希望自己实现该功能？

  • [ ] 我希望自己来实现这一功能，并向 OpenCompass 贡献代码！

siftxxx avatar Apr 24 '24 12:04 siftxxx