opencompass icon indicating copy to clipboard operation
opencompass copied to clipboard

[Feature] Can we find the config version that is used to produce the score displayed on leaderboard?

Open sdc17 opened this issue 1 year ago • 0 comments

Describe the feature

Hi, thanks for sharing this wonderful project! I am wondering is there somewhere we can find the config version that is used to produce the score displayed on leaderboard? For example, there are config files from different versions under configs/datasets/ARC_c. How should I choose the right version to reproduce the displayed results on leaderboard?

image

Any method to obtain the right version information would be appreciated!

Will you implement it?

  • [ ] I would like to implement this feature and create a PR!

sdc17 avatar Jan 19 '24 13:01 sdc17