KoLA icon indicating copy to clipboard operation
KoLA copied to clipboard

Published 20 hours ago • verified publisher icon THU-KEG
→

Metadata

[ICLR24] The open-source repo of THU-KEG's KoLA benchmark.

Results 3 KoLA issues
Sort by recently updated
recently updated
newest added

Ambiguity on the evaluation metrics

6 comment

![image](https://github.com/THU-KEG/KoLA/assets/8592144/017a3423-14c7-4f91-9232-8e909268edbd) Are you evaluating F1 or EM (ROUGE or BLEU) after all for these datasets? I have no idea reading this paper. Also, BLEU has a lot of variants, which...

zhimin-z avatar zhimin-z

Is this benchmark being maintained?

2 comment

Hi, It seems like the benchmark is not being actively maintained -- the [latest session](http://103.238.162.37:31622/LeaderBoard) is October 2023. Could you please let me know if you are planning to maintain...

ZhangzihanGit avatar ZhangzihanGit

Unable to log in with GitHub

4 comment

![image](https://github.com/THU-KEG/KoLA/assets/8592144/e68979e1-5bf2-45cc-9d47-86deeec02d00)

zhimin-z avatar zhimin-z

← Metadata

45
Stars
0
Forks
Watchers

Owner

verified publisher icon THU-KEG

Metadata

[ICLR24] The open-source repo of THU-KEG's KoLA benchmark.

Back