indonlu icon indicating copy to clipboard operation
indonlu copied to clipboard

Benchmark table is not consistent (am I wrong?)

Open tryanbot opened this issue 1 year ago • 2 comments

I read the paper and compare it to this website : https://www.indobenchmark.com/leaderboard.html . It seems that the sequence labelling benchmark is not the same. I also tried my own fine-tuning, and the result is closer to the one on the paper rather than that in the website. is there any explanation regarding this problem?

tryanbot avatar Apr 02 '23 09:04 tryanbot

Thank you for creating the issue. The numbers on the website is outdated. You can refer to the paper for the more updated results.

gentaiscool avatar Apr 03 '23 16:04 gentaiscool

It seems the result on the web is better than that on the paper. If the one on the paper is the latest, how come the performance is decreased?

tryanbot avatar Apr 03 '23 16:04 tryanbot