Bert base eval f1 score stuck at 0.85

[kemalaraz]

Hello there,

I am using bert-base-uncased and haven't changed the config.ini (just commented out bert-large and using bert-base instead) but in your readme the performance for semeval is 0.88 but I stuck at 0.85 what might be the problem?

[EmanuelaBoros]

Hello there,

I am using bert-base-uncased and haven't changed the config.ini (just commented out bert-large and using bert-base instead) but in your readme the performance for semeval is 0.88 but I stuck at 0.85 what might be the problem?

Hello @kemalaraz, There is a chance that you forget to apply the official script for SemEval 2010 task-8. After you finished running, apply the script on the final results on test:

$ cd eval
$ bash test.sh
$ cat res.txt