KoLA icon indicating copy to clipboard operation
KoLA copied to clipboard

Ambiguity on the evaluation metrics

Open zhimin-z opened this issue 1 year ago • 6 comments

image Are you evaluating F1 or EM (ROUGE or BLEU) after all for these datasets? I have no idea reading this paper. Also, BLEU has a lot of variants, which variant do you use for implementation?

zhimin-z avatar Nov 30 '23 23:11 zhimin-z