ml-mkqa icon indicating copy to clipboard operation
ml-mkqa copied to clipboard

A question about the "Query-only mT5"

Open StevenTang1998 opened this issue 1 year ago • 0 comments

Hello, I wonder how to evaluate on the "query-only mT5" setting since it has no unanswerable probs. When I use the evaluation script, the best_f1 score is about 34 for all languages but the best_answerable_f1 seems reasonable.

StevenTang1998 avatar Apr 11 '23 03:04 StevenTang1998