Question-Answering icon indicating copy to clipboard operation
Question-Answering copied to clipboard

Published 20 hours ago • verified publisher icon MurtyShikhar

The f1 and exact match

Open Embedding opened this issue 6 years ago • 4 comments

Could you tell me the F1 and exact match after 30 epochs? I only achieve {"f1": 40.09514087383774, "exact_match": 27.93755912961211} with official evaluation script

Embedding avatar Mar 16 '18 06:03 Embedding

I also got similar results, @MurtyShikhar: what results did you get?

emilysw avatar Mar 20 '18 20:03 emilysw

Me too, I don't know what is wrong

lhuang9703 avatar Mar 30 '18 06:03 lhuang9703

Similar result

Penghao-He avatar Apr 09 '18 01:04 Penghao-He

When I ran the sweep, I was able to get close to 60 exact match using the Boundary model. The Sequence model was much worse. You could try playing around with the hyperparameters (I know the best results I got weren't with these exact parameters but my best config is lost since then).

MurtyShikhar avatar Apr 09 '18 17:04 MurtyShikhar