mrc-for-flat-nested-ner icon indicating copy to clipboard operation
mrc-for-flat-nested-ner copied to clipboard

Published 20 hours ago • verified publisher icon ShannonAI

Reproduce of the GENIA dataset

Open YuSawan opened this issue 4 years ago • 5 comments

Hi, I cannot reproduce the genia dataset results for f1=83.75 in your paper; the results only reached f1=78. If available, would you like to give your preprocessed dataset?

YuSawan avatar Feb 06 '21 18:02 YuSawan

@YuSawan Neither do I. Have you reproduced the genia dataset results for f1=83.75 in your paper now?

Nicozwy avatar Mar 26 '21 01:03 Nicozwy

Not yet. I use the genia dataset provided in Obaja's project but it can not reproduce the results. I think this model uses different preprocessing like eliminates entities with coordinate structure (ex. Human A and B lymphocytes).

YuSawan avatar Mar 26 '21 06:03 YuSawan

Hello! I ran your program on the genia dataset, and the result was 74. Can you give me the data set you have processed?

yujiahappy avatar Apr 07 '21 09:04 yujiahappy

Please use our released data files link for GENIA. Hyperparameters for reproducing the result can be found here. Many thanks.

xiaoya-li avatar Jul 27 '21 14:07 xiaoya-li

Any update of this issue? I have run the experiment with Genia dataset, but only f1 0.79 I can get. I already used your dataset and your genia.sh scripts.

EternalEep avatar Nov 04 '21 10:11 EternalEep