nlp-entity-convnet icon indicating copy to clipboard operation
nlp-entity-convnet copied to clipboard

Performance drop when using the latest version of wikipedia

Open matthewfl opened this issue 8 years ago • 2 comments

For some reason there is a notable performance drop when using the latest download of wikipedia instead of the 20141208 version that was used for the paper.

I am guessing that somehow the wikipedia dump format has changed slightly and one of the scripts that processes wikipedia is failing slightly as a result.

** If you run into this issue email me. **

matthewfl avatar Sep 04 '16 20:09 matthewfl

I only got 86.8% accuracy on ace05 dataset, while your result is 89.9% in your paper, is there any solution? I just run the demo.sh.. I guess this is your default parameters.. could you share your parameters in your paper so that I can repeat ?

janenie avatar Sep 11 '16 14:09 janenie

can you send me an email so I can send you the wiki dump I used.

matthewfl avatar Sep 11 '16 16:09 matthewfl