transformer icon indicating copy to clipboard operation
transformer copied to clipboard

Best performance on iwslt2016 de->en?

Open LibertFan opened this issue 5 years ago • 1 comments

Hello, what's the best result of iwslt2016 de->en that you've got?

Mine is 26.15 in iwslt2014 test set. However, I find that the score reports in this paper [https://www.aclweb.org/anthology/P19-1020.pdf] is 30.19.

Does anyone know the reason?

Thanks!

LibertFan avatar Oct 23 '19 16:10 LibertFan

you may mix the iwslt2014 and test2014,for instance,this program is based on iwslt2016 while its test datas range from test2010 to test2014.maybe early test data is difficult to handle.

yifanjun233 avatar Dec 13 '19 08:12 yifanjun233