conv_seq2seq icon indicating copy to clipboard operation
conv_seq2seq copied to clipboard

Published 20 hours ago • verified publisher icon tobyyouup

Result on ReadMe ?

Open dylanee2 opened this issue 7 years ago • 6 comments

Hi @tobyyouup ,

I thought it would be good for people like me (who want to use your implementation) if you have result of running your implementation on the dataset.

Were you able to reproduce the result of original conv seq2seq?

Thanks!

dylanee2 avatar Jul 25 '17 01:07 dylanee2

@tobyyouup could you report the result in terms of BLEU scores in the wmt'14 en-de translation task? Thanks!

anglil avatar Jul 28 '17 16:07 anglil

@dylanee2 @anglil I have run the iwslt14 de-en task, the command is shown in the README, and I can get a BLEU score 25 at step 60k with batchsize 32.

tobyyouup avatar Jul 31 '17 11:07 tobyyouup

@tobyyouup thanks, that looks promising. Could you comment on how many GPUs you used and what dataset (newstest 2014 or newstest 2015 or something else) you got a BLEU score of 25 on?

anglil avatar Jul 31 '17 17:07 anglil

Hi anglil, just one tesla K40 GPU. The traning data is IWSLT Germain-English, I concatenate dev2010, tst2010, tst2011 and tst2012 as the test set.

tobyyouup avatar Sep 13 '17 08:09 tobyyouup

Thanks.

anglil avatar Sep 13 '17 08:09 anglil

@tobyyouup Hi, tobyyouup, do you remember how long it took to train step 60k with batchsize 32 on iwslt14 de-en?

cauivy avatar Nov 07 '18 09:11 cauivy