nmt icon indicating copy to clipboard operation
nmt copied to clipboard

About shuffle operation

Open yapingzhao opened this issue 6 years ago • 3 comments

Hi, I have a question: does the tensorflow / NMT model shuffle after each epoch when training the translation model?Also, how do we perform shuffle operations?

Looking forward to your advice or answers. Best regards, Thank you very much!

yapingzhao avatar Oct 23 '18 09:10 yapingzhao

yes, it does shuffle each time it's iterated over. line # 114 in https://github.com/tensorflow/nmt/blob/master/nmt/utils/iterator_utils.py

ranjita-naik avatar Oct 23 '18 12:10 ranjita-naik

@ranjita-naik Thank you very much!

yapingzhao avatar Oct 23 '18 12:10 yapingzhao

Hi,I have a question: Can the encoder be processed in different formats with the decoder? The encoder uses BPE and the decoder uses character processing. Looking forward to your advice or answers. Thank you very much.

yapingzhao avatar Nov 16 '18 07:11 yapingzhao