fairseq
fairseq copied to clipboard
Add option to disable EOS appending in preprocessing (#5615)
Before submitting
- [x] Was this discussed/approved via a Github issue? (no need for typos, doc improvements)
- [x] Did you read the contributor guideline?
What does this PR do?
Fixes #5615