adaptive-softmax icon indicating copy to clipboard operation
adaptive-softmax copied to clipboard

Published 20 hours ago • verified publisher icon facebookresearch

How to put 1 billion word dataset into train.txt, valid.txt and test.txt

Open songyuzhou324 opened this issue 7 years ago • 0 comments

In order to reproduce the result, could you please describe how to make the 1 billion word dataset into train.txt, valid.txt and test.txt? Or an example showing first a few lines of the train/valid/test files?

songyuzhou324 avatar Jan 12 '18 00:01 songyuzhou324