Liang

How to distribute the data to ep.train.txt, ep.dev.txt, and ep.test.txt? what's the purpose of these files?

2

head -n -400000 step2.txt > ./out/ep.train.txt tail -n 400000 step2.txt > step3.txt head -n -200000 step3.txt > ./out/ep.dev.txt tail -n 200000 step3.txt > ./out/ep.test.txt Hi ottokart, Could you elaborate on...

How to determine hidden layer size and learning rate?

2

python main.py I am wondering at first stage of training the language model, how to choose the hidden layer size and learning rate? Thanks!