On regularizing and optimizing LSTM

[kylegao91]

This paper discussed and evaluated several regularization and optimization methods and gave the ablations on each techniques. It'd be interesting to experiment some techniques on seq2seq. https://arxiv.org/pdf/1708.02182.pdf