rnn-theano icon indicating copy to clipboard operation
rnn-theano copied to clipboard

RNN(LSTM, GRU) in Theano with mini-batch training; character-level language models in Theano

###RNN(LSTM, GRU) using Theano

  • main_char_train.py: train the char-rnn model
  • main_hlm_train.py: train using corpus "Dream of Red Mansions" (《红楼梦》)

####Bugs:

  • Compile failed on CPU

###Frameworks: Framework of LSTM and GRU

###Reference:

  • Fig ref:https://github.com/dophist/kaldi-lstm
  • A Note on BPTT for LSTM LM: http://www.slideshare.net/tmasada/a-note-on-bptt-for-lstm-lm
  • Colah’s blog: http://colah.github.io/posts/2015-08-Understanding-LSTMs/