char-rnn-keras icon indicating copy to clipboard operation
char-rnn-keras copied to clipboard

CuDNNLSTM

Open GameLogist opened this issue 6 years ago • 1 comments

I believe CuDNNLSTM will be beneficial for the model.

GameLogist avatar Oct 02 '18 16:10 GameLogist

I tested this on my side and CuDNNLSTM seems to work as a drop-in replacement for LSTM. This only works for keras tensorflow backend though.

That said in my current test case using CuDNNLSTM instead of LSTM make learning phase go 3 times faster. I don't took time to thoroughly cross check results between the 2 variants after learning.

Perhaps one could programmatically check backend and use CuDNNLSTM whenever

keras.backend.backend()=='tensorflow'

@GameLogist thank you for your suggestion I'll use it when possible.

TheErk avatar Oct 03 '18 06:10 TheErk