textgenrnn icon indicating copy to clipboard operation
textgenrnn copied to clipboard

Keras 2.3.0 potential sigmoid breaking change

Open minimaxir opened this issue 6 years ago • 0 comments

https://github.com/keras-team/keras/releases/tag/2.3.0

Change default recurrent activation to sigmoid (from hard_sigmoid) in all RNN layers.

This shouldn't affect textgenrnn because I was accidentally ahead of the curve and made the sigmoid function the default for LSTMs when I did the revamp. (because the CuDNNRNN layers required it).

But I'll keep an eye on it.

minimaxir avatar Sep 17 '19 18:09 minimaxir