lstm
lstm copied to clipboard
The tanh_derivative should be : 1. + values**2
No, he is right.[tanh(x)]'=1-[tanh(x)]^2
[tanh(x)]' = [sin(x)/cos(x)]' = (cos(x)^2 + sin(x)^2)/cos(x)^2 = 1 + tanx(x)^2
tanh x is not the same as tan x
It's been a while since I've looked at this codebase... if there's something wrong can someone submit a PR?