neural-turing-machines
neural-turing-machines copied to clipboard
shawntan
Attempt at implementing system described in "Neural Turing Machines." by Graves, Alex, Greg Wayne, and Ivo Danihelka. (http://arxiv.org/abs/1410.5401)
Controller module missing , while using "import controller" in run_model.py
The paper said: "Taking inspiration from the input and forget gates in LSTM, we decompose each write into two parts: an erase followed by an add". Why? Thanks!
The tanh in the hidden layer is unnecessary since the head param need the result of hidden layer instead of transform by tanh. Secondly, by using lower learning rate can...
Hi firstly appreciate to your contribution and I am playing your code with the model you produce. When I trying to produce a similar model of copy.mdl using without l2...
Self-explanatory. Also thanks! Awesome work! Glad to see you're from NUS too.
Have you contacted the authors in order to learn more about the training algorithm used in the paper?
How do you know what is optimal controller output for read and write heads ?
