neural-turing-machines icon indicating copy to clipboard operation
neural-turing-machines copied to clipboard

Why Writing operation is decomposed into two parts "an erase followed by an add"?

Open ylqfp opened this issue 8 years ago • 1 comments

The paper said: "Taking inspiration from the input and forget gates in LSTM, we decompose each write into two parts: an erase followed by an add". Why? Thanks!

ylqfp avatar Apr 27 '16 09:04 ylqfp

The LSTM has the same idea of 'forgetting' and then adding the new input. That was what was meant by that line in the paper.

Just to be clear: I was in no way involved with the writing of the paper. This repo just happens to be one of the popular implementations of the NTM currently.

shawntan avatar May 01 '16 04:05 shawntan