Passage icon indicating copy to clipboard operation
Passage copied to clipboard

Published 20 hours ago • verified publisher icon IndicoDataSolutions

Initialize LSTM forget gate with one

Open ma2rten opened this issue 9 years ago • 1 comments

This paper found they got significantly better results on a range of tasks if the forget gate for LSTM is initialized with one.

http://www.jmlr.org/proceedings/papers/v37/jozefowicz15.pdf

ma2rten avatar Jun 28 '15 19:06 ma2rten

How to initialze the forget gate with1

eoninfinity avatar Jan 05 '18 09:01 eoninfinity