PyxLSTM icon indicating copy to clipboard operation
PyxLSTM copied to clipboard
Published 1 year ago • verified publisher icon muditbhargava66

Stabilizer state missing from sLSTM

Open Strawl opened this issue 1 year ago • 1 comments

The new sLSTM doesn't have the stabilizer state m. This leads to exploding gradients very easily.

Strawl avatar May 25 '24 12:05 Strawl

Also the normalizer is not implemented?

yanpeng0520 avatar Jun 14 '24 13:06 yanpeng0520

Stale issue message

github-actions[bot] avatar Nov 03 '24 18:11 github-actions[bot]