sparse_learning icon indicating copy to clipboard operation
sparse_learning copied to clipboard

LSTM Support

Open akaniklaus opened this issue 5 years ago • 1 comments

Would this also work for LSTM? Do you have any benchmark of the method on that?

akaniklaus avatar Jul 15 '19 18:07 akaniklaus

I never tested it for LSTMs. The library itself should work for LSTMs out of the box. However, I am not sure if there might be problems with inducing too much sparsity in the recurrent weight matrices.

I will look into this and see if they are straightforward to use. If they are, I might add some LSTM starter code to try it quickly.

TimDettmers avatar Jul 15 '19 21:07 TimDettmers