gated-state-spaces-pytorch icon indicating copy to clipboard operation
gated-state-spaces-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains
→

Metadata

Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch

Results 1 gated-state-spaces-pytorch issues
Sort by recently updated
recently updated
newest added

any plan on adding local attention?

Hi, I have been experimenting with the model. It sounds very promising given it does not have similar limitation as of attention based models. I have written [a blog post](https://naxalpha.substack.com/p/devlog-experiment-a2a468-gated-state)...

NaxAlpha avatar NaxAlpha

← Metadata

94
Stars
4
Forks
Watchers

Owner

verified publisher icon lucidrains

Metadata

Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch

Back