Submit implementation to HuggingFace Transformers library

[JLTastet]

First of all, thanks for your amazing work on Mamba. This is probably one of the most exciting papers I have read this year!

I am opening this issue to ask you if you have any intention of submitting this model to HuggingFace’s Transformers library.

If not, I have started working on an implementation based on your code (specifically, commit 2ee7fd287a8f5c826af6f69ae3aad4682c4afd15). The changes are mostly boilerplate and refactoring, with no new logic (not that I would be able to understand any of the CUDA wizardry anyway!).

So, in case you are interested in chiming in, I have opened an issue at https://github.com/huggingface/transformers/issues/28086. No obligation, of course.

Thanks again!