text-generation-inference
text-generation-inference copied to clipboard
Support for Falcon-Mamba-7B
Model description
Hi I'm interested in adding support for Falcon-Mamba 7B to TGI, Here are some links for this model:
paper: https://arxiv.org/abs/2410.05355 model: https://huggingface.co/tiiuae/falcon-mamba-7b
Open source status
- [ ] The model implementation is available
- [X] The model weights are available
Provide useful links for the implementation
No response