text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

Support for Falcon-Mamba-7B

Open mokeddembillel opened this issue 1 year ago • 1 comments

Model description

Hi I'm interested in adding support for Falcon-Mamba 7B to TGI, Here are some links for this model:

paper: https://arxiv.org/abs/2410.05355 model: https://huggingface.co/tiiuae/falcon-mamba-7b

Open source status

  • [ ] The model implementation is available
  • [X] The model weights are available

Provide useful links for the implementation

No response

mokeddembillel avatar Nov 10 '24 15:11 mokeddembillel