mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

Published 20 hours ago • verified publisher icon mlc-ai

[Model Request] Mamba

Open kmn1024 opened this issue 9 months ago • 0 comments

⚙️ Request New Models

  • Link to an existing implementation (e.g. Hugging Face/Github): https://huggingface.co/docs/transformers/en/model_doc/mamba https://huggingface.co/state-spaces https://github.com/state-spaces/mamba/

  • Is this model architecture supported by MLC-LLM? No

Additional context

Mamba introduces a new architecture that competes well with transformers. It has similarities to RWKV.

kmn1024 avatar May 16 '24 07:05 kmn1024