llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

llama : support Mamba-2

Open ggerganov opened this issue 1 year ago • 1 comments

Mamba-2 is a new version of the Mamba architecture:

  • Blog: https://tridao.me/blog/2024/mamba2-part1-model/
  • Paper: https://arxiv.org/abs/2405.21060

ggerganov avatar Jun 04 '24 05:06 ggerganov

I'd love to see support for this come soon.

hg0428 avatar Oct 01 '24 01:10 hg0428