llama.cpp
llama.cpp copied to clipboard
llama : support Mamba-2
Mamba-2 is a new version of the Mamba architecture:
- Blog: https://tridao.me/blog/2024/mamba2-part1-model/
- Paper: https://arxiv.org/abs/2405.21060
I'd love to see support for this come soon.