llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Published 20 hours ago • verified publisher icon ggml-org

Feature Request: Support Codestral Mamba

Open VelocityRa opened this issue 7 months ago • 14 comments

Feature Description

New 7B coding model just released by Mistral.

  • Blog Post: https://mistral.ai/news/codestral-mamba/
  • HF: https://huggingface.co/mistralai/mamba-codestral-7B-v0.1

Motivation

Seems to perform very well, especially for a 7B model:

image

Possible Implementation

An extension to https://github.com/ggerganov/llama.cpp/issues/7727?

VelocityRa avatar Jul 16 '24 16:07 VelocityRa