llama-cpp-python icon indicating copy to clipboard operation
llama-cpp-python copied to clipboard

unknown model architecture: 'gemma-embedding'

Open mariocannistra opened this issue 3 months ago • 3 comments

I am running llama-cpp-python Version: 0.3.16

Trying to load the recently released model embeddinggemma-300M I get the following error message:

llama_model_load: error loading model: error loading model architecture: unknown model architecture: 'gemma-embedding'

Support for this model architecture has been added to llama.cpp in this build: https://github.com/ggml-org/llama.cpp/releases/tag/b6384

Could you please align llama-cpp-python to reflect this addition ?

mariocannistra avatar Sep 05 '25 09:09 mariocannistra