llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Add Doc for Converting Granite Vision -> GGUF

Open alex-jw-brooks opened this issue 1 day ago • 0 comments

Adds example docs for converting a granite vision model, which is essentially a llava next model with multiple feature layers using siglip for the visual encoder, and a granite language model as the LLM.

Depends on https://github.com/ggml-org/llama.cpp/pull/11794

CC @danbev

alex-jw-brooks avatar Feb 21 '25 17:02 alex-jw-brooks