llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Qwen2.5-vl support and conversion?

Open Gusha-nye opened this issue 9 months ago • 1 comments

Hi,big guys! I would like to ask if llama.cpp is able to convert a multimodal model (e.g. Qwen2.5-vl-3B) to gguf format and quantize it to Q4_0? And is there a corresponding tool to run it through llama.cpp after compilation? If not, are there any subsequent plans for this part of the development?

Gusha-nye avatar Mar 26 '25 08:03 Gusha-nye

See: https://github.com/ggml-org/llama.cpp/issues/11483#issuecomment-2727577078

panda44312 avatar Mar 26 '25 18:03 panda44312

This issue was closed because it has been inactive for 14 days since being marked as stale.

github-actions[bot] avatar May 10 '25 01:05 github-actions[bot]