mistral.rs icon indicating copy to clipboard operation
mistral.rs copied to clipboard

Published 20 hours ago • verified publisher icon EricLBuehler

Guidance on how to create my own gguf / uqff format file similar to llava.

Open lucasjinreal opened this issue 7 months ago • 0 comments

Hi, i had trained a llava like MLLM but with a customized vision encoder (siglip2)

Am wondering if there any steps to follow to create a gguf / uqff format file for convert and inference.

lucasjinreal avatar Mar 09 '25 15:03 lucasjinreal