stable-diffusion.cpp icon indicating copy to clipboard operation
stable-diffusion.cpp copied to clipboard
Published 1 week ago • verified publisher icon leejet

Merge models and loras

Open KintCark opened this issue 3 months ago • 3 comments

We can quantize models to gguf but cab we please get the features to merge models with loras as well I could create new merge models thx

KintCark avatar Oct 01 '25 20:10 KintCark

Did a hacky patch that does something similar. It applies a lora AFTER quantization and then writes the gguf.

https://github.com/leejet/stable-diffusion.cpp/pull/709

Green-Sky avatar Oct 01 '25 21:10 Green-Sky

+1 on this, I was just about to open the same issue.

Except obviously merging before quant or even no quant at all.

lastrosade avatar Oct 13 '25 11:10 lastrosade

I will see and try to update my hacky patch.

If you export close to the type of the input model it will basically just be a merge.

Green-Sky avatar Oct 13 '25 11:10 Green-Sky