ComfyUI-Kolors-MZ Can not load LoRA model from SimpleTuner, no effect

Hi, I am not sure why but I can not load LoRA model from SimpleTuner, no effect. Please fix, thanks! <3

Jan 06 '25 11:01 DefinitlyEvil

Hi, I am not sure why but I can not load LoRA model from SimpleTuner, no effect. Please fix, thanks! <3

Can you provide the LoRA model file?

Jan 06 '25 16:01 wailovet

Sure, where can I send it?

Jan 06 '25 17:01 DefinitlyEvil

Is there a url that can be provided for download?

Jan 07 '25 01:01 wailovet

@wailovet I can send via e-mail.

Jan 07 '25 19:01 DefinitlyEvil

@wailovet I can send via e-mail.

This is my e-mail. [email protected]

I guess that the LoRA model trained by SimpleTuner uses Diffusers+PEFT. In ComfyUI, some key-value conversions may be required.

Jan 08 '25 01:01 wailovet

@wailovet Hi, mail sent, pls check!

Jan 10 '25 12:01 DefinitlyEvil

I haven't found a way to directly load diffusers lora in ComfyUI. However, you can use a script for conversion. https://github.com/huggingface/diffusers/blob/main/scripts/convert_diffusers_sdxl_lora_to_webui.py

python convert_diffusers_sdxl_lora_to_webui.py --input_lora ./lora_sample.safetensors  --output_lora ./lora_sample_sd.safetensors

The converted model is working normally on my side.

Jan 11 '25 18:01 wailovet

I haven't found a way to directly load diffusers lora in ComfyUI. However, you can use a script for conversion. https://github.com/huggingface/diffusers/blob/main/scripts/convert_diffusers_sdxl_lora_to_webui.py
python convert_diffusers_sdxl_lora_to_webui.py --input_lora ./lora_sample.safetensors  --output_lora ./lora_sample_sd.safetensors
The converted model is working normally on my side.

Thx, I gonna try!

Jan 11 '25 20:01 DefinitlyEvil