stable-fast icon indicating copy to clipboard operation
stable-fast copied to clipboard

Is this package compatible with Lycoris LoRAs

Open JohnnyRacer opened this issue 1 year ago • 3 comments

Hello, I see that in the read me that stable-fast supports LoRAs out of the box. Does anyone know if it's possible to use Lycoris LoRAs with this package? The Nvidia TensorRT extension for A1111 seems have questionable support for them.

JohnnyRacer avatar Dec 14 '23 09:12 JohnnyRacer

Hello, I see that in the read me that stable-fast supports LoRAs out of the box. Does anyone know if it's possible to use Lycoris LoRAs with this package? The Nvidia TensorRT extension for A1111 seems have questionable support for them.

Can you share your desired use case and script with me so that I can test if it works?

chengzeyi avatar Dec 14 '23 16:12 chengzeyi

Reading up, it's a whole family of algorithms similar to lora:

https://github.com/KohakuBlueleaf/LyCORIS/blob/main/docs/Algo-List.md

The diffusers framework mentions partial support for some of them which means they probably already work?

https://huggingface.co/docs/diffusers/v0.25.1/en/using-diffusers/loading_adapters#kohya-and-thelastben

"LyCORIS checkpoints aren’t fully supported. The load_lora_weights() method loads LyCORIS checkpoints with LoRA and LoCon modules, but Hada and LoKR are not supported."

Luke2642 avatar Jan 25 '24 12:01 Luke2642

Reading up, it's a whole family of algorithms similar to lora:

https://github.com/KohakuBlueleaf/LyCORIS/blob/main/docs/Algo-List.md

The diffusers framework mentions partial support for some of them which means they probably already work?

https://huggingface.co/docs/diffusers/v0.25.1/en/using-diffusers/loading_adapters#kohya-and-thelastben

"LyCORIS checkpoints aren’t fully supported. The load_lora_weights() method loads LyCORIS checkpoints with LoRA and LoCon modules, but Hada and LoKR are not supported."

It should.

chengzeyi avatar Feb 09 '24 09:02 chengzeyi