how do i run it by diffusers

[xiekong]

give some examples，please

[xiankgx]

Sharing this thread.

The base layer diffusion model is a SDXL LoRA trained on the modified latent space. I managed to convert the given checkpoint to LoRA and use it with diffusers by calling pipe.load_lora_weights().

But how do you use the other four layer modules:

• layer_xl_bg2ble.safetensors
• layer_xl_bgble2fg.safetensors
• layer_xl_fg2ble.safetensors
• layer_xl_fgble2bg.safetensors

Its tightly integrated with sd-forge and using things like extra_concat_cond and I have no idea how to integrate them to diffusers.

[xiekong]

i am waiting for the official integration plan

[nighting0le01]

@xiankgx can you share how you used the base model for inference in diffusers?

[CustodialMatter]

Also curious how this could work with diffusers