ComfyUI icon indicating copy to clipboard operation
ComfyUI copied to clipboard

Can't apply loras on playground 2.5

Open axel578 opened this issue 1 year ago • 4 comments

Applying lora onto playground 2.5 model doesn't seem to work, it works in diffusers, they seem to have made changes to support it: https://github.com/huggingface/diffusers/pull/7126

axel578 avatar Apr 25 '24 18:04 axel578

Are you using loras that were specifically trained for playground 2.5 and that used the specific EDM training method? PG2.5 is its own custom trained model. It shares the same SDXL architecture, but they use their completely own dataset. Therefore, loras that were trained for regular SDXL models will not work with PG2.5 because the data in their network is inherently completely different.

RandomGitUser321 avatar Apr 26 '24 08:04 RandomGitUser321

Are you using loras that were specifically trained for playground 2.5 and that used the specific EDM training method? PG2.5 is its own custom trained model. It shares the same SDXL architecture, but they use their completely own dataset. Therefore, loras that were trained for regular SDXL models will not work with PG2.5 because the data in their network is inherently completely different.

Yeah I kno, I trained them myself, as stated they work using diffusers, I know about edm

axel578 avatar Apr 26 '24 16:04 axel578

Post a simple comfyui workflow of it not working

RandomGitUser321 avatar Apr 28 '24 01:04 RandomGitUser321

Post a simple comfyui workflow of it not working

You just apply lora onto the model using the EDM scheduler and you can see it, its really just the base workflow for lora with EDM scheduler.

axel578 avatar May 01 '24 16:05 axel578