Johnson yue

How to train lora with controlnet in unet??

1

thanks your work, I can train lora as usually method , it work good . but when using sd15 base model + lora (I trained) + controlnet, the generate image...

how to use this flash-attention in python code ?

8

Hi ,thank you for implement flash-attention in MPS , it can be run flash-attention on Mac . But no document to say how to use it in python or pytorch...

fix typo

why gdpp loss always (almost) negative， it can't compute BCE loss

6

Hi, I was trying your gdpp loss with pytorch version, but when I add gdpp loss on G_loss, the training process crash, because the G_loss(~1.0) + gdpp_loss is negative. So,...