brian6091

What is your prior_loss_weight? Not sure there is a problem per se, as your total loss is decreasing.

I can confirm what @qunash found. With gradient checkpointing enabled, the lora weights for both the unet and the text encoder will not change when printed to screen. However, in...

@kingofprank for joint training, I've enabling gradient checkpointing for the unet only, and just *not* enabling it for the text encoder. This works, and I think you get most of...

> > I face the same problem when opening gradient checkpointing, Is there a way to solve this problem under text-encoder and unet joint training? > > Kohya's repo seems...

Ah, nice trick. Thanks