Ledzy

I found two problems about the code. First, the reconstruction loss should be L1 loss instead of L2, according to cycleGAN's paper. Second, the generator and discriminator should update simutaneously,...

Does FC domain BN introduce biases when inferencing?

7

Thanks for the excellent work and the highly-organized code. I'm a little confused about the BN behavior of FC for CAN. According to what i observed, during the training, the...

load a model with unmerged lora adapters

3

### Feature request For some reason, I need to train a model's both LoRA modules and the original weights. The model is saved periodically during training. However, if i directly...

I suppose the corresponding backward calculations should be discarded.