taming-transformers
taming-transformers copied to clipboard
CompVis
Discriminator loss remains unchanged during training
Great work!
I am working on my own dataset recently. During training, I found two odd things about the loss. I really appreciate the guidance of you if you've had the same problems before.
a. I fit in my own dataset, the whole process runs well except that the D loss during training remains 1! I followed the same procedure where Discriminator started after several epochs. Seems that D losses its ability to distinguish the real and fake. I decrease the number of pre-running epochs but ended in the same result.
b. I tried to exclude the D loss and keep the perceptual loss. The reconstructed results seem fine, except that within the complex-pattern area there exists some blocking effect noise. I wonder whether you guys ran into the same odd before.
All in all, I really think this piece of work is a big step toward better text-image generation.
Would you be willing to share your setup, for training this on a custom dataset? I'm trying to go through this myself, only started, and would welcome some advice.
@tearscoco Did you somehow solve the issue? I've encountered the same problem (D loss during training remains 1)
