annotated_deep_learning_paper_implementations icon indicating copy to clipboard operation
annotated_deep_learning_paper_implementations copied to clipboard

[BUG] StyleGAN2: latent vector is ignored

Open karray opened this issue 3 years ago • 3 comments

The implementation of StyleGAN2 does not learn a mapping for the latent vector z. The vector z is completely ignored, and a variety of generated images is provided by noise. To demonstrate the issue, I created a google colab with a pre-trained model that I trained for 55400 iterations.

Images genertd with a random z and a fixed noise: image

Images generated with a fixed z and random noise image

karray avatar Feb 07 '22 10:02 karray

Thanks. Will look into it.

vpj avatar Feb 07 '22 12:02 vpj

False or Weakening. Ignore or Endure

Siimarras avatar Mar 26 '23 09:03 Siimarras

Sorry for commenting on a rather old issue, but I've recently implemented StyleGAN2 (being helped by the code from this repository too) and experienced a similar issue - however, in my case, it wasn't due to z or noise.

My models were actually experiencing mode collapse, and no matter what the input was, a pretrained model would always generate the same image. I managed to overcome this issue by playing around with the learning rates and number of gradient accumulation steps.

lukaboljevic avatar May 22 '23 19:05 lukaboljevic