GAN_stability icon indicating copy to clipboard operation
GAN_stability copied to clipboard

Spectral Normalization

Open oleksandrlazariev opened this issue 6 years ago • 3 comments

I'm curious if you've tried the Spectral Normalization technic for your approach? At least at resolution 128^2 it didn't work for me

oleksandrlazariev avatar Nov 19 '18 13:11 oleksandrlazariev

We haven't tried to combine spetral norm with our method, but depending on the spectral norm implementation your problems might be related to how our code handles trainable parameters. Here and here we set all parameters of the generator / discriminator to trainable, which might also affect the u and v vectors of the spectral norm (which shouldn't be trainable). You can use buffers instead, but then you have to make sure that the running average still works, which currently only operates on the parameters.

LMescheder avatar Nov 19 '18 14:11 LMescheder

@LMescheder thanks for the quick reply. I'll give it a try accordingly to your insights

oleksandrlazariev avatar Nov 19 '18 14:11 oleksandrlazariev

@oleksandrlazariev Hi, did you work fine with SN ??

Johnson-yue avatar May 17 '19 04:05 Johnson-yue