GANs-collections-tf2.0_keras-eager_mode icon indicating copy to clipboard operation
GANs-collections-tf2.0_keras-eager_mode copied to clipboard

Loss of WGAN does not converge

Open Curry-whs opened this issue 3 years ago • 2 comments

The loss curve of my WGAN does not converge all the time, and I do not know why. Could anyone help me?I have changed the whole model many times, and the best result is that it starts to converge and collapse at 250peochs,the loss curve just like this : c13d00bce75dd2d7390953e332db4bb adfbee48d8597e10b59ba6399f40889

my code looks like this: image image image image image image image image

So how to solve this problem?

Curry-whs avatar Oct 09 '21 07:10 Curry-whs

Have you solved the problem? My WGAN loss is also not convergent

tf2gan avatar May 21 '22 13:05 tf2gan

Gradient clipping instead of weight clipping

for WGAN model all the gradients should clip to (-0.01,0.01)

    for idx,grad in enumerate(gradients_of_d) :
        gradients_of_d[idx]=tf.clip_by_value(grad,-0.01,0.01)

senu-et avatar Sep 17 '22 18:09 senu-et