keras-dcgan icon indicating copy to clipboard operation
keras-dcgan copied to clipboard

Published 20 hours ago • verified publisher icon jacobgil

Slow to converge

Open 8enmann opened this issue 8 years ago • 2 comments

When I ran this, after 4 epochs G appeared to be farther and farther from converging (currently g_loss~=3) while D does appear to be converging slowly. Can you post a tensorboard screenshot of the convergence behavior?

8enmann avatar Sep 19 '16 05:09 8enmann

Would be interesting to know how long this model needs to be trained to converge.

anjishnu avatar Feb 06 '17 09:02 anjishnu

I trained it yesterday with the default settings for ±18 epochs (468 batches of 128 images each) and then plotted d_loss and g_loss: all It seems like it has 3 phases, 0-300, 300-1500 and the rest. A closer look to the first ±600 batches: part One interesting finding is that when generating output with the nice option turned off, it creates mostly 1s and a lot of 0s. With nice turned on, the class distribution is much more even.

worbit avatar Feb 18 '17 14:02 worbit