training freeze

[raylu1314coding]

(epoch: 4, iters: 14800, time: 0.085, data: 0.001) G_GAN: 0.908 G_L1: 8.419 D_real: 1.730 D_fake: 0.254 (epoch: 4, iters: 14900, time: 0.041, data: 0.001) G_GAN: 1.959 G_L1: 4.833 D_real: 0.900 D_fake: 0.095 (epoch: 4, iters: 15000, time: 0.040, data: 0.001) G_GAN: 1.928 G_L1: 12.184 D_real: 2.155 D_fake: 0.082 saving the latest model (epoch 4, total_iters 75000) (epoch: 4, iters: 15100, time: 0.041, data: 0.001) G_GAN: 2.237 G_L1: 3.930 D_real: 0.087 D_fake: 0.155 (epoch: 4, iters: 15200, time: 0.094, data: 0.001) G_GAN: 2.362 G_L1: 29.048 D_real: 0.000 D_fake: 0.130 (epoch: 4, iters: 15300, time: 0.040, data: 0.001) G_GAN: 2.675 G_L1: 7.681 D_real: 0.003 D_fake: 0.153 (epoch: 4, iters: 15400, time: 0.040, data: 0.001) G_GAN: 1.852 G_L1: 10.161 D_real: 0.125 D_fake: 0.556 (epoch: 4, iters: 15500, time: 0.041, data: 0.001) G_GAN: 1.870 G_L1: 8.213 D_real: 0.165 D_fake: 0.287 (epoch: 4, iters: 15600, time: 0.088, data: 0.001) G_GAN: 1.777 G_L1: 9.989 D_real: 1.522 D_fake: 0.062 (epoch: 4, iters: 15700, time: 0.041, data: 0.001) G_GAN: 2.321 G_L1: 5.518 D_real: 0.454 D_fake: 0.128 (epoch: 4, iters: 15800, time: 0.042, data: 0.001) G_GAN: 1.434 G_L1: 14.416 D_real: 0.001 D_fake: 0.428 (epoch: 4, iters: 15900, time: 0.042, data: 0.001) G_GAN: 1.423 G_L1: 4.327 D_real: 0.211 D_fake: 0.783 (epoch: 4, iters: 16000, time: 0.131, data: 0.002) G_GAN: 2.729 G_L1: 14.776 D_real: 0.618 D_fake: 0.097 (epoch: 4, iters: 16100, time: 0.041, data: 0.001) G_GAN: 1.678 G_L1: 12.894 D_real: 0.049 D_fake: 0.346 (epoch: 4, iters: 16200, time: 0.041, data: 0.001) G_GAN: 1.423 G_L1: 7.753 D_real: 1.595 D_fake: 0.135 (epoch: 4, iters: 16300, time: 0.041, data: 0.001) G_GAN: 2.935 G_L1: 12.845 D_real: 0.234 D_fake: 0.057 (epoch: 4, iters: 16400, time: 0.095, data: 0.001) G_GAN: 1.380 G_L1: 5.466 D_real: 0.030 D_fake: 0.928 (epoch: 4, iters: 16500, time: 0.041, data: 0.001) G_GAN: 2.229 G_L1: 21.498 D_real: 0.105 D_fake: 0.171 (epoch: 4, iters: 16600, time: 0.041, data: 0.001) G_GAN: 1.847 G_L1: 18.601 D_real: 0.167 D_fake: 0.273 (epoch: 4, iters: 16700, time: 0.041, data: 0.001) G_GAN: 2.866 G_L1: 10.228 D_real: 0.001 D_fake: 0.098 (epoch: 4, iters: 16800, time: 0.090, data: 0.001) G_GAN: 1.600 G_L1: 6.937 D_real: 0.431 D_fake: 0.228 (epoch: 4, iters: 16900, time: 0.040, data: 0.001) G_GAN: 1.518 G_L1: 13.635 D_real: 0.608 D_fake: 0.428 (epoch: 4, iters: 17000, time: 0.041, data: 0.001) G_GAN: 1.068 G_L1: 7.074 D_real: 1.304 D_fake: 0.447 (epoch: 4, iters: 17100, time: 0.041, data: 0.001) G_GAN: 2.960 G_L1: 5.616 D_real: 0.289 D_fake: 0.061 (epoch: 4, iters: 17200, time: 0.091, data: 0.001) G_GAN: 3.180 G_L1: 4.383 D_real: 0.312 D_fake: 0.043 (epoch: 4, iters: 17300, time: 0.041, data: 0.001) G_GAN: 0.985 G_L1: 4.218 D_real: 0.894 D_fake: 0.526 (epoch: 4, iters: 17400, time: 0.042, data: 0.001) G_GAN: 2.173 G_L1: 11.092 D_real: 0.300 D_fake: 0.109 (epoch: 4, iters: 17500, time: 0.041, data: 0.001) G_GAN: 1.798 G_L1: 33.420 D_real: 0.000 D_fake: 0.448 (epoch: 4, iters: 17600, time: 0.092, data: 0.001) G_GAN: 2.202 G_L1: 9.365 D_real: 0.284 D_fake: 0.124 (epoch: 4, iters: 17700, time: 0.040, data: 0.001) G_GAN: 1.229 G_L1: 4.887 D_real: 1.148 D_fake: 0.134 (epoch: 4, iters: 17800, time: 0.045, data: 0.001) G_GAN: 2.679 G_L1: 16.967 D_real: 0.009 D_fake: 0.159 (epoch: 4, iters: 17900, time: 0.041, data: 0.002) G_GAN: 3.540 G_L1: 26.500 D_real: 0.000 D_fake: 0.180

It always stop(freeze) at epoch: 4, iters: 17900, time: 0.041, data: 0.002, I tried to stop it and use -- continue_train , yes it worked,but still stop at epoch: 4, iters: 17900. How can I solve the problem?

[Entongsu]

I have encountered the same problem and stopped at epoch 167.

[raylu1314coding]

I have solved the problem. You can disable the visdom by setting --display_id 0

[yupan233]

I have solved the problem. You can disable the visdom by setting --display_id 0

hi，can u explain why this work？SUPER THANKS！