TransGAN icon indicating copy to clipboard operation
TransGAN copied to clipboard

about test

Open maoshen5 opened this issue 3 years ago • 10 comments
trafficstars

Now I have experimented with a framework in which the generator is transgan and the discriminator is autogan, but it doesn't seem to converge? Epoch is 320, and the experimental result FID is 130. What tricks did you use in the experiment?Thank you

maoshen5 avatar Jul 17 '22 14:07 maoshen5

Now I have experimented with a framework in which the generator is transgan and the discriminator is autogan, but it doesn't seem to converge? Epoch is 320, and the experimental result FID is 130. What tricks did you use in the experiment?Thank you

maoshen5 avatar Jul 22 '22 01:07 maoshen5

yeah, training GAN is comparably tricky, I would suggest you to go with AutoGAN's repo and run the experiments, make sure you get the reasonable FIDs and then replace AutoGAN's generator with Transformer. Then you will get the expected output.

yifanjiang19 avatar Jul 23 '22 19:07 yifanjiang19

OK,But isn't the weight propagation of the pre training model the same? Can we still use the pre training model of autogan after this change?

maoshen5 avatar Jul 28 '22 06:07 maoshen5

I use autogan's generator and discriminator to train to 180 epochs, is to train to 8.3, and FID to train to 15. However, when I use this model to train the generator to be transformer, and the discriminator is an autogan model, after training from 180 to 200 epochs, is suddenly reduced to 1.3, and FID rises to more than 320. Is this normal?

maoshen5 avatar Aug 07 '22 04:08 maoshen5

this is not normal. I've tried it before and the IS should be around 8.7-8.8 @maoshen5 I think you should try to tune the hyper parameter and learning rate

yifanjiang19 avatar Aug 11 '22 18:08 yifanjiang19

OK,then,do I need to prohibit the training of certain epoch autogan discriminators to continue training, and only train the generator of transformer?

maoshen5 avatar Aug 17 '22 01:08 maoshen5

no, just follow the standard training of AutoGAN.

yifanjiang19 avatar Aug 21 '22 18:08 yifanjiang19

I adjusted the learning rate, but now I can only adjust it to about 100 epochs at most. Is is 7 and FID is 30. But after 110 epochs, the loss of the generator will change around 0, and the loss of the discriminator will not drop any more. The FID index will also rise. I suspect that the generator's ability completely exceeds the discriminator after 100 epochs. When you train to 320 epochs, is the indicator of GAN still rising? Thank you

maoshen5 avatar Sep 06 '22 05:09 maoshen5

yeah, I had same observation that IS/FID will get worse after longer training. But that IS is > 8.0 in my case. Sorry, I don't have the script to run this now.

yifanjiang19 avatar Sep 14 '22 01:09 yifanjiang19

I adjusted the learning rate, but now I can only adjust it to about 100 epochs at most. Is is 7 and FID is 30. But after 110 epochs, the loss of the generator will change around 0, and the loss of the discriminator will not drop any more. The FID index will also rise. I suspect that the generator's ability completely exceeds the discriminator after 100 epochs. When you train to 320 epochs, is the indicator of GAN still rising? Thank you

Hello, did you solve this problem?

dipth11 avatar Oct 27 '23 03:10 dipth11