ganhacks icon indicating copy to clipboard operation
ganhacks copied to clipboard

Trick 2 explanation

Open techmatt opened this issue 8 years ago • 1 comments

I don't fully understand the phrase in trick 2:

"In practice, works well: Flip labels when training generator: real = fake, fake = real"

Is this saying that with low probability you should corrupt the labels? (although that seems to be what trick 6 says.)

techmatt avatar Feb 03 '17 07:02 techmatt

The second parts of trick 2 and trick 6 do the same thing, but are applied during different updates. Trick 6 - flip labels occasionally while training D and trick 2 - flip labels while training G. Even though both are aimed at weakening the discriminator, the motivation behind these tricks seem different to me. Trick 2's flip is motivated by G wanting to degrade(fool) D, while trick 6's flip is an attempt to prevent D from becoming too strong(which is undesirable). This is my intuition, corrections are welcome.

vijayvee avatar Feb 14 '17 05:02 vijayvee