SimSwapHD icon indicating copy to clipboard operation
SimSwapHD copied to clipboard

Discriminator feature matching loss

Open leicaand opened this issue 3 years ago • 2 comments

The "Weak Feature Matching Loss" is different (both here and in the original repo), from the one mentioned in the paper (the features from all the layers are used, instead of the last few layers)

leicaand avatar Oct 21 '21 09:10 leicaand

From my training experience, it is better to add feature matching loss to all layer features of D. This operation is conducive to achieving a better training balance.

a312863063 avatar Dec 13 '21 17:12 a312863063

From my training experience, it is better to add feature matching loss to all layer features of D. This operation is conducive to achieving a better training balance.

I noticed that getIntermFeat in discriminator is set to False as default which makes D returns only last layer output. If all layer features of D should be used for wfm, should getIntermFeat be set to True?

gitlabspy avatar Feb 09 '22 03:02 gitlabspy