One-Shot-Face-Swapping-on-Megapixels icon indicating copy to clipboard operation
One-Shot-Face-Swapping-on-Megapixels copied to clipboard

Published 20 hours ago • verified publisher icon zyainfal

some unknown reason badcases

Open Arthurzhangsheng opened this issue 3 years ago • 2 comments

when I pick the celabAHQ img id randomly to swap, some id pairs seams wrong

badcases: 9b938af55d9a486842fb84e86d58bd0 1576ceb4f1576f5ca5f45444c6d07d8 2-116 3-116 2-120 3-120 25043-1291 25043-1302 25043-1851

normal cases: image

anyone know why?

Arthurzhangsheng avatar Oct 31 '21 04:10 Arthurzhangsheng

For bad examples, HieRFE may predict bad latent codes for FTM to swap faces. These bad latent codes may not be used even for reconstruction. So, you could solve this by refining those latent codes through optimized GAN Inversion methods.

Or, you may want to fine-tune HieRFE and FTM with more data, which should be helpful either.

zyainfal avatar Oct 31 '21 12:10 zyainfal

Exactly, some other similar cases were found when swapping faces from CelebAMask-HQ.

29230_to_29714, 29198_to_28541, 29387_to_28689 (in to format)

Normal cases:

LiUzHiAn avatar Apr 29 '22 14:04 LiUzHiAn