Thin-Plate-Spline-Motion-Model icon indicating copy to clipboard operation
Thin-Plate-Spline-Motion-Model copied to clipboard

Plans to modify it to perform partswap/faceswap?

Open instant-high opened this issue 2 years ago • 2 comments

Thank you for this great repo.

I'm using the original FOMM for about 2 years. But your modification gives much better results. Are you planning to modify it so we can use it for face swap / part swap like the motion co-segmentation branch of FOMM?

I've made major modifications to the motion co-segmentation repo, so that now it performs 'automatic' face tracking / cropping / face swap /colour correction and putting all together again.

It would be nice to do that with a version that gives even better results.

instant-high avatar Jun 07 '22 14:06 instant-high

The current version of the model cannot do part swap tasks

Because the current model learns by unsupervised method, the contribution of each TPS to the optical flow is not concentrated in one region like FOMM, but scattered in various locations on the face. And good motion transfer results can only be obtained when multiple TPSs cooperate.

yoyo-nb avatar Jun 11 '22 10:06 yoyo-nb

Thanks for your reply.

instant-high avatar Jun 11 '22 21:06 instant-high