insightface icon indicating copy to clipboard operation
insightface copied to clipboard

MetaHuman + Photogrammetry + InsightFaceSwap (Deepfake)?

Open wilhelmli opened this issue 2 years ago • 13 comments

Any solutions for creating MetaHumans using a deepfake version of InsightFaceSwap? Screenshot_2023-05-27_at_10 40 16_ins

Reddit post: https://www.reddit.com/r/unrealengine/comments/13sbl5u/am_i_the_only_one_using_insightfaceswap_for/

wilhelmli avatar May 27 '23 03:05 wilhelmli

You may ask the author of that thread.

nttstar avatar May 27 '23 06:05 nttstar

You may ask the author of that thread.

I am the author lol. I experimented with a few deepfake models(render videos), but the quality is not yet ideal for photogrammetry.

Is there an option for batch swap similar to Upscayl?

wilhelmli avatar May 27 '23 06:05 wilhelmli

What is the ideal resolution for metahuman?

nttstar avatar May 27 '23 06:05 nttstar

What is the ideal resolution for metahuman?

The resolution of the current model on MJ is already sufficient. What we need is video input, or batch process the images frame by frame from input video.

wilhelmli avatar May 27 '23 06:05 wilhelmli

I see, right now it's not possible. Do you think it's a very effective tool for creating metahuman, if it supports video pipeline?

nttstar avatar May 27 '23 06:05 nttstar

I see, right now it's not possible. Do you think it's a very effective tool for creating metahuman, if it supports video pipeline?

If achieved, we can push out mesh WITHOUT video captures of the actual person. 我觉得insight模型挺屌的,有很大空间。

wilhelmli avatar May 27 '23 06:05 wilhelmli

I see, right now it's not possible. Do you think it's a very effective tool for creating metahuman, if it supports video pipeline?

If achieved, we can push out mesh WITHOUT video captures of the actual person. 我觉得insight模型挺屌的,有很大空间。

你这个评价很屌

nttstar avatar May 27 '23 06:05 nttstar

Here is another interesting example. Reversed process!

/saveID from this 3D clay mesh CywxwZYRS8g

/swapid input Screenshot 2023-05-25 at 11 11 04

/swapid image output Screenshot_2023-05-25_at_11 17 17_ins

wilhelmli avatar May 27 '23 06:05 wilhelmli

sharpness is even higher than the original image

nttstar avatar May 27 '23 06:05 nttstar

sharpness is even higher than the original image

Particularly, Insight model did a really good job for Eyes, which is something quite valuable. 眼睛是心灵的窗户哈哈 Screenshot_2023-05-27_at_15 00 59_ins

wilhelmli avatar May 27 '23 07:05 wilhelmli

For this image does it look similar to the source identity?

nttstar avatar May 27 '23 07:05 nttstar

For this image does it look similar to the source identity?

I created a new id with an image of young Keanu. KeanuReeves 159366 Then this one with Keanu at present day, the facial matches really well~ Screenshot_2023-05-27_at_15 12 54_ins keanu-reeves-net-worth-in-2023-64141295ab76325253328-900

wilhelmli avatar May 27 '23 07:05 wilhelmli

looks good

nttstar avatar May 27 '23 07:05 nttstar