NextFace icon indicating copy to clipboard operation
NextFace copied to clipboard

Wrong pose and higher iterStep1 lead to bad shape

Open Michaelwhite34 opened this issue 3 years ago • 5 comments
trafficstars

iterStep1 2000 left Deep3DFaceRecon_pytorch, right NextFace. Image 11 Image 12 e5895849736cc2a677c7386e31d6 iterStep1 10000
debug1_iter0_frame0 render_0

landmarks0

Michaelwhite34 avatar Aug 30 '22 09:08 Michaelwhite34

Hi I never tested with 10000 iterations, u need to increase the shape/expression regularuzation to get better fitting

abdallahdib avatar Sep 11 '22 11:09 abdallahdib

Hi I never tested with 10000 iterations, u need to increase the shape/expression regularuzation to get better fitting

But 2000 iterations still gives bad results, some clear facial feather doesn't match, like nose.

Michaelwhite34 avatar Sep 11 '22 13:09 Michaelwhite34

Did u try multiple view points for same subject? This could improve the accuracy of the geometry. Using single image for the reconstruction is ill posed. Having multiple views improves.

abdallahdib avatar Sep 11 '22 13:09 abdallahdib

Did u try multiple view points for same subject? This could improve the accuracy of the geometry. Using single image for the reconstruction is ill posed. Having multiple views improves.

I mean, I am not even talking about side view of nose, the input is front view and the reconstructed nose is very different in front view.

Michaelwhite34 avatar Sep 11 '22 13:09 Michaelwhite34

U may need to improve/add more facial landmarks to obtain an accurate fitting.

abdallahdib avatar Sep 11 '22 13:09 abdallahdib