menpofit icon indicating copy to clipboard operation
menpofit copied to clipboard

Question: Fitting a 2D face image onto a 3D model

Open usmancheema89 opened this issue 2 years ago • 0 comments

Is it possible to fit a 2D face image or a custom 3D face model without morphing the 3D model using face keypoints?

The process would be given a 2D face image and a custom 3D face mesh 1 - detect face landmarks on 2D image 2 - identify corresponding face landmarks on 3D face mesh (land marks can be pre-annotated) 3 - deform/transform the 2D face image to aling the land marks location 4 - use the transformed image as texture for 3D face 5 - project the 3D face to 2D

While doing this retain realism and expressions of the 2D face?

usmancheema89 avatar Feb 07 '23 09:02 usmancheema89