menpofit
menpofit copied to clipboard
Question: Fitting a 2D face image onto a 3D model
Is it possible to fit a 2D face image or a custom 3D face model without morphing the 3D model using face keypoints?
The process would be given a 2D face image and a custom 3D face mesh 1 - detect face landmarks on 2D image 2 - identify corresponding face landmarks on 3D face mesh (land marks can be pre-annotated) 3 - deform/transform the 2D face image to aling the land marks location 4 - use the transformed image as texture for 3D face 5 - project the 3D face to 2D
While doing this retain realism and expressions of the 2D face?