About extract 3D landmarks from VOCA

[kuanxin]

How to extract the 3d feature points of the obj mesh output by VOCA...>< Many thanks

[TimoBolkart]

May I ask what you intend to do with the landmarks extracted from a VOCA mesh? VOCA outputs meshes in FLAME topology which provides a much denser correspondence than just 51 / 68 landmarks.

However, if you are still interested in the landmarks, just load the FLAME landmark embedding, the FLAME mesh output from VOCA, and call the function mesh_points_by_barycentric_coordinates in here. This returns you the 3D landmarks in that mesh.

[kuanxin]

@TimoBolkart I try to change the 68/51 landmarks of the obj face model in unity3d to achieve the animation effect that the face model is talking. I am not sure is the correct way...

Thanks for your reply! It's very helpful.

[kuanxin]

@TimoBolkart For example, I have a 3D face model generated by DECA, how to use VOCA to make this face model lip-sync in Blender or unity3d?

Thank you

[airfri]

@TimoBolkart
May I ask how to calculate the two formal parameters mesh_vertsand mesh_facesof the function mesh_points_by_barycentric_coordinates from VOCA flame mesh output？