mediapipe icon indicating copy to clipboard operation
mediapipe copied to clipboard

Missing 2 landmarks in between standard and attention FaceMesh model.

Open janglinko-dac opened this issue 3 years ago • 2 comments

Hello! As I understand from documentation, AttentionModule produces 478 landmars face model, adding Irises to the standard one. mp_face_mesh.FACEMESH_NUM_LANDMARKS = 468 mp_face_mesh.FACEMESH_NUM_LANDMARKS_WITH_IRISES = 478 However, mp_face_mesh.FACEMESH_IRISES=8.

My question is what are those two missing landmarks? I have 468 landmarks canonical face model and I want to solve PnP. I could not find 478 landmarks canonical face model. If You can provide me with such one, it will be great!

Best, Jan

janglinko-dac avatar Jul 13 '22 07:07 janglinko-dac

Hi @janglinko-dac, Could you please elaborate your query with complete details. Thank you!

kuaashish avatar Jul 14 '22 06:07 kuaashish

Hi @kuaashish, thanks for the response. I want to estimate a head pose in the camera frame. I want to use FaceMesh module to detect landmarks and then, with use of a canonical facel model, solve PnP to get the position.

In the documentation is it said:

In addition to the Face Landmark Model we provide another model that applies attention to semantically meaningful face regions, and therefore predicting landmarks more accurately around lips, eyes and irises, at the expense of more compute. It enables applications like AR makeup and AR puppeteering.

The attention mesh model can be selected in the Solution APIs via the refine_landmarks option.

Attention mesh results in face 478 landmarsk. mp_face_mesh.FACEMESH_NUM_LANDMARKS_WITH_IRISES = 478

My canonical face model has 468 landmarks (like the output with refine_landmarks=False), but i want to use attention mesh, as results are more accurate.

I would like to remove landmarks added by attention mesh, but there are only 8 Iris landmarks. So, 2 landmarks left to remove and i don't know their numbers.

My question is about the numbers of these 2 landmarks.

janglinko-dac avatar Jul 14 '22 08:07 janglinko-dac

Hello @janglinko-dac, We are upgrading the MediaPipe Legacy Solutions to new MediaPipe solutions However, the libraries, documentation, and source code for all the MediapPipe Legacy Solutions will continue to be available in our GitHub repository and through library distribution services, such as Maven and NPM.

You can continue to use those legacy solutions in your applications if you choose. Though, we would request you to check new MediaPipe solutions which can help you more easily build and customize ML solutions for your applications. These new solutions will provide a superset of capabilities available in the legacy solutions. Thank you

kuaashish avatar May 05 '23 10:05 kuaashish

This issue has been marked stale because it has no recent activity since 7 days. It will be closed if no further activity occurs. Thank you.

github-actions[bot] avatar May 13 '23 01:05 github-actions[bot]

This issue was closed due to lack of activity after being marked stale for past 7 days.

github-actions[bot] avatar May 22 '23 01:05 github-actions[bot]

Are you satisfied with the resolution of your issue? Yes No

google-ml-butler[bot] avatar May 22 '23 01:05 google-ml-butler[bot]