VTuber-Python-Unity icon indicating copy to clipboard operation
VTuber-Python-Unity copied to clipboard

The reason why somttimes iris_image_points will run out of range

Open DannisMa opened this issue 2 years ago • 1 comments

image

If you will list index out of range in main iris_image_points[j, 0] = faces[0][j + 468][0], you need to check your face detector init.

image

You need to set refine_landmarks be Ture. It mean detector will detect detail.

DannisMa avatar May 01 '22 08:05 DannisMa

Thank you for mentioning this. I would like to add on a bit.

After an update, there is one more API option available, which is the "refinelandmarks". From the official description, it "further refine the landmark coordinates around the eyes and lips" and output 10 more landmarks around iris for enhanced iris tracking, in the expense of a bit extra computational power. That's why there is one more for-loop to get the extra iris points without affecting the original 468 landmarks.

There are further details in their website about the extra landmarks. https://google.github.io/mediapipe/solutions/face_mesh#solution-apis

mmmmmm44 avatar May 01 '22 14:05 mmmmmm44