mediapipe_face_iris_cpp icon indicating copy to clipboard operation
mediapipe_face_iris_cpp copied to clipboard

Get the 3d coordinate output of the model

Open Youmimzy opened this issue 2 years ago • 6 comments

image image The output data seems to be different from python,where am i doing wrong?

Youmimzy avatar Sep 27 '22 10:09 Youmimzy

Hi @Youmimzy, did you rescale the coordinate like FaceLandmark::getFaceLandmarkAt ?

pntt3011 avatar Sep 27 '22 14:09 pntt3011

你好@Youmimzy,您是否重新调整了坐标FaceLandmark::getFaceLandmarkAt

image This code they output is the pixel coordinates of the image, I want to know how to operate the output three-dimensional coordinates of the world。thanks。

Youmimzy avatar Sep 27 '22 15:09 Youmimzy

I think the official code does some post-processing with the output from tensorflowlite model. You can check my answer here

pntt3011 avatar Sep 28 '22 00:09 pntt3011

我认为官方代码对 tensorflowlite 模型的输出进行了一些后处​​理。你可以在这里查看我的答案

Thanks for your guidance, I solved the problem。

Youmimzy avatar Sep 28 '22 06:09 Youmimzy

我认为官方代码对 tensorflowlite 模型的输出进行了一些后处​​理。你可以在这里查看我的答案

感谢您的指导,我解决了这个问题。

Sorry I found that I didn't seem to solve this problem. I modified my own code to get the normalized real world x, y, z coordinates through the following official code. image my code: image But the output doesn't seem to be correct, what am I doing wrong?

Youmimzy avatar Sep 28 '22 10:09 Youmimzy

I mentioned in the link above that using the model alone cannot give you the real-world coordinates. The normalize step just gives you the image coordinate (even z axis). According to the official doc, they use a geometry module to process the model output. Maybe the python wrapper has that module included.

pntt3011 avatar Sep 28 '22 11:09 pntt3011