mediapipe icon indicating copy to clipboard operation
mediapipe copied to clipboard

Hand World Landmarks are not accurate

Open Javacr opened this issue 1 year ago • 4 comments

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)

None

OS Platform and Distribution

windows 10

MediaPipe Tasks SDK version

0.10.10

Task name (e.g. Image classification, Gesture recognition etc.)

Gesture recognition

Programming Language and version (e.g. C++, Python, Java)

python

Describe the actual behavior

Hand 2D landmarks are accurate, but hand world landmarks are bad

Describe the expected behaviour

Hand world landmarks are accurate

Standalone code/steps you may have used to try to get what you need

I follow https://ai.google.dev/edge/mediapipe/solutions/vision/gesture_recognizer/python to detect hand gesture, and I plot 2D and 3D hand landmarks. The 3D hand landmarks are weird.

Other info / Complete Logs

No response

Javacr avatar Aug 16 '24 02:08 Javacr

image image image image red represents left hand, blue represents right hand

Javacr avatar Aug 16 '24 02:08 Javacr

image image image image

In fact, most of the time, the results are correct. The bad results are due to the limitations of the algorithm itself.

Javacr avatar Aug 16 '24 10:08 Javacr

Hi @Javacr,

Thank you for bringing this issue to our attention. We are aware of the problem, as noted in this GitHub issue. For now, we are marking it as a bug and assigning it to our team for further investigation so that it will be on our radar However, we currently do not have a timeline for a fix and cannot provide any updates at this time.

kuaashish avatar Aug 21 '24 08:08 kuaashish

Hi @Javacr,

Thank you for bringing this issue to our attention. We are aware of the problem, as noted in this GitHub issue. For now, we are marking it as a bug and assigning it to our team for further investigation so that it will be on our radar However, we currently do not have a timeline for a fix and cannot provide any updates at this time.

Thank you, look forward to your future resolution of this bug.

Javacr avatar Sep 03 '24 07:09 Javacr