mediapipe icon indicating copy to clipboard operation
mediapipe copied to clipboard

visibility and presence always be 0.

Open endink opened this issue 3 years ago • 12 comments

visibility and presence fields in a NormalizedLandmark for the Holistic Solution always be 0. Is this unsupported right now?

endink avatar Jul 11 '22 03:07 endink

Hi @endink, Could you please elaborate your query with complete details. Thank you!

kuaashish avatar Jul 12 '22 11:07 kuaashish

1657682595030

Sorry, visibility and presence the fields is in MediapipeUnityPlugin project.

Simply, if the the score or visibility of the hand landmark in this Holistic scene available now ? ( like the pose landmarks).

BTW, please forgive me for my English grammar errors.

endink avatar Jul 13 '22 03:07 endink

@endink - We opened the same issue but never got a reply on the reason why it never detects anything other than 0, nor that it was a defect

jimb2834 avatar Jul 16 '22 12:07 jimb2834

@jimb2834 we can only wait for a reply...

endink avatar Jul 16 '22 16:07 endink

@kuaashish and @ivan-grishchenko, is there any update on this issue? This issue is affecting other validations such visibility and presence of various points of interest as it is always 0 hence wrong results. One example is palm validation, checks for palm validation and visibility on an image with only points 8,12,16,20,7,11,15,19,6,10,14,19,5,9,13,17, mediapipe is returning other points not available on the image hence wrong result. find sample image below 2022_08_17_21_211_55_Moment(1)

ajmakoni avatar Aug 18 '22 04:08 ajmakoni

@elYeodeol - there are old issues related to Visibility and Presence of landmarks re: face mesh specifically from a while back - https://github.com/google/mediapipe/issues/3200 https://github.com/google/mediapipe/issues/3159

But anytime someone solves it, ping me and we are happy to pay for the solution.

jimb2834 avatar Aug 18 '22 12:08 jimb2834

@elYeodeol - there are old issues related to Visibility and Presence of landmarks re: face mesh specifically from a while back - #3200 #3159

But anytime someone solves it, ping me and we are happy to pay for the solution.

Hi jimb2834, have you looked at Google mlkit library for face landmarks? https://developers.google.com/ml-kit my experience has been impressive.

ajmakoni avatar Aug 18 '22 13:08 ajmakoni

@ajmakoni - Hi, thanks for the message. The main issue was landmark quantity; whether it reflects "visibility" or "presence" I did not check. So the landmark Qty, Visibility, and Presence values were all needed for our use case. GCP ML kit for face has a lower landmark qty.

jimb2834 avatar Aug 18 '22 14:08 jimb2834

@ajmakoni - Hi, thanks for the message. The main issue was landmark quantity; whether it reflects "visibility" or "presence" I did not check. So the landmark Qty, Visibility, and Presence values were all needed for our use case. GCP ML kit for face has a lower landmark qty.

Okay, I get your point

ajmakoni avatar Aug 18 '22 14:08 ajmakoni

Is there any good news for this? Nobody care it?

endink avatar Sep 01 '22 15:09 endink

@endink - I was in the MediaPipe slack channel and saw this

image

jimb2834 avatar Sep 02 '22 12:09 jimb2834

@jimb2834 it only worked for pose landmarks, but not in hand landmarks.

endink avatar Sep 03 '22 01:09 endink

Hello @endink, We are upgrading the MediaPipe Legacy Solutions to new MediaPipe solutions However, the libraries, documentation, and source code for all the MediapPipe Legacy Solutions will continue to be available in our GitHub repository and through library distribution services, such as Maven and NPM.

You can continue to use those legacy solutions in your applications if you choose. Though, we would request you to check new MediaPipe solutions which can help you more easily build and customize ML solutions for your applications. These new solutions will provide a superset of capabilities available in the legacy solutions. Thank you

kuaashish avatar May 05 '23 10:05 kuaashish

This issue has been marked stale because it has no recent activity since 7 days. It will be closed if no further activity occurs. Thank you.

github-actions[bot] avatar May 13 '23 01:05 github-actions[bot]

This issue was closed due to lack of activity after being marked stale for past 7 days.

github-actions[bot] avatar May 20 '23 01:05 github-actions[bot]

Are you satisfied with the resolution of your issue? Yes No

google-ml-butler[bot] avatar May 20 '23 01:05 google-ml-butler[bot]

Mediapipe unity plugin stills gives always 0 for visibility and presence for normalizedlandmarks in handtracking

guunnz avatar Nov 24 '23 20:11 guunnz