Pose Landmarker returns NormalizedLandmarks objects without visibility

[mihaiEDW]

MediaPipe Solution (you are using)

Pose Landmark Detection

Programming language

typescript

Are you willing to contribute it

Yes

Describe the feature and the current behaviour/state

Current behaviour:

The documentation states here (https://developers.google.com/mediapipe/solutions/vision/pose_landmarker/web_js#handle_and_display_results) that the Pose Landmarker returns a poseLandmarkerResult object, which in turn contains a visibility parameter.

However, when using the demo provided by the Mediapipe Team, there is no such visibility parameter returned.

Feature:

I'd like to propose a small change to the information returned in the NormalizedLandmarks object: visibility and presence, as per the current documentation and the past Mediapipe versions.

Will this change the current API? How?

Yes, the change will be visible in the NormalizedLandmarks object, as it will contain two more parameters when returned: visibility and presence.

This will not only allow developers use the current version of Mediapipe in the same ways that they used it in the past, but it will allow for extended functionality, for a very small change.

Who will benefit with this feature?

The developers building apps and solutions using Mediapipe.

Please specify the use cases for this feature

- view if the people are fully in the camera frame
- view which pose landmarks are seen correctly
- view how the person is standing, relative to the camera

Any Other info

It seems that this feature was available in the past versions and I can't understand why it is no more available.

[kuaashish]

Hello @lu-wang-g,

Could you please look into this feature request. Thank you

[schmidt-sebastian]

@yichunk

[galharth]

Any update ? thanks :)

[ewan-m]

I am interested in this also! Happy to contribute a PR for it (visibility and presence both) 😄

[schmidt-sebastian]

@yichunk - We need to take another look.

[kuaashish]

Hi @mihaiEDW,

Could you please verify the current status using the nightly version at https://www.npmjs.com/package/@mediapipe/tasks-vision/v/0.10.12-rc.20240407? It must return the visibility due to the merged pull request. These changes are expected to be included in the upcoming major release.

Thank you!!

[github-actions[bot]]

This issue has been marked stale because it has no recent activity since 7 days. It will be closed if no further activity occurs. Thank you.

[github-actions[bot]]

This issue was closed due to lack of activity after being marked stale for past 7 days.