mediapipe icon indicating copy to clipboard operation
mediapipe copied to clipboard

Mediapipe how to detect a speific person?

Open ArtfulMinx opened this issue 3 years ago • 2 comments

I observed that it only detects the closest person to the cam in a video, but I want to detect a person who is some distance away and not the closest one? How do I do that?

btw the person I want to detect can be considered to be center of the video

Thank you

ArtfulMinx avatar Jul 21 '22 09:07 ArtfulMinx

+1 I see the issue of detecting multiple persons is repeatedly raised from time to time and the solution suggested (modify the graph) isn't really practical as there is no any tutorial on how to make such graph modification, in addition to the requirement to recompile the whole model. I think MP can do a huge favor to the community by adding support for multi-pose detection! the approach proposed in https://github.com/google/mediapipe/issues/1691#issuecomment-1103730953 can be a good start.

BTW, other libraries such as OpenPose do support the multi-pose detection, it would be better if MP would add such a capability to save people from searching alternative libraries.

akryeem avatar Jul 23 '22 09:07 akryeem

Hi @ArtfulMinx , Could you please check this https://github.com/google/mediapipe/issues/3539#issuecomment-1193091309 comments and confirm still if you have any error.

sureshdagooglecom avatar Aug 05 '22 06:08 sureshdagooglecom

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you.

google-ml-butler[bot] avatar Aug 12 '22 07:08 google-ml-butler[bot]

@sureshdagooglecom none of the comments there describes the steps needed to enable multiple persons detection, it says that the graph need to be changed. How to change it? is there any explanation or tutorial on how to build and use a modified graph?

akryeem avatar Aug 13 '22 13:08 akryeem

Closing as stale. Please reopen if you'd like to work on this further.

google-ml-butler[bot] avatar Aug 20 '22 13:08 google-ml-butler[bot]

Are you satisfied with the resolution of your issue? Yes No

google-ml-butler[bot] avatar Aug 20 '22 13:08 google-ml-butler[bot]

Hi @ArtfulMinx , Pose landmarks model is intended to be used with an image of a single person for now. We can't guarantee the same quality if there will be another person in the same model input image. Hopefully, in the future, we'll extend the model's ability to work on this case. We are actively working on improving the model right now.

As for the detector, it detects all people in the frame. We pick the one with the highest confidence right now. But you can create a graph that tracks several people. Take a look at how multi-hand tracking is implemented: https://github.com/google/mediapipe/blob/master/mediapipe/graphs/hand_tracking/hand_tracking_desktop_live.pbtxt

sureshdagooglecom avatar Aug 20 '22 14:08 sureshdagooglecom

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you.

google-ml-butler[bot] avatar Aug 27 '22 14:08 google-ml-butler[bot]

Closing as stale. Please reopen if you'd like to work on this further.

google-ml-butler[bot] avatar Sep 09 '22 07:09 google-ml-butler[bot]

Are you satisfied with the resolution of your issue? Yes No

google-ml-butler[bot] avatar Sep 09 '22 07:09 google-ml-butler[bot]