Mediapipe-VR-Fullbody-Tracking icon indicating copy to clipboard operation
Mediapipe-VR-Fullbody-Tracking copied to clipboard

Is it possible without SteamVR? And Multi-People

Open jasjang opened this issue 3 years ago • 2 comments

It's great application!! I am a Game developer. I like this soooo much! Q1. Is it possible to share the tracking result to other APP without VR? Maybe OSC to C# or Unity?

Q2. I've tested 2 people, it's so stable. But will only tracking the last body only. is it possible to track more than one people?

Thank You.

jasjang avatar Nov 20 '21 12:11 jasjang

Thank you!

1: I connect to the SteamVR driver using a named pipe, so you should be able to open a named pipe in your game code to receive the data. Or, since it is a python script, you shouldnt have problem modifying the code a bit to send whatever data you need in your game in whatever way is best for you.

Do note that, to get full 3d position of joints, you need a VR hmd for reference! Mediapipe only returns a root-relative skeleton shape, but doesnt actualy get its full position in space.

2: Mediapipe only supports one person at a time. To support more, you would have to add a person detector, crop each person, then do pose estimation on each seperately.

ju1ce avatar Nov 20 '21 14:11 ju1ce

THANKS for reply, I will try to edit it later. I am new with Python. I would try to receive data via build a fake StreamVR firstly. It's really great work!!I will share the result. Thank You.

jasjang avatar Nov 22 '21 14:11 jasjang