biorbd icon indicating copy to clipboard operation
biorbd copied to clipboard

Possible to use coordinates of pose estimation with pyomeca?

Open gabriead opened this issue 2 years ago • 1 comments

Hi folks, I am completely new to Biomechanics and have been looking at it only from the perspective of pose estimation. Is it possible to use the data of a pose estimation model (e.g. MediaPipe) directly with pyomeca? How would I transfer the joint coordinates in a format that pyomeca can use (e.g. c3d)? Thank's a lot!

gabriead avatar Dec 29 '22 09:12 gabriead

Hi @gabriead That actually depends on what you used to collect the data. For instance, if you used a vicon system and used the inverse kinematics (inverse kinematics is the process to get angles from skin marker data), pyomeca (https://github.com/pyomeca/pyomeca) can read them directly. You can also read them using ezc3d (https://github.com/ezc3d/ezc3d).

I am not aware how MediaPipe stores their data though. If you can export in c3d, you definitely can retrieve them using ezc3d. If they are storing them the same way Vicon does, them pyomeca can directly be used. If you are a C++ or Matlab developer, ezc3d is your sole option though. I've seen that you are doing java, if you want to use our code, you'll have to update the SWIG interface for java (which could be a nice add on to ezc3d hahaha)

Hope this helps!

pariterre avatar Jan 04 '23 13:01 pariterre