mmpose icon indicating copy to clipboard operation
mmpose copied to clipboard

How to transform 3D keypoints from a coordinate system centered on the pelvis to a camera coordinate system

Open hirokiyazaki opened this issue 2 years ago • 6 comments

📚 The doc issue

Hello, I have run the code example provided below for the "3D Human Pose Demo" and acquired the 3D keypoints coordinates for each frame.

python demo/body3d_pose_lifter_demo.py \ demo/mmdetection_cfg/rtmdet_m_640-8xb32_coco-person.py \ https://download.openmmlab.com/mmpose/v1/projects/rtmpose/rtmdet_m_8xb32-100e_coco-obj365-person-235e8209.pth \ configs/body_2d_keypoint/rtmpose/body8/rtmpose-m_8xb256-420e_body8-256x192.py \ https://download.openmmlab.com/mmpose/v1/projects/rtmposev1/rtmpose-m_simcc-body7_pt-body7_420e-256x192-e48f03d0_20230504.pth \ configs/body_3d_keypoint/video_pose_lift/h36m/video-pose-lift_tcn-243frm-supv-cpn-ft_8xb128-200e_h36m.py \ https://download.openmmlab.com/mmpose/body3d/videopose/videopose_h36m_243frames_fullconv_supervised_cpn_ft-88f5abbb_20210527.pth \ --input https://user-images.githubusercontent.com/87690686/164970135-b14e424c-765a-4180-9bc8-fa8d6abc5510.mp4 \ --output-root vis_results \ --save-predictions

However, since these coordinates are within a coordinate system centered around the pelvis, I would like to transform the keypoints' coordinates into the camera coordinate system. Therefore, could you please provide me with guidance on how to perform this transformation?

Suggest a potential alternative/fix

No response

hirokiyazaki avatar Nov 05 '23 02:11 hirokiyazaki

您好,请问您的3D 人体姿态估计能运行出来吗,我搞了好几天这个都弄不了,能否相互交流一下呢

LZhen624 avatar Nov 05 '23 06:11 LZhen624

Hello, may I ask if your 3D human posture can be estimated to work? I've been working on this for several days but I can't figure it out. Can you please communicate with each other

LZhen624 avatar Nov 05 '23 07:11 LZhen624

Sure, no problem!

hirokiyazaki avatar Nov 06 '23 02:11 hirokiyazaki

Do you know which ready-made model can also mark several key points of the foot?I want to demonstrate the key points of the whole body and feet in the 3D human pose. There are not many key points of the feet, just have them.

LZhen624 avatar Nov 06 '23 05:11 LZhen624

I'm sorry, I don’t know such an existing model. I apologize for not being able to help.

hirokiyazaki avatar Nov 08 '23 00:11 hirokiyazaki

Thank you very much. Recently, I found the Halpe26 model in the RTM pose in mmpose, which includes key points of the feet. Can you use it,

LZhen624 avatar Nov 08 '23 01:11 LZhen624