HybrIK icon indicating copy to clipboard operation
HybrIK copied to clipboard

3D joint locations for mpjpe calculation on custom video using demo script

Open pankhurivanjani opened this issue 1 year ago • 1 comments

Hello! I run the demo script on the custom videos and I get res.pk file, which has these keys from the code:

res_keys = [
    'pred_uvd',
    'pred_xyz_17',
    'pred_xyz_29',
    'pred_xyz_24_struct',
    'pred_scores',
    'pred_camera',
    # 'f',
    'pred_betas',
    'pred_thetas',
    'pred_phi',
    'pred_cam_root',
    # 'features',
    'transl',
    'transl_camsys',
    'bbox',
    'height',
    'width',
    'img_path'
]

I have some GT 3D joint locations. For MPJPE calculation, can I get the 3D Joint locations directly from this demo script? pred_thetas are 3D joint rotations, do I need to write the code for FK or can I directly get the root relative 3D joint locations?

pankhurivanjani avatar Sep 26 '23 12:09 pankhurivanjani

There are some different formats of keypoint representation. pred_xyz_17 are keypoints in Human3.6m format obtained by FK, pred_xyz_24_struct are keypoints in SMPL format obtained by FK, and pred_xyz_29 are keypoints directly predicted by the backbone network. All the three items are root-relative by default.

biansy000 avatar Oct 02 '23 09:10 biansy000