ROMP icon indicating copy to clipboard operation
ROMP copied to clipboard

3D joints/ skeleton plot without Mesh

Open Dipankar1997161 opened this issue 1 year ago • 1 comments

Hey @Arthur151 I clarified my concepts and used Humannerf for my own 3d reconstruction and your parameters, helped a lot in this. Thank you for the work.

There's one final thing that I have to achieve which is plotting the 3d joints. how can I plot the 3d key points / skeleton in the 3d space? here is a sample file shape from ROMP on 1 h36m image

The shape of the array under key "cam" is (1, 3) The shape of the array under key "global_orient" is (1, 3) The shape of the array under key "body_pose" is (1, 69) The shape of the array under key "smpl_betas" is (1, 10) The shape of the array under key "smpl_thetas" is (1, 72) The shape of the array under key "center_preds" is (1, 2) The shape of the array under key "center_confs" is (1, 1) The shape of the array under key "cam_trans" is (1, 3) The shape of the array under key "verts" is (1, 6890, 3) The shape of the array under key "joints" is (1, 71, 3) The shape of the array under key "pj2d_org" is (1, 71, 2)

i believe, the verts is the j_regressor, smpl_thetas represent the rotation of the smpl joints, betas are betas. the cam is "Rh" and the cam_trans is "Th" in smpl format.

but I wonder, what are these joints and body_pose?? usually, smpl has a 24x3 shape so accordingly, the body_pose should be the 3d smpl joints which can be used to plot them into 3d space.

The shape of the joints is so weird and I am not sure because h36m has 17 keypoints but i shows 71,3 and also for the 2d image 71,2?

My main goal is to plot 3d smpl joints/ skeleton in the 3d space without the mesh. Any referrals to how I can achieve this? Can we do this in ROMP too??

Dipankar1997161 avatar Mar 22 '23 13:03 Dipankar1997161

I believe that the smpl_thetas corresponds to the values you're seeking. It should be shaped as 24x3. Please note that the composition of smpl_thetas (1,72) consists global_orientation (1,3) and body_pose (1, 69).

I guess pj2d_org[-17:] is the h36m joints. #joints-in-output-npz-file

@Arthur151 However, there seems to be a discrepancy with the pj2d_org shape in your config_guide, which is specified as (54, 2).

Other things such as j3d_all54 and j3d_smpl24, which are supposedly part of the setting in the config_guide are missing, I was also wondering where to obtain them?

yqtl avatar Jul 25 '23 15:07 yqtl