THuman2.0-Dataset icon indicating copy to clipboard operation
THuman2.0-Dataset copied to clipboard

Why I got the wrong global orient results

Open jhkim0759 opened this issue 1 year ago • 5 comments

그림1

I rendered the obj with pytorch3d library and fit the SMPL skinned model using the parameters provided. but, I got the results as above. I think this is upside down result. Can you help me to get the correct results?

jhkim0759 avatar Sep 13 '22 06:09 jhkim0759

Dear jhkim0759,

can you first try to generate the corresponding SMPL mesh and save it as .obj file, and then check the alignment between the two obj meshes using the Meshlab?

ytrock avatar Sep 14 '22 03:09 ytrock

Thank you for your answer

I saved the mesh as obj and check between the data what you provided. but, I got the exactly opposite results as the image shown. I think I have to aligned the mesh one by one. or is there an other way to obtain the Global Orient from camera parameters(Entrinsic, Intrinsic, Rotation, etc.)?

jhkim0759 avatar Sep 20 '22 15:09 jhkim0759

That's weird, when generating smpl-x meshes, did you use the provided poses which already include the global RT? Or you can paste your code for generating the smpl-x meshes at here.

ytrock avatar Sep 21 '22 00:09 ytrock

smplr = SMPLR()

params_dir = "../dataset/THuman/THuman2.0_smplx/0525/smplx_param.pkl"

db = np.load(params_dir, allow_pickle=True)
dict_ = {}
for key in db:
    dict_[key] = torch.tensor(db[key])
    
global_ori = torch.from_numpy(dict_["global_orient"])[0]
pose = torch.cat([global_ori, torch.from_numpy(dict_["body_pose"][0])],0)
verts = smplr(pose.reshape(1,-1,3,3).float(),torch.from_numpy(beta).reshape(1,-1).float(), pose2rot=False)["verts"]

renderer = Renderer(resolution=(1024, 1024), orig_img=True, wireframe=False )
img = renderer.render(img, verts[0], [1,1,0,0])

This the code what is used. The SMPLR Model is from ROMP, and Renderer is from PARE.

Thank you

jhkim0759 avatar Sep 21 '22 11:09 jhkim0759

I think the SMPL regressor is based on vibe form. That's why the verts show the opposite. Thank you

jhkim0759 avatar Sep 23 '22 04:09 jhkim0759

You are welcome :) Thanks for your attention.

ytrock avatar Oct 10 '22 12:10 ytrock