noah-research icon indicating copy to clipboard operation
noah-research copied to clipboard

[CLIFF] About the SMPL camera parameters output

Open mimiliaogo opened this issue 2 years ago • 5 comments

Hi, what is the exact meaning of the SMPL camera parameters output? As your paper says, they are the root translations relative to the camera coordinate, and they can be transformed to perspective projection parameters.

  1. So does this mean the output of the SMPL vertices is in 'World Coordinate' ? and then we need to add a translation as 'extrinsic matrix' to convert them into 'Camera Coordinate'?
  2. How is this formula formulated? Why can the z translation be calculated like that? image

Thank you so much!

mimiliaogo avatar Sep 26 '22 07:09 mimiliaogo

Also, Does the global rotation mentioned in your paper refer to the root rotation with respect to the world coordinate or to the camera coordinate?

mimiliaogo avatar Sep 26 '22 07:09 mimiliaogo

I see your supp, and understand the above questions. However, in the below picture, if now we used the cropped image as camera coordinate(the original version), should the tx and ty all be zero? (because the predicted human mesh will be at the center of the bounding box) image

mimiliaogo avatar Sep 26 '22 09:09 mimiliaogo

Is there any way to project SMPL joints into image plane as 2D keypoints in the demo?

haofanwang avatar Sep 26 '22 10:09 haofanwang

@mimiliaogo No, tx and ty are not always zeros. The center of the bbox is C, corresponding to E in the virtual plane, but the root of the human mesh is R, which causes the root translation tx=|RE|. In another word, the human root (the Pelvis joint) is not always at the center of the bbox.

zhihaolee avatar Sep 27 '22 01:09 zhihaolee

@haofanwang Refer to #119.

zhihaolee avatar Sep 27 '22 01:09 zhihaolee