VIBE
VIBE copied to clipboard
[BUG] Issue of the character being always centred at the origin in FBX output.
@mkocabas Thanks for this wonderful effort. I am able to get the FBX output for my videos. However, there is one key issue. The character is always centred at the origin (0,0,0) in all the frames. All the poses and movements of the character are happening at the same point. It would be nice if the character also exhibits the movement along the axes as per the motions in the original video. Do you know how to make this happen? For the 2D video, you are able to take the rendered OBJ mask and fit it on the character and make it appear to move along with the person.Would like to achieve the same in 3D also so that the FBX would look natural.
I think the center at the origin is a feature of VIBE unrelated to the FBX output. The weak perspective assumption used in HMR/SPIN/VIBE, assumes that movement in the depth dimension is small compare to the focal length. Therefore depth is not accurately estimated in this algorithm. The challenge is sometimes referred by "hip lock": https://github.com/mkocabas/VIBE/issues/54