how to get right root transition?

[lucasjinreal]

Hi, I current converted the result to fbx animation, it looks fine on all rotations, but only the transition is not right.

I get the global_orientation which is the first bone position as root position, and set it in blender, I am not sure how to align with blender,

Does this order fit the blender order?

bones[bone_name_index_choosen[0]].location = (
            # Vector((100 * trans[1], 100 * trans[2], 100 * trans[0]))
            # Vector((100 * trans[0], 100 * trans[1], 100 * trans[2]))
            Vector((trans[1]*30, trans[2], pelvis_position[-1]))
        )

I tried also commented way all not works good. how to make it natural?

[zetyquickly]

I'm also encountered this question. One thing that I've deduced is whenever we use VIBE or PARE the pred_cameras are needed to be converted as it done in visualize_smpl_vibe flow.

VIBE and PARE outputs [N,4] valued arrays while HMR/SPIN [N,3] cameras

[zetyquickly]

Regarding the location. Have you tried Vector((100*trans[1], 0, 100*trans[0])).

[lucasjinreal]

@zetyquickly Hi, am using PARE but got a [-1, 3] output from pred_cams, I also tried using pred_cams as transition.

But it's just looks not right. Very shaking and also some jitting on x or z axis.

How did u using pred_cams? Directly applied into blender bone position without any further transform? Also, am not sure if pred_cam is real world x,y,z

[zetyquickly]

Yeah, you right it is a [N,3] tensor, but consider that these parameters are weakperspective camera parameters not an x,y,z. Follow visualize_smpl_vibe flow to get orig_camera or K, R, T matrices.

[zetyquickly]

I could achieve the following performance. 3D model is well aligned but whenever the person on the video do "sit" the model do "jump" tiktok source

https://user-images.githubusercontent.com/25350960/186831431-16f886b5-6d6a-4b27-8fa9-3034bc8e0e52.mp4

[lucasjinreal]

@zetyquickly Can we add a wechat connection, we can have a further discussion on this topic, your transition also looks not right, but I think I can make it right,

[ttxskk]

Hi @jinfagang, I think you have resolved this problem after the discussion in the WeChat group. Would you mind updating it for other users?
Thanks.

[lucasjinreal]

@ttxskk Honestly speaking, I forgot how did we solve this...... Would u remind me a little bit?

[zetyquickly]

@ttxskk could you share we chat qr code?

[ttxskk]

@ttxskk could you share we chat qr code?

Here you can find the QR code.

[bbbbubble]

@jinfagang @ttxskk I have encountered the same problem. Could you share how to deal with this issue, or some insights? I can't enter the wechat group even though I have scanned the QR code...

[ttxskk]

Hi @bbbbubble,

You can refer to this issue #262. Please let me know if you have any other questions.