motion-diffusion-model icon indicating copy to clipboard operation
motion-diffusion-model copied to clipboard

hi, is there a way to using the output animation driven mixamo model?

Open lucasjinreal opened this issue 3 years ago • 10 comments

hi, is there a way to using the output animation driven mixamo model?

the skeleton between smpl and mixamo are not very likely.

lucasjinreal avatar Oct 13 '22 11:10 lucasjinreal

Hi @jinfagang ! Indeed that's not a trivial task. Maybe issue #5 will have some useful info in this direction. Anyway, if someone manages to do so, I will be happy if you send us a pull request (and will be listed as a contributor)!

GuyTevet avatar Oct 24 '22 14:10 GuyTevet

why not smpl to fbx.. or Unity biped rig

yosun avatar Jan 11 '23 13:01 yosun

Hi @jinfagang ! Indeed that's not a trivial task. Maybe issue #5 will have some useful info in this direction. Anyway, if someone manages to do so, I will be happy if you send us a pull request (and will be listed as a contributor)!

hi i wonder if there is anyway to cvt SMPL to mixamo model directly in code, except for saving fbx and retargeting?

lvZic avatar May 15 '23 08:05 lvZic

@lvZic , have you solved it by use smpl pose to drive miximo model ?

luoww1992 avatar Jul 06 '23 07:07 luoww1992

@lvZic , have you solved it by use smpl pose to drive miximo model ?

it is possible to find an eula angle (x, y, z) for each bone, in order to rotate miximo's A pose to SMPL's T pose. Then, the output animation could driven miximo model. In my experiment, most of the animation are accurate after converting.

lvZic avatar Jul 06 '23 07:07 lvZic

@lvZic , how to do footskate ?

luoww1992 avatar Jul 06 '23 11:07 luoww1992

@lvZic , how to do footskate ?

The root translation could be estimated by left/right foot movement. Then the sliding problem could be alleviated.

lvZic avatar Jul 07 '23 02:07 lvZic

After using SMPL2FBX , it becom something like this. What should I do to fix it image

Tigerdwgth avatar Aug 16 '24 05:08 Tigerdwgth

@lvZic , have you solved it by use smpl pose to drive miximo model ?

it is possible to find an eula angle (x, y, z) for each bone, in order to rotate miximo's A pose to SMPL's T pose. Then, the output animation could driven miximo model. In my experiment, most of the animation are accurate after converting.

@lvZic Hi,I'm now suffering from converting smpl to mixamo model,glad to hear your success. Could you please tell me more about it,or share your converting code?Thanks a lot!

Italian-PAO avatar Aug 28 '24 08:08 Italian-PAO

@lvZic , have you solved it by use smpl pose to drive miximo model ?

it is possible to find an eula angle (x, y, z) for each bone, in order to rotate miximo's A pose to SMPL's T pose. Then, the output animation could driven miximo model. In my experiment, most of the animation are accurate after converting.

@lvZic Hi,I'm now suffering from converting smpl to mixamo model,glad to hear your success. Could you please tell me more about it,or share your converting code?Thanks a lot!

u can try retargeting, and it's easier

lvZic avatar Sep 24 '24 07:09 lvZic