EDGE icon indicating copy to clipboard operation
EDGE copied to clipboard

why the foot is moving all the time?

Open lvZic opened this issue 1 year ago • 8 comments

amazing work! i found in the result, the foot of dancer is moving, no matter when the music is. it seems like skating. I wonder if the final skeleton global translation is right?

lvZic avatar Apr 20 '23 12:04 lvZic

Same here. According to the paper, there should be no sliding on the soles of the feet, it should be something wrong in our running steps.

lzyplayer avatar Apr 25 '23 11:04 lzyplayer

Hi, have you solved this foot-moving problem?

YIN95 avatar Apr 26 '23 04:04 YIN95

It seems there is something wrong with smpl2fbx. The exported FBX is not standing on the ground. Once you fixed the scale, it seems better. But still, if the original motion is already skating, correcting the smpl2fbx procedure is not so much helpful.

hi, have u used other animation character except the robot.fbx when exporting fbx. The author retargeted the one from "https://www.mixamo.com/" in unity. I wonder if there is other way to add the result motion values to fbx directly in code. I tried to cvt the mixamo's skeleton to SMPL's skeleton, but failed.

lvZic avatar May 11 '23 10:05 lvZic

SMPL2FBX requires a SMPL skeletion. I think mixamo's bone definition is different from SMPL. I would suggest you to do animation retargeting, which is also a more reasonable approach, it is not difficult to learn. Unreal has a similar tool.

lzyplayer avatar May 15 '23 09:05 lzyplayer

SMPL2FBX requires a SMPL skeletion. I think mixamo's bone definition is different from SMPL. I would suggest you to do animation retargeting, which is also a more reasonable approach, it is not difficult to learn. Unreal has a similar tool.

I had used retargeting to get good result. However, i donnot want to modify the skeleton (fbx). So the SMPL axis-angle values should be changed in my opinion. But i failed in the cvt process when coding...

lvZic avatar May 15 '23 11:05 lvZic

According to the paper, EDGE can infer the contact between the character's feet and the ground. I tried to draw this contact, but the effect was not satisfactory. (Because EDGE long motion generation requires cross interpolation, only a 5s single segment is used here for display, where red represents contact with the ground, green represents no contact with the ground, and the contact threshold is 0.95) image

lzyplayer avatar May 22 '23 02:05 lzyplayer

According to the paper, EDGE can infer the contact between the character's feet and the ground. I tried to draw this contact, but the effect was not satisfactory. (Because EDGE long motion generation requires cross interpolation, only a 5s single segment is used here for display, where red represents contact with the ground, green represents no contact with the ground, and the contact threshold is 0.95) image

so how the problem should be solved ?

lvZic avatar May 29 '23 04:05 lvZic

Has anyone solved the problem?

mia-y-w avatar May 10 '24 13:05 mia-y-w