AnimateAnyone icon indicating copy to clipboard operation
AnimateAnyone copied to clipboard

Driving pose skeleton to approximate the length of the character’s skeleton in the reference image

Open learnuser1 opened this issue 1 year ago • 8 comments

During inference, we rescale the length of the driving pose skeleton to approximate the length of the character’s skeleton in the reference image. Does anyone know how to do this step?

learnuser1 avatar Jan 26 '24 07:01 learnuser1

We tried rescaling through the external rectangle of the kps common to ref and motion, and tested in Moore-AnimateAnyone, but the effect was not significantly improved.

mymusise avatar Jan 30 '24 06:01 mymusise

We tried rescaling through the external rectangle of the kps common to ref and motion, and tested in Moore-AnimateAnyone, but the effect was not significantly improved.

I tried scaling the skeleton and it worked, but it wasn't good enough.

learnuser1 avatar Feb 01 '24 07:02 learnuser1

In my work, skeleton alignment was effective for quality (Ref : woman, Pose : man)

MoonEese avatar Feb 05 '24 02:02 MoonEese

I tried to extract several key points from the dwpose and perform affine transformation to obtain a matrix. Then, I processed each frame of the pose video and achieved better results

wangxr1999 avatar Feb 21 '24 07:02 wangxr1999

I tried to extract several key points from the dwpose and perform affine transformation to obtain a matrix. Then, I processed each frame of the pose video and achieved better results

It's so greatly, i have some doubts, how to select the key points?

wxhqw avatar Feb 23 '24 02:02 wxhqw

In my work, skeleton alignment was effective for quality (Ref : woman, Pose : man)

How did you achieve it? Can you share the code.

eightmusic avatar Feb 27 '24 08:02 eightmusic

@eightmusic - there's this code base - https://github.com/MooreThreads/Moore-AnimateAnyone/

wweevv-johndpope avatar Mar 03 '24 23:03 wweevv-johndpope

I tried to extract several key points from the dwpose and perform affine transformation to obtain a matrix. Then, I processed each frame of the pose video and achieved better results

That's so great. Really want to know how to make it! Can you share the code?

EnochX avatar Mar 12 '24 14:03 EnochX