[Feature Request]: img2img pose transfer

[Ehplodor]

Is there an existing issue for this?

• [X] I have searched the existing issues and checked the recent builds/commits

What would your feature do ?

What do devs think of potential img2img head (face ?) / body img2img pose transfer like in https://github.com/yoyo-nb/Thin-Plate-Spline-Motion-Model ?

Proposed workflow

1. Go to img2img (with some image where you wish to alter the body / head pose
2. Add driving image of the wished for pose
3. press "transfer pose"

Additional information

No response

[W1Real]

Some useful references I collected: OpenPose

• first real-time multi-person system to jointly detect human body, hand, facial, and foot keypoints (in total 135 keypoints) on single images.

ExPose: Monocular Expressive Body Regression through Body-Driven Attention

• This one creates a 3d mesh of the pose

We could use the same tech behind depth maps to force SD to respect the proper anatomy/pose. We can generate the depth maps and images from the pose mesh.

[UnstableChainSmoker]

any updates on this one ?

Something that might be relevant : https://github.com/ChenyangQiQi/FateZero

[missionfloyd]

https://github.com/Mikubill/sd-webui-controlnet