Plans for an openpose model including hand pose data?

[BlueAccords]

Are you guys planning on eventually training an openpose model, including handpose data? https://github.com/Hzzone/pytorch-openpose#hand-pose-estimation

I feel like if we had the openpose model usable with hand data then stable diffusion will finally be able to consistently reproduce hands/fingers. I'm assuming the biggest hurdle will be obtaining enough annotated data to produce such a model in the first place though.

[Njasa2k]

openpifpaf seems to have a hand pose from the ControlNet paper

I wonder what happened to that model.

[sALTaccount]

No need to train a new pose model, they already exist, such as with mediapipe

[BlueAccords]

No need to train a new pose model, they already exist, such as with mediapipe

Is it possible to use one of those models with controlnet so it can know how to handle detected hands?

[richard-schwab]

I would absolutely love to have a ControlNet trained on Mediapipe's Holistic model, for hands but also for face and expression: https://google.github.io/mediapipe/solutions/holistic.html

[Zvandaa]

+1

[TheLukaDragar]

i call dibs on face control :)

[Zvandaa]

hi~我是周曦文~您的邮件我已经收到。

[geroldmeisinger]

all issues about "Release the openpifpaf model". this is not a duplicate. https://github.com/lllyasviel/ControlNet/issues/109 https://github.com/lllyasviel/ControlNet/issues/201 https://github.com/lllyasviel/ControlNet/issues/331 https://github.com/lllyasviel/ControlNet/issues/467

[Zvandaa]

hi~我是周曦文~您的邮件我已经收到。

[geroldmeisinger]

also see #445