sd-webui-controlnet Hand Pose Estimation

Is possible to include this model to generate images with good hands?

I think is already part of ControlNet, but it does not create a hand pose estimation in my experiments with this extension.

If anyone have more info, please comment. https://github.com/CMU-Perceptual-Computing-Lab/openpose

https://github.com/Hzzone/pytorch-openpose#hand-pose-estimation

Feb 14 '23 07:02 edgartaor

Hand Pose Estimation is disabled by default, you may need to enable it manually. https://github.com/Mikubill/sd-webui-controlnet/blob/fca33937af7bf45dac94616531643ce228c88d6b/scripts/processor.py#L69 (Maybe we should add a setting tab to configure such things)

Feb 14 '23 07:02 Mikubill

A toggle for it on the UI would be ideal, this is crazy good for assisting the AI with hands.

Feb 14 '23 12:02 trihardseven

However, it may not work if pos2model is trained with openpose images without hands.

Feb 14 '23 13:02 toyxyz

Put those .pth files to annotetor/ckpts/ , and hand detection will work. https://huggingface.co/lllyasviel/ControlNet/tree/main/annotator/ckpts

Feb 14 '23 14:02 matsuvr

Quick test!

Feb 14 '23 14:02 toyxyz

Don't know if I did the right thing but I downloaded the hand_pose_model.pth put it in the annotator folder, then chose the openpose_hand preprocessor then used control_any3_openpose model

test