ControlNet icon indicating copy to clipboard operation
ControlNet copied to clipboard

Openpose sd v1.5 weights different from original sd v1.5 weights

Open wenquanlu opened this issue 2 years ago • 2 comments

Hi, I downloaded the controlnet weights control_sd15_openpose.pth for openpose sd v1.5 from this site https://huggingface.co/lllyasviel/ControlNet

However, after I extracted the stable diffusion weights from this file, I compared it with the original sd v1.5 weight released in https://huggingface.co/runwayml/stable-diffusion-v1-5

I found the weights for encoding and middle block are the same, but the decoding blocks are different. So I guess it was trained with sd_locked = False? Can you provide the openpose weights in which the original sd is completely locked by any chance?

Furthermore, seems like in HuggingFace diffuser ControlNet implementation, they forcebly merge the extracted pure controlnet weight and the original runwayml/stable-diffusion-v1-5 sd weight together, does this suggest we can also merge this without degrading the generation quality much?

Thanks!!!

wenquanlu avatar Apr 18 '23 18:04 wenquanlu

Hello cnet 1.0 has an sd_locked option, see also "sd_locked " in https://github.com/lllyasviel/ControlNet/blob/main/docs/train.md

but it turns out that such unlock does not have influence to the results, and the sd_locked option is removed in cnet 1.1

See also https://github.com/lllyasviel/ControlNet-v1-1-nightly and the models https://huggingface.co/lllyasviel/ControlNet-v1-1/tree/main

lllyasviel avatar Apr 22 '23 00:04 lllyasviel

OK, cool, thank you so much!

wenquanlu avatar Apr 22 '23 04:04 wenquanlu