ControlNet-v1-1-nightly icon indicating copy to clipboard operation
ControlNet-v1-1-nightly copied to clipboard

Is there any plan to support ***comfyUI***?

Open icelandno1 opened this issue 1 year ago • 3 comments

Is there any plan to support comfyUI? Currently comfyUI has no way to access pre-processors although it supports the ControlNet-v1-1 model. Although there are projects on github such as comfy_controlnet_preprocessors that allow comfyUI to access the ControlNet preprocessors, but they are incomplete and don't have the control mode option, so they don't work very well. I believe there are very many people who have a need for this, so I hope there is good news.

icelandno1 avatar Aug 05 '23 11:08 icelandno1

Hi @icelandno1 yes we considered that, as comfyui is becoming more popular. Our concern is that in our implementations, many preprocessors have non-commercial licenses, like CMU Openpose. We are not sure if this will cause problems if we officially implement it in comfyui, since comfyui seems a commercial project owned by commercial company. Nevertheless we can try to find alternative preprocessor models, like mmpose for replacing openpose (actually this is already on a todo list for main controlnet repo - you can find a bit more info here). And it is also worth taking a look at comfyui extensitons, as it seems to have some extensitons to achieve more advanced purposes.

lllyasviel avatar Aug 06 '23 21:08 lllyasviel

@lllyasviel Thank you for your reply, still would like to see full official ControlNet support for comfyUI. Good luck!

icelandno1 avatar Aug 07 '23 13:08 icelandno1

Is there any news on this issue?

Andrew7127 avatar Sep 17 '23 22:09 Andrew7127