sd-webui-cloud-inference icon indicating copy to clipboard operation
sd-webui-cloud-inference copied to clipboard

Controlnet not working

Open ChrisFab16 opened this issue 1 year ago • 13 comments

Versions: ControlNet v1.1.422 Webui: version: v1.6.1  •  python: 3.10.11  •  torch: 2.0.1+cu117  •  xformers: 0.0.20  •  gradio: 3.41.2  •  checkpoint: 96e98913b1

Steps to reproduce: place openpose picture in controlnet image box. Select control_v11p_sd15_openpose from dropdown. Enter prompt "man standing" hit "generate"

Expected result: Pose from openpose template applied to picture

In stead, it provides a picture with a random pose

ChrisFab16 avatar Dec 14 '23 12:12 ChrisFab16

Have you enable controlnet ? could you provides controlnet extension version ?

AnyISalIn avatar Dec 16 '23 03:12 AnyISalIn

Yes it is enabled. ControlNet v1.1.422

If I render locally I get the result image and the pose image in the output.

When I try using the cloud generation it seems there is no controlnet info

ChrisFab16 avatar Dec 16 '23 08:12 ChrisFab16

it looks like something may be going wrong with the loading of the Controlnet models. The controlnet model dropdown in my local interface does not match the example list in the screenshot from the README: image

ChrisFab16 avatar Dec 18 '23 09:12 ChrisFab16

solved - removed controlnet models from models/ControlNet folder and it loaded the models from the api correctly. Keeping bug open as it's probably worth fixing.

ChrisFab16 avatar Dec 18 '23 09:12 ChrisFab16

I am experiencing the same issue here. When I read the latest post of ChrisFab16 I removed all models from the models/ControlNet folder but still the web-ui refuses to show any models from the cloud it just shows "none". After removing I tried disabling and then then re-enabling the ControlNet extension as well as the cloud-inference extension but to no avail. I'm using ControlNet version 1.1.424 (this commit https://github.com/Mikubill/sd-webui-controlnet/commit/50ddf1da960ad4ca7800d65cdde4553e746bcbf7) and version 0.1.9 of cloud-inference. Any ideas?

Tyrnan avatar Dec 31 '23 12:12 Tyrnan

I'm using ControlNet v1.1.427, and my situation is the same with Tyrnan.

KLA6 avatar Jan 12 '24 05:01 KLA6

Thanks for feedback, we will be fixed in next version. @KLA6 @Tyrnan @ChrisFab16

AnyISalIn avatar Jan 12 '24 07:01 AnyISalIn

we cannot reproduce in our test environment, could you provides config.json and command line arguments help us to solve the problems. thanks. @KLA6

AnyISalIn avatar Jan 15 '24 02:01 AnyISalIn

image This is a screen shot to show the problem. It's using Cloud Inference and ControlNet Canny, but the result doesn't include a Canny shot.

BTW, what do you mean config.json, where can I capture it?

KLA6 avatar Jan 15 '24 03:01 KLA6

image This is a screen shot to show the problem. It's using Cloud Inference and ControlNet Canny, but the result doesn't include a Canny shot.

BTW, what do you mean config.json, where can I capture it?

could you share screenshot of installed extensions ?

image

AnyISalIn avatar Jan 15 '24 05:01 AnyISalIn

image Here, it is.

KLA6 avatar Jan 15 '24 06:01 KLA6

@KLA6 Hello, I have been updated in dev branch, could you upgrade to this version and try again ?

AnyISalIn avatar Jan 15 '24 08:01 AnyISalIn

I've downloaded https://github.com/omniinfer/sd-webui-cloud-inference/tree/dev as a zip file to replace all files of Cloud Inference.

image

However, the result is still the same which is not showing any Canny related shot.

image

KLA6 avatar Jan 15 '24 09:01 KLA6