sd-webui-controlnet icon indicating copy to clipboard operation
sd-webui-controlnet copied to clipboard

1028x720 image don't work but 512x512 crop works

Open harrywang opened this issue 2 years ago • 12 comments

my image is 1028x720. if I use 512x512 default, the result is good:

Screenshot 2023-02-16 at 9 25 12 AM

however, when I changed to 1028x720 in both webui and controlnet menu, all other settings are the same, the result is not good: Screenshot 2023-02-16 at 9 24 21 AM

any suggestions?

Thanks!

harrywang avatar Feb 16 '23 14:02 harrywang

Hmm, how about using higher resolution of canny preproc

Mikubill avatar Feb 16 '23 15:02 Mikubill

thanks for your reply but I don't know what you meant. This is my setting:

Screenshot 2023-02-16 at 10 16 46 AM

harrywang avatar Feb 16 '23 15:02 harrywang

Update the plugin and you will find some new options. fyi: added in https://github.com/Mikubill/sd-webui-controlnet/commit/d09c520d40b68c3b980864ad96fc1455343f4a43

Mikubill avatar Feb 16 '23 15:02 Mikubill

Thanks, will do and report back.

harrywang avatar Feb 16 '23 15:02 harrywang

I just noticed that the slider bar is limited to 1024 (https://github.com/Mikubill/sd-webui-controlnet/issues/48), so I resized my image to 1024x567 and tried again before update the plugin - same result. Will update the plugin and try again.

harrywang avatar Feb 16 '23 15:02 harrywang

updated the plugin and max the resolution, the result is not good as well:

Screenshot 2023-02-16 at 10 41 27 AM Screenshot 2023-02-16 at 10 41 33 AM m/595772/219415300-934811c8-b31a-447e-a4c3-1541553ab324.png">

512x512 as a comparison after the updating: Screenshot 2023-02-16 at 10 38 16 AM

harrywang avatar Feb 16 '23 15:02 harrywang

you may need to alter some params such as prompts/negative prompts or denoiser/sampling method

Mikubill avatar Feb 16 '23 15:02 Mikubill

Thanks for the suggestion - what confused me is why 512x512 is much better with all other settings being the same - any pointers?

harrywang avatar Feb 16 '23 16:02 harrywang

manually cropped the image to 512x512 - out of box - the result is much better: Screenshot 2023-02-16 at 11 08 21 AM

harrywang avatar Feb 16 '23 16:02 harrywang

you are using stock sd1.5 right? that model is trained only on 512px res images compared to any other merged model/trained model with aspect ratio bucketing. Maybe try another model from civit ai and see if other aspects work better?

Nazzaroth2 avatar Feb 16 '23 16:02 Nazzaroth2

you are using stock sd1.5 right? that model is trained only on 512px res images compared to any other merged model/trained model with aspect ratio bucketing. Maybe try another model from civit ai and see if other aspects work better?

Thanks a lot for pointing this out. Any suggested models that I should try?

harrywang avatar Feb 16 '23 16:02 harrywang

for 1024x567 dream shaper model - result is good: Screenshot 2023-02-16 at 11 23 45 AM

openjourney v1, no good: Screenshot 2023-02-16 at 11 22 38 AM

photogen v3.4, ok: Screenshot 2023-02-16 at 11 25 03 AM

@Nazzaroth2 thanks again for the pointer!!

harrywang avatar Feb 16 '23 16:02 harrywang