stable-diffusion-webui icon indicating copy to clipboard operation
stable-diffusion-webui copied to clipboard

[Bug]: inpainting strength seems broken

Open BunnyViking opened this issue 3 years ago • 8 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues and checked the recent builds/commits

What happened?

Inpainting is working sometimes... usually works the first time. But it seems that something is wrong with the strength settings, denoising or variation strength .... with both set to 1 im not getting much alteration to the base image at all. This is as of this morning (so about commit -20) but it's still an issue in the listed commit.

Steps to reproduce the problem

Try inpainting an area with a vastly different prompt ... in my case adding a shield to a character. Try setting denoise str and variation to 1 (or any settings)

What should have happened?

SD should attempt to fill in the appropriate object in the inpainting area.

Commit where the problem happens

e526f6b378e908d0a4a15661aaa1f67ecbaef1ff

What platforms do you use to access UI ?

Windows

What browsers do you use to access the UI ?

Mozilla Firefox

Command Line Arguments

No response

Additional information, context and logs

inpaint bug

BunnyViking avatar Nov 02 '22 09:11 BunnyViking

I think this is how it suppose to be. The inpainting method takes input from the masked area of the original image. If that area originally has nothing similar to a shield, sd is going to struggle.

Way I usually do it is to sketch in a very rough circular shape, just to give sd a hint. Then inpaint.

Also setting denoising strength somewhere between 0.5-0.8.

giteeeeee avatar Nov 02 '22 10:11 giteeeeee

Nah it should be trying to do more, especially if you play with the masked content parameters. (and with denoising and variance set to 1 it should basically ignore what's there)

BunnyViking avatar Nov 02 '22 10:11 BunnyViking

Not really a technical solution, but try "holding a round shield" instead. Usually works for me when I want the subject to hold something.

GigsTheCat avatar Nov 02 '22 12:11 GigsTheCat

Hrm I've noticed this for a while now but wasn't sure if I was incorrect in presuming it used to be different.

Pretty sure I used to be able to inpaint entire new things into a scene and it would largely ignore the rest of the image for better or worse, but now it tries to paint as an extension to the current image contents regardless of denoising strength or masked content mode.

e.g. I try to paint a bird into the sky next to a person's head, in every masking mode it will only draw a beak coming from the person's head (despite the masked area not even touching them), or maybe a cloud matching the other clouds in the sky elsewhere in the image. This is regardless of conditioning masked strength being 0 or 1, though as far as I know that's only relevant with the inpainting model selected, which I'm not using.

CodeExplode avatar Nov 03 '22 04:11 CodeExplode

image What are the rest of your settings it works just fine

SeverianVoid avatar Nov 03 '22 05:11 SeverianVoid

The mask area is too small, try giving it a larger margin

ghost avatar Nov 04 '22 12:11 ghost

Re-install the definitions with a new request for licenses first create a new folder on the desktop do not change the location or name of the folder put it on the desktop shorten the name of the folder only with the first name of the folder and include files we await your response to ensure the life of this solution for those who suffer from the same problem

nbekw

naserafn avatar Nov 04 '22 13:11 naserafn

الذكاء الاصطناعي لايمكنك السيطرة عليه والتحكم به بما يفعل انت غير من زواياك ومدخلاتك وحسب مزاجه سيخرج لك النتيجة

naserafn avatar Nov 04 '22 13:11 naserafn

so out of date now

BunnyViking avatar Dec 16 '22 01:12 BunnyViking