ControlNet icon indicating copy to clipboard operation
ControlNet copied to clipboard

ControlNet on specific area

Open waquey opened this issue 1 year ago • 3 comments

Dear great author,

Thanks for the fantastic work! I would like to ask a question. Assume that the controlled photo contains a man and a dog. Is it possible to apply ControlNet just on the man but not change the dog? For instance, if my command is "add some red spots on the man's face" and the result photo is a man with red spots and the dog

Could we use positive/negative prompts to control it? Or shall we retrain ControlNet to do so?

Thanks

waquey avatar Mar 14 '23 02:03 waquey

use a mask?

kaka45inablink avatar Mar 15 '23 07:03 kaka45inablink

Using a mask in inpainting entirely achieves this, I do it all the time. The previews during generation show a total image being affected, but the result is mask-limited.

shadowlocked avatar Mar 16 '23 08:03 shadowlocked

Using a mask in inpainting entirely achieves this, I do it all the time. The previews during generation show a total image being affected, but the result is mask-limited.

how do you use a mask? You mean just cut out your area of interest from the ControlNet result and paste it on the original image? But the edits still may affect other areas, so you might end up with a cut off object or background.

andreemic avatar Apr 04 '23 10:04 andreemic

Using a mask in inpainting entirely achieves this, I do it all the time. The previews during generation show a total image being affected, but the result is mask-limited.

Hi, do you have any update on this?

Currently, I am having the same problem, I would like to keep the object and just change the background.

For example, a dog in a park picture. I want to keep the dog but change the background from park into indoor for example

Khaihuyennguyen avatar Nov 08 '23 17:11 Khaihuyennguyen

Using a mask in inpainting entirely achieves this, I do it all the time. The previews during generation show a total image being affected, but the result is mask-limited.

how do you use a mask? You mean just cut out your area of interest from the ControlNet result and paste it on the original image? But the edits still may affect other areas, so you might end up with a cut off object or background.

Hi, if you find the solution, please help to share

Khaihuyennguyen avatar Nov 08 '23 17:11 Khaihuyennguyen