Fooocus icon indicating copy to clipboard operation
Fooocus copied to clipboard

Inpainting not working in case the mask area has big overlap with strong visual elements of original image

Open lanyusan opened this issue 1 year ago • 5 comments

I am using 2.1.693, inpainting 1.0 & 2.5 both have this problem.

image

lanyusan avatar Oct 18 '23 03:10 lanyusan

original image: 0 (11)

lanyusan avatar Oct 18 '23 03:10 lanyusan

2.1.703 fixed many inpaint problems

image

lllyasviel avatar Oct 18 '23 13:10 lllyasviel

I have tested the new version '2.1.709'.

The result is that if the mask area is small, it misses mostly. When the mask area is larger, the inpainting works much more likely.

Screenshot from 2023-10-20 08-10-56

Screenshot from 2023-10-20 08-11-58

Screenshot from 2023-10-20 08-12-54

lanyusan avatar Oct 20 '23 02:10 lanyusan

Can confirm that the strange inpainting behavior is still present in v2.1.772. If the mask is relatively small, it seems as if the prompt was ignored altogether — no new objects are generated, masked area is filled from the surroundings: image

But, when the mask size is increased, new objects appear, yet they tend to be far from what is in the prompt: image Examples were generated with inpainting model v2.5. (v1 acts the same), no styles selected, the same seed.

vikmaks1 avatar Nov 01 '23 21:11 vikmaks1

Please test again with the latest version of Fooocus, especially with inpaint method "Modify Content (add objects, change background, etc.)", and let us know the results.

mashb1t avatar Jan 01 '24 15:01 mashb1t

Closing as stale, feel free to reopen when providing new information.

mashb1t avatar Jan 12 '24 20:01 mashb1t