Fooocus icon indicating copy to clipboard operation
Fooocus copied to clipboard

Inpainting: bad result on single color background, which severely impairs inpainting's power for designers

Open lanyusan opened this issue 1 year ago • 4 comments

I have been trying to use Fooocus inpainting to accelerate design prototyping. One use case is to use inpainting to draw images on a unfolded coffee cup for packaging designs.

The unfolded base image of coffee cup is as below, which has pure white background. wang-1

Current inpainting output is very much influenced by existing pxiels under inpainting mask. In this case, the pixels are all white.

I wish Fooocus has this parameter that sets influence of existing pixels on inpainting, which would make it a great tool for product poster designers or packaging designers, who often need to inpaint on single color background.

image

lanyusan avatar Nov 14 '23 03:11 lanyusan

Or maybe can add a paste mode that generates image with zero influence from existing pixels and pastes generated images' mask area to the base image.

lanyusan avatar Nov 14 '23 03:11 lanyusan

This could also be handled via image segmentation, right?

jonathanmiser9 avatar Nov 15 '23 20:11 jonathanmiser9

You can try using a png with alpha channel transparency

xhoxye avatar Dec 02 '23 00:12 xhoxye

Would this be solved by using the inpaint mask features https://github.com/lllyasviel/Fooocus/pull/529 or https://github.com/lllyasviel/Fooocus/pull/1645?

mashb1t avatar Dec 31 '23 00:12 mashb1t

@jonathanmiser9 @lanyusan bump

mashb1t avatar Jan 05 '24 13:01 mashb1t

Closing as stale, feel free to reopen when providing new information.

mashb1t avatar Jan 12 '24 20:01 mashb1t