IOPaint icon indicating copy to clipboard operation
IOPaint copied to clipboard

outpainting workflow

Open wr4thful opened this issue 11 months ago • 1 comments

hi, im trying to outpaint this image 2-1

but i keep getting this black bar result regardless of any changes that i made in the model and configs.

using stable-diffusion-inpainting chrome_2024-03-05_02 34 46

using powerpaint chrome_2024-03-05_02 31 05

as you can see both give same results. did i missed something crucial in the process or i picked the wrong model? whats the approach to do outpainting in my case? looking forward for any responses and help, thanks :)

wr4thful avatar Mar 04 '24 19:03 wr4thful

Service startup parameters

If the generated result is black, you can try adding these two parameters when starting the service:

  • --disable-nsfw-checker
  • --no-half(Some graphics cards will produce black results without adding this parameter.)

outpainting workflow

  • I think PowerPaint and runwayml/stable-diffusion-inpainting cannot handle such high resolution, so it is recommended to switch to diffusers/stable-diffusion-xl-1.0-inpainting-0.1.

  • Even when using diffusers/stable-diffusion-xl-1.0-inpainting-0.1, it is recommended to only outpaint one side, as shown in the picture. image

  • During testing your image, I found a bug in IOPaint. This has been fixed in version iopaint==1.2.2. Here are the results I obtained using the fixed version. The newly generated region has discoloration, I think it should be similar to the issue mentioned in this issue https://github.com/huggingface/diffusers/issues/5808, and there doesn't seem to be a good solution at the moment: 309879155-e97c63da-fdea-4a83-abf1-94a5121b50f1_outpainting

prompt: detailed background, best quality, 4k, dramatic cinematic perfect light, coherent, deep, detailed, very inspirational, intricate, beautiful, highly color set, real, complex, artistic, appealing, full, symmetry, great composition, sharp, fine detail, clear, focus, inspired, epic, spectacular, breathtaking, gorgeous, stunning, infinite, futuristic, professional, awarded

Other parameters. image

Sanster avatar Mar 05 '24 15:03 Sanster

hey sorry for the late responses thanks for the feedback. i really appreciate it.

wr4thful avatar Mar 16 '24 16:03 wr4thful