stable-diffusion icon indicating copy to clipboard operation
stable-diffusion copied to clipboard

Gradio loading animation slows generations down by 10%

Open TheEnhas opened this issue 2 years ago • 4 comments

https://github.com/hlky/stable-diffusion-webui#Loading

Also, is there any way to integrate that UI into this fork? Mostly because it (kind of) has inpainting support in img2img, which is much different than the rudimentary support SD has and doesn't need a 3.1 GB latent diffusion checkpoint to work.

TheEnhas avatar Aug 27 '22 18:08 TheEnhas

I will look into the performance degradation part. But can you tell more about the inpainting support? Does it only use the original Stable diffusion weights for inpainting?

basujindal avatar Aug 27 '22 19:08 basujindal

I think so, there's no mention of other models to download for that, and it looks like it's done through masking with img2img. I'd try it but I'm kind of afraid of hosing my SD install, I'm lucky I was able to get this fork up and running lol

TheEnhas avatar Aug 27 '22 19:08 TheEnhas

huggingface diffusers supports inpainting which can be added using this script

https://github.com/huggingface/diffusers/tree/main/examples/inference#in-painting-using-stable-diffusion

AK391 avatar Aug 28 '22 01:08 AK391

I will look into the performance degradation part. But can you tell more about the inpainting support? Does it only use the original Stable diffusion weights for inpainting?

I don't think it has actual inpainting support (nor does it claim to). it just masks the generated portion if img2img which results in generations where the masked portion doesn't line up or match the outside colors and style at all.

pandoras-rabbithole avatar Aug 31 '22 12:08 pandoras-rabbithole