multidiffusion-upscaler-for-automatic1111 icon indicating copy to clipboard operation
multidiffusion-upscaler-for-automatic1111 copied to clipboard

Please make tile vae and tile diffusion work with Stable XL

Open wardensc2 opened this issue 1 year ago • 16 comments

Hi pkuliyi2015 with the new model Stable Diffusion XL which using more Vram and hardware your extension is vital for PC with less Vram more. But at the moment it's not work in Stable XL, please make it support. We will wait, thank you in advance just dont abbandon this project it's so important for personal user like us.

wardensc2 avatar Jul 29 '23 11:07 wardensc2

Sorry, I just check only tile diffusion not working, your tile vae is working very well, thank you

wardensc2 avatar Jul 29 '23 15:07 wardensc2

I didn't abandon the project; it is just because I haven't migrate to SDXL. I'm waiting for SDXL custom checkpoints; once they come I update again.

pkuliyi2015 avatar Jul 29 '23 15:07 pkuliyi2015

I didn't abandon the project; it is just because I haven't migrate to SDXL. I'm waiting for SDXL custom checkpoints; once they come I update again.

Thank you so much

wardensc2 avatar Jul 29 '23 16:07 wardensc2

Even though Tiled VAE works with SDXL - it still has a problem that SD 1.5 didn't have, specifically a weird dot/grid pattern

image

Desm0nt avatar Aug 04 '23 11:08 Desm0nt

Even though Tiled VAE works with SDXL - it still has a problem that SD 1.5 didn't have, specifically a weird dot/grid pattern

image

I noticed this myself, Tiled VAE seems to ruin all my SDXL gens by creating a pattern (probably the decoded tiles? didn't try to change their size a lot). As of now, I preferred to stop using Tiled VAE in SDXL for that reason.

acezard avatar Aug 04 '23 12:08 acezard

I didn't abandon the project; it is just because I haven't migrate to SDXL. I'm waiting for SDXL custom checkpoints; once they come I update again.

Hi, anything new pkuliyi2015 ?

wardensc2 avatar Aug 20 '23 13:08 wardensc2

Now controlnet openpose and depth for Stable XL are released, it's a matter of time before controlnet tile XL to be finished.

https://huggingface.co/thibaud/controlnet-openpose-sdxl-1.0/tree/main https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0/tree/main https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0/tree/main

So far anything update pkuliyi2015 ?

wardensc2 avatar Sep 02 '23 07:09 wardensc2

I'm also looking forward to the integration with SDXL. Please pkuliyi2015, bless us with your wisdom soon!

ViratX avatar Oct 13 '23 07:10 ViratX

I didn't see this problem until I switched to the Juggernaut XL and some other XL models recently, disabling the Fast Decoder made it possible to generate the images normally. The images below are in 2688x1536, the magic still happens on the 3070.

The problem seems to increse when the resolution is not 1024x1024, but it depends from model to model and you lose a little speed in the final process, more noticeable in large images.

Specs: 3070 - 8GB Webui Parm: --xformers --medvram --no-half-vae

image

Fast Decoder Enabled: image

image

Fast Decoder Disabled: image

image

pedroluizmossi1 avatar Oct 29 '23 16:10 pedroluizmossi1

I didn't see this problem until I switched to the Juggernaut XL and some other XL models recently, disabling the Fast Decoder made it possible to generate the images normally. The images below are in 2688x1536, the magic still happens on the 3070.

The problem seems to increse when the resolution is not 1024x1024, but it depends from model to model and you lose a little speed in the final process, more noticeable in large images.

Specs: 3070 - 8GB Webui Parm: --xformers --medvram --no-half-vae

image

Fast Decoder Enabled: image

image

Fast Decoder Disabled: image

image

I've been having a headache with this problem for several days. And I found this answer as well.

9Somboon avatar Nov 08 '23 12:11 9Somboon

@pkuliyi2015 So... There's a lot of custom chekpoints of SDXL now. Will Tiled Diffusion work with SDXL?

I didn't abandon the project; it is just because I haven't migrate to SDXL. I'm waiting for SDXL custom checkpoints; once they come I update again.

So... There's a lot of custom checkpoints based on SDXL now. Will Tiled Diffusion work soon with SDXL?

sebaxakerhtc avatar Mar 12 '24 06:03 sebaxakerhtc

Are you still working on SDXL support?

hakbodi avatar Jun 13 '24 20:06 hakbodi

Sadly say no. The core developers of this extension has all gone :(

Kahsolt avatar Jun 14 '24 02:06 Kahsolt

Sadly say no. The core developers of this extension has all gone :(

Ouch... that sucks, I've grown dependent on this extension :/ do you know if anything comparable exists with active development?

hakbodi avatar Jun 14 '24 09:06 hakbodi

So sorry but be honest to say that I've not touched these SD stuff for months, unfamiliar to the current mainstream community.

The last news I got is that, the author of sd-webui-forge will make his forge version "more experimental", thus call people back to the original a1111 for stable production. Before that annoucement, people wants our multidiffusion migrated to forge.... What I mean here is, maybe you should ask A1111, might there be more proficient users and helpful suggestion :)

Kahsolt avatar Jun 14 '24 09:06 Kahsolt

Even though Tiled VAE works with SDXL - it still has a problem that SD 1.5 didn't have, specifically a weird dot/grid pattern image

I noticed this myself, Tiled VAE seems to ruin all my SDXL gens by creating a pattern (probably the decoded tiles? didn't try to change their size a lot). As of now, I preferred to stop using Tiled VAE in SDXL for that reason.

Have you solved this problem?

woshinwyx avatar Jul 26 '24 08:07 woshinwyx