sd-webui-hires-fix-tweaks

sd-webui-hires-fix-tweaks copied to clipboard

TItle, would be interesting to have the option, currently you can change checkpoint but not compatible between both arquitectures

You can set vae for every checkpoint inside "Checkpoints" tab, next to "Lora" tab, and then use only "automatic" mode for vae

• https://github.com/w-e-w/sd-webui-hires-fix-tweaks/issues/3

tldr it might be possible done with an extension but the implementation will be very very ugly and even if it's implemented it's likely going to be easy to break especially when mixing with other extensions it's better that if this is gonna be implemented it be directly implemented in web UI

About this issue: I think we should be sure this method is better then just decode vae and then encode back

About this issue: I think we should be sure this method is better then just decode vae and then encode back

that's easier said than done, the code is programmed by Italians who loves spaghetti

You can set vae for every checkpoint inside "Checkpoints" tab, next to "Lora" tab, and then use only "automatic" mode for vae

@light-and-ray In theory yeah, and I've tried it lots of times. The end image ends up no looking right. Im doing SDXL->1.5, and even though the log says the vae was loaded for 1.5, the end image ends up looking blueish and wrong.

Unless theres somehting im missing or a setting thats colliding with this, doesnt really work.

this is from memory so I might remember something wrong

the issue is that and why I said the code is spaghetti is because in hires fix the vae decode of the first pass happens near the beginning at the hires stage but switch model request is done at the end of the first pass stage before entering hires stage

which means if you go from SD 1.5 to SDXL is you will decode the first pass 1.5 using XL VAE

Maybe I should go back to developing img2img hiresfix as selectable script, and if everything go ok, port it in txt2img with a kind of compatibility layer. Unfortunately in discord nobody answers me, and I abandoned. And I m not sure am I really need it, because I've added custom mask in my replacer extension

Btw inpaint hires fix has much more options like extra mask dilate/blur/padding, and they really works. Also it's a good idea to add hires fix seed. So if I'll add it, it must be an always on script

Also I think I can't wait answering from auto, he it very busy as I see. At least I can discard spirky ✨ button and convert it into an extension

Btw @w-e-w using of your style of masking like from your nudenet extras script with a button for creating canvas I've found it helps to solve performance issue with inpainting by downscaling image inside created canvas. Maybe in inpainting tab I can try to make a hidden image box for the original image, and send a downscaled image into masking image box. It can prevent ui performance issue for 4k images etc. But I need to think about it only if I add inpaint hires fix

Btw @w-e-w using of your style of masking like from your nudenet extras script with a button for creating canvas I've found it helps to solve performance issue with inpainting by downscaling image inside created canvas. Maybe in inpainting tab I can try to make a hidden image box for the original image, and send a downscaled image into masking image box. It can prevent ui performance issue for 4k images etc. But I need to think about it only if I add inpaint hires fix

I don't really want to touch that thing until after we upgrade to Gradio 4

Unfortunately in discord nobody answers me, and I abandoned

I didn't reply you on that because I'm personally not too interested not sure about what other think, if you're really interested you can always ask again

Oh, yes, gradio 4... Went out of my head