high vram usage with inpaint with SDXL and SDXL_inpaint

[kalle07]

Checklist

• [X] The issue exists after disabling all extensions
• [ ] The issue exists on a clean installation of webui
• [ ] The issue is caused by an extension, but I believe it is caused by a bug in the webui
• [X] The issue exists in the current version of the webui
• [X] The issue has not been reported before recently
• [ ] The issue has been reported before but has not been fixed yet

What happened?

i know SDXL_inpaint models not yet fully implemented but its happened also with normal SDXL model

Steps to reproduce the problem

load a model go to im2img inpaint-tab paste an image (take a large one >1400x1000) draw a mask write somewhat in the prompt take over resolution all other standard watch GPU-Z Vram usage with an SDXL model ~9GB first 2sec 12GB last 3sec >16GB if you have a fast GPU rase up sampling steps too 200 too get it

What should have happened?

ok fooocus control has another way to use the models but never use more than 9GB ;)

What browsers do you use to access the UI ?

Mozilla Firefox

Sysinfo

Win10 RTX 4060-16GB

Console logs

no error

Additional information

i only mention this because if i have another program running which uses e.g. 2GB VRam then the last 3sec -> 10sec

[kalle07]

https://github.com/AUTOMATIC1111/stable-diffusion-webui/discussions/14601

[kalle07]

hellooo !?!?

my model https://civitai.com/models/245423/juggerxlinpaint

handles by sdxl_inpaint.yaml https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/14390