stable-diffusion-webui-forge icon indicating copy to clipboard operation
stable-diffusion-webui-forge copied to clipboard

GPU Weights Not Respected - Forge Always use Max VRAM

Open Iory1998 opened this issue 1 year ago • 2 comments

Not all the time, but sometimes I run into this issue where I use the FLUX.1 Models (mainly Fp16) and even though I set the GPU Weights to be around 18.5 GB (Which is 75% of my VRAM capacity), Forge will use 23.8GB or VRAM, which leads it to either crash or use 100% of my RAM for minutes. Below is the screenshot of the log. Even if I reset the GPU Weights, they are not respected at all. image

Iory1998 avatar Sep 10 '24 13:09 Iory1998

I am having the same issue. I tried shutting it down and trying again to no avail. Forge keeps using max vram causing my Flux runs to be extremely slow. No matter what I set in weight, it is not respected. I was hoping that if I changed the default weight it would use it. So I tried to change defaults via settings but weight is not included in the saved defaults and when forge is restarted, weight is reset to max again.

Sana-A-E avatar Sep 12 '24 10:09 Sana-A-E

I am having the same issue. I tried shutting it down and trying again to no avail. Forge keeps using max vram causing my Flux runs to be extremely slow. No matter what I set in weight, it is not respected. I was hoping that if I changed the default weight it would use it. So I tried to change defaults via settings but weight is not included in the saved defaults and when forge is restarted, weight is reset to max again.

I know right! This is very frustrating problem that prevents me from using the FP16. The issue is mitigated if use quantized versions.

Iory1998 avatar Sep 12 '24 23:09 Iory1998

Same issue for me, memory is being eaten up like crazy! {E3B6F574-2AAF-499D-AD8E-8B0CF1584BCD}

I don't have this issue with A1111 or ComfyUI. I am working with Pony models and getting this issue.

LindezaBlue avatar Nov 16 '24 21:11 LindezaBlue