GPU Weights Not Respected - Forge Always use Max VRAM
Not all the time, but sometimes I run into this issue where I use the FLUX.1 Models (mainly Fp16) and even though I set the GPU Weights to be around 18.5 GB (Which is 75% of my VRAM capacity), Forge will use 23.8GB or VRAM, which leads it to either crash or use 100% of my RAM for minutes.
Below is the screenshot of the log. Even if I reset the GPU Weights, they are not respected at all.
I am having the same issue. I tried shutting it down and trying again to no avail. Forge keeps using max vram causing my Flux runs to be extremely slow. No matter what I set in weight, it is not respected. I was hoping that if I changed the default weight it would use it. So I tried to change defaults via settings but weight is not included in the saved defaults and when forge is restarted, weight is reset to max again.
I am having the same issue. I tried shutting it down and trying again to no avail. Forge keeps using max vram causing my Flux runs to be extremely slow. No matter what I set in weight, it is not respected. I was hoping that if I changed the default weight it would use it. So I tried to change defaults via settings but weight is not included in the saved defaults and when forge is restarted, weight is reset to max again.
I know right! This is very frustrating problem that prevents me from using the FP16. The issue is mitigated if use quantized versions.
Same issue for me, memory is being eaten up like crazy!
I don't have this issue with A1111 or ComfyUI. I am working with Pony models and getting this issue.