SwarmUI
SwarmUI copied to clipboard
mcmonkeyprojects
Option to keep model(s) in memory
Feature Idea
As far as I could figure out there is currently no way to disable the automatic clearing of vram after X minutes. In my setup the model(s) needs to be loaded and always available to avoid the loading time of the first generation.
Simply setting ClearVRAMAfterMinutes to 0 to disable the timer would make sense I think. Or some other checkbox to turn it off.
And yes, I know I could set it to some large number, but in some cases it's possible the instance could be idle long enough to surpass that anyway. Being able to disable it completely would be cleaner.
Other
No response
Just set it to 999999 or whatever. If your server goes 2 years running without generating anything I think it's okay to have the vram finally clear out at that point.
Like I said, I feel it would be a cleaner solution to be able to properly disable it.
Not to mention that currently if you set it to 0 expecting it to work that way, it just reloads the model for every single generation. While the logic behind this makes sense, it's not expected behavior.