Any way to "unload" a controlnet model from memory when Controlnet is disabled?

[boredsebastian]

I know I'm really pushing it with a 1660TI 6GB on a laptop but, I've noticed if I use a difference control and then use a different one I get CUDA OOM errors and I have to restart the webUI completely to use another. So my guess is they just hang around in memory even if you don't have Controlnet enabled.

I don't know if this is the right place to ask this question/suggestion.