I can't run controlnet without my harddrive usage capping at max

[Soularis10]

Is there an existing issue for this?

• [X] I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

Previously before I installed controlnet I could render images normally, but after installing my harddrive usage keeps working at 100%. With my memory slowly increasing. And when I close my stable diffusion, the harddrive usage instantly drops to 0%

So now I can't render any images without my memory being fully used up and crashing my computer

Steps to reproduce the problem

1. Run Stable Diffusion with ControlNet (Runs smoothly)
2. Close Stable DIffusion (Since my memory keeps increasing)

What should have happened?

It should have ran controlnet normally without using too much of my harddrive

Commit where the problem happens

None

What browsers do you use to access the UI ?

Google Chrome

Command Line Arguments

--xformers --lowvram 
gitpull

List of enabled extensions

None Except for a few checkpoints, VAE and LoRA models

Console logs

To create a public link, set `share=True` in `launch()`.
Startup time: 14.0s (import torch: 3.9s, import gradio: 2.1s, import ldm: 0.9s, other imports: 1.9s, setup codeformer: 0.2s, load scripts: 3.3s, create ui: 1.0s, gradio launch: 0.5s).
Creating model from config: D:\stable-diffusion-webui\configs\v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.

Additional information

I suspect it is more of a stable diffusion issue, since when I delete the controlnet in the extension folder and venv folder. I still encountered the same problem

PS: I have no experience in coding at all, Please send help :(

Processor Intel(R) Core(TM) i7-6700HQ CPU @ 2.60GHz 2.60 GHz Installed RAM 16.0 GB GPU: NVIDIA Geforce GTX 1070 System type 64-bit operating system, x64-based processor

I am running on a gaming laptop