ollama-python icon indicating copy to clipboard operation
ollama-python copied to clipboard

GPU- Utilization freezing

Open ankitvirla opened this issue 1 month ago • 0 comments

sometime, GPU- Util memory is freezing, when I'm using mistral through ollama-python . Creating a host using "Client" method.

image

sometime GPU util reaching to 93%, and everything hanging.

image

is there anyone who faced the same issue, any solution for the same.

Thanks.

ankitvirla avatar May 02 '24 08:05 ankitvirla