ollama-python
ollama-python copied to clipboard
GPU- Utilization freezing
sometime, GPU- Util memory is freezing, when I'm using mistral through ollama-python . Creating a host using "Client" method.
sometime GPU util reaching to 93%, and everything hanging.
is there anyone who faced the same issue, any solution for the same.
Thanks.