devika icon indicating copy to clipboard operation
devika copied to clipboard

Published 20 hours ago • verified publisher icon stitionai

fix: Enable NVIDIA GPU support for Ollama in Docker

Open juvi21 opened this issue 11 months ago • 2 comments

added NVIDIA GPU support for OLLAMA in docker-compose.yaml

juvi21 avatar Mar 29 '24 16:03 juvi21

can make the latest docker files that compatible with the current changes.

ARajgor avatar Apr 03 '24 20:04 ARajgor

This code throws error. if nvidia gpu container toolkit is not present ( which will prevent non-gpu from running docker).

I would suggest to handle it gracefully using "runtime" and a environment variable in code, so that it will give flexibity for a non-GPU user also to run & also it won't throw errors if nvidia-gpu-container- toolkit is not present.

So it can handle in better way? Or I just skip this pr currently?

ARajgor avatar Apr 12 '24 03:04 ARajgor