I have Nvidia GPU but I am getting error.
I am getting error : Error response from daemon: unknown or invalid runtime name: nvidia
I did the configuration as required and when I run sudo docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi
I am getting this output :
Sun Dec 24 09:53:47 2023
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.147.05 Driver Version: 525.147.05 CUDA Version: 12.0 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 NVIDIA GeForce ... Off | 00000000:01:00.0 Off | N/A |
| N/A 45C P8 4W / 50W | 163MiB / 4096MiB | 27% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
This shows that docker is able to access nvidia GPU. So what is the issue here?
Did you change anything from the config? Could you please show the full logs where we have the logs "Error response from daemon: unknown or invalid runtime name: nvidia". I'd like to see the context around it.
@stockarea
No, I have not changed any config file.
That is the only error it is showing in the log.
[+] Running 1/0
⠋ Container go5-project-text_recognition-1 Recreate 0.0s
✔ Container go5-project-table_recognition-1 Running 0.0s
Error response from daemon: unknown or invalid runtime name: nvidia
@stockarea it seems like we have a problem with the Nvidia runtime. Could you please check the recent issue raised by the community to see if it helps, I haven't meet this issue... For example: https://github.com/NVIDIA/nvidia-container-toolkit/issues/150
@phamquiluan I do have nvidia runtime installed as shown by sudo docker info | grep -i runtime
Runtimes: io.containerd.runc.v2 nvidia runc
Default Runtime: nvidia