docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].

[Marietto2008]

Hello.

I've tried to install it on my Machine (running Ubuntu 23.10) but I got the error that you see...

root@Z390-AORUS-PRO-DEST:/home/ziomario/Scaricati/AI-Translate# docker run -d -p 5000:5000 --gpus=all
r8.im/replicate/vicuna-13b@sha256:6282abe6a492de4145d7bb601023762212f9ddbbe78278bd6771c8b3b2f2a13b

Unable to find image 'r8.im/replicate/vicuna-13b@sha256:6282abe6a492de4145d7bb601023762212f9ddbbe78278bd6771c8b3b2f2a13b' locally r8.im/replicate/vicuna-13b@sha256:6282abe6a492de4145d7bb601023762212f9ddbbe78278bd6771c8b3b2f2a13b: 
Pulling from replicate/vicuna-13b
6e3729cf69e0: Pulling fs layer 
c89936af62a8: Pulling fs layer 
b595f36bc0d6: Pulling fs layer 
9ea0b6ba6346: Waiting 
c7a5f76dbf21: Waiting 
0ace61bc365d: Pull complete 
95f141d14ca3: Pull complete 
f84bdfb69b68: Pull complete 
dca2c161474f: Pull complete 
950bb921b86b: Pull complete 
7d1f97c11b6b: Pull complete 
dabfe2404e84: Pull complete 
7b13d367d884: Pull complete 
375bf25ece8d: Pull complete 
911e8a9c1d45: Pull complete 
4c723659f6a5: Pull complete 
517a351fa015: Pull complete 
d042c2140c35: Pull complete 
4edc9bee62c9: Pull complete 
8b10860cd8b8: Pull complete 
d5be5b124544: Pull complete 
e836f3e2ebd0: Pull complete 
4bf9f24a42e4: Pull complete 
2d5e4dfbc1bd: Pull complete 
Digest: sha256:6282abe6a492de4145d7bb601023762212f9ddbbe78278bd6771c8b3b2f2a13b
Status: Downloaded newer image for r8.im/replicate/vicuna-13b@sha256:6282abe6a492de4145d7bb601023762212f9ddbbe78278bd6771c8b3b2f2a13b
60ccf389d3b3b9c10045231d9d20bc2e8e02706812a1121cac3d0d33daeb16ba
**docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].**

why that error ? I have two graphic cards...one of them is good...the geforce RTX 2080 ti ; the nvidia driver works,CUDA works...can you explain to me why I get that error ? thanks.

root@Z390-AORUS-PRO-DEST:/home/ziomario/Scaricati/AI-Translate# nvidia-smi
Wed Jan 10 14:24:53 2024       
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 545.29.06              Driver Version: 545.29.06    CUDA Version: 12.3     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA GeForce GTX 1060 3GB    Off | 00000000:01:00.0  On |                  N/A |
| 53%   35C    P0              30W / 120W |    375MiB /  3072MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+
|   1  NVIDIA GeForce RTX 2080 Ti     Off | 00000000:02:00.0 Off |                  N/A |
| 30%   32C    P8              21W / 250W |      6MiB / 11264MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+
                                                                                         
+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|    0   N/A  N/A      2988      G   /usr/lib/xorg/Xorg                          191MiB |
|    0   N/A  N/A      3286      G   xfwm4                                         2MiB |
|    0   N/A  N/A      3315      G   /usr/lib/firefox/firefox                    176MiB |
|    1   N/A  N/A      2988      G   /usr/lib/xorg/Xorg                            4MiB |
+---------------------------------------------------------------------------------------+