Suraj Singh

Results 4 comments of Suraj Singh

![image](https://github.com/predibase/lorax/assets/83424550/5a1cb64a-5690-4651-81be-50a9621c635a) Outside the container everything looks good, I am using the same system to load models smoothly. The container is not able to access the GPUs somehow.

> Hi, almost the same here with nvidia-smi: > > ``` > +-----------------------------------------------------------------------------------------+ > | NVIDIA-SMI 550.54.14 Driver Version: 550.54.14 CUDA Version: 12.4 | > |-----------------------------------------+------------------------+----------------------+ > | GPU Name...

> Same as above (I think we read the same article 😉) except I didn't use sudo (rootless) and I used the docker emulator of podman + I used TMPDIR...

> I found on a French website (https://www.metal3d.org/blog/2023/podman-et-nvidia/) some settings so that podman can access the GPU: > > ``` > # install nvidia container toolkit repo > curl -s...