Cuda 12.4 - ImportError: libcudart.so.12: cannot open shared object file: No such file or directory

[rozariwang]

pytorch 2.4.0 setuptools 69.5.1 cuda 12.4

Hi,

I am trying to run Mamba on a server using a Docker image. The server machines are using Cuda 12.4. When I try to run the model, I get the following output. I wonder if it is related to incompatibilities with Cuda or Pytorch.

import selective_scan_cuda
ImportError: libcudart.so.12: cannot open shared object file: No such file or directory

I can see there is no wheel for Cuda 12.4. Is it possible to publish a wheel for Cuda 12.4? Somebody else is asking for the same here.

Thanks a lot.