RuntimeError: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):

[pradeep10kumar]

RuntimeError: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):

CUDA Setup failed despite GPU being available. Please run the following command to get more information:

python -m bitsandbytes

Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

I am running from terminal.

I am working with following versions:

print("Torch version:", torch.version) Torch version: 1.13.1+cu116 print("TorchVision version:", torchvision.version) TorchVision version: 0.14.1+cu116 print("Torchaudio version:", torchaudio.version) Torchaudio version: 0.13.1+cu116 print("Bitsandbytes version:", bnb.version) Bitsandbytes version: 0.43.3

transformers.version '4.44.0'

I have added these paths to my system variables. Still can't find it.

[pradeep10kumar]

Result of python -m bitsandbytes

System Info CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths... CUDA SETUP: WARNING! libcuda.so not found! Do you have a CUDA driver installed? If you are on a cluster, make sure you are on a CUDA machine! CUDA SETUP: Loading binary AppData\Local\Programs\Python\Python310\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so... argument of type 'WindowsPath' is not iterable CUDA SETUP: Problem: The main issue seems to be that the main CUDA library was not detected. CUDA SETUP: Solution 1): Your paths are probably not up-to-date. You can update them via: sudo ldconfig. CUDA SETUP: Solution 2): If you do not have sudo rights, you can do the following: CUDA SETUP: Solution 2a): Find the cuda library via: find / -name libcuda.so 2>/dev/null CUDA SETUP: Solution 2b): Once the library is found add it to the LD_LIBRARY_PATH: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:FOUND_PATH_FROM_2a CUDA SETUP: Solution 2c): For a permanent solution add the export from 2b into your .bashrc file, located at ~/.bashrc

[matthewdouglas]

Hi,

I am closing this issue as it is stale. We've since made improvements to the packaging and setup of the library.

Please open a new issue for further support as needed.