TimDettmers
agx orin with jetpack 5.1.2 ，install bitsandbyts=0.41.0，error The installed version of bitsandbytes was compiled without GPU support，
System Info
python3 -m bitsandbytes False /home/nx/Downloads/bitsandbytes-0.41.0/bitsandbytes/cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable. warn("The installed version of bitsandbytes was compiled without GPU support. " 'NoneType' object has no attribute 'cadam32bit_grad_fp32' ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ ++++++++++++++++++ BUG REPORT INFORMATION ++++++++++++++++++ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
++++++++++++++++++ /usr/local CUDA PATHS +++++++++++++++++++ /usr/local/cuda-11.4/targets/aarch64-linux/lib/stubs/libcuda.so /usr/local/cuda-11.4/targets/aarch64-linux/lib/libcudart.so
+++++++++++++++ WORKING DIRECTORY CUDA PATHS +++++++++++++++
++++++++++++++++++ LD_LIBRARY CUDA PATHS +++++++++++++++++++ ++++++++++ /usr/local/cuda-11.4/lib64 CUDA PATHS +++++++++++
++++++++++++++++++++++++++ OTHER +++++++++++++++++++++++++++ COMPILED_WITH_CUDA = False COMPUTE_CAPABILITIES_PER_GPU = [] ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ ++++++++++++++++++++++ DEBUG INFO END ++++++++++++++++++++++ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Running a quick check that: + library is importable + CUDA function is callable
WARNING: Please be sure to sanitize sensible info from any such env vars!
Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Above we output some debug information. Please provide this info when creating an issue via https://github.com/TimDettmers/bitsandbytes/issues/new/choose ...
Reproduction
pip3 install bitsandbytes
python3 -m bitsandbytes
Expected behavior
how to install bitsandbytes0.41.0 in agx orin with jetpackpack=5.1.2
I also had the same issue. Building bitsandbytes manually from source solved the problem.
