CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment!

[cnahmgx]

===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues

CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so CUDA SETUP: Highest compute capability among GPUs detected: 7.5 CUDA SETUP: Detected CUDA version 117 CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so... /lib64/libstdc++.so.6: version CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so) CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so CUDA SETUP: Highest compute capability among GPUs detected: 7.5 CUDA SETUP: Detected CUDA version 117 CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so... /lib64/libstdc++.so.6: version CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so) CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so CUDA SETUP: Highest compute capability among GPUs detected: 7.5 CUDA SETUP: Detected CUDA version 117 CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so... /lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so) CUDA SETUP: Something unexpected happened. Please compile from source: git clone [email protected]:TimDettmers/bitsandbytes.git cd bitsandbytes CUDA_VERSION=117 make cuda11x python setup.py install Traceback (most recent call last): File "/root/magaoxiang/finetune.py", line 9, in from peft import get_peft_model, LoraConfig, TaskType File "/usr/local/lib/python3.9/site-packages/peft/init.py", line 22, in from .mapping import MODEL_TYPE_TO_PEFT_MODEL_MAPPING, PEFT_TYPE_TO_CONFIG_MAPPING, get_peft_config, get_peft_model File "/usr/local/lib/python3.9/site-packages/peft/mapping.py", line 16, in from .peft_model import ( File "/usr/local/lib/python3.9/site-packages/peft/peft_model.py", line 31, in from .tuners import LoraModel, PrefixEncoder, PromptEmbedding, PromptEncoder File "/usr/local/lib/python3.9/site-packages/peft/tuners/init.py", line 20, in from .lora import LoraConfig, LoraModel File "/usr/local/lib/python3.9/site-packages/peft/tuners/lora.py", line 36, in import bitsandbytes as bnb File "/usr/local/lib/python3.9/site-packages/bitsandbytes/init.py", line 7, in from .autograd._functions import ( File "/usr/local/lib/python3.9/site-packages/bitsandbytes/autograd/init.py", line 1, in from ._functions import undo_layout, get_inverse_transform_indices File "/usr/local/lib/python3.9/site-packages/bitsandbytes/autograd/_functions.py", line 9, in import bitsandbytes.functional as F File "/usr/local/lib/python3.9/site-packages/bitsandbytes/functional.py", line 17, in from .cextension import COMPILED_WITH_CUDA, lib File "/usr/local/lib/python3.9/site-packages/bitsandbytes/cextension.py", line 22, in raise RuntimeError(''' RuntimeError: CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment! If you cannot find any issues and suspect a bug, please open an issue with detals about your environment: https://github.com/TimDettmers/bitsandbytes/issues

[cnahmgx]

有人遇到过这种问题么

[walker83]

问题不太一样，用另外的方案绕过了

[xpeter80]

问题不太一样，用另外的方案绕过了

什么方案？

[luohm111]

我也遇到了这个问题，请问什么方案可以绕过？

[luohm111]

问题不太一样，用另外的方案绕过了

请问什么方案可以绕过？

[walker83]

问题不太一样，用另外的方案绕过了

请问什么方案可以绕过？ 我的问题类似，用这个办法解决的： https://github.com/mymusise/ChatGLM-Tuning/issues/117

[cutelitchi]

你这个117也没解决啊

[magicleo]

export LD_LIBRARY_PATH=/mnt/storage/anaconda3/lib:$LD_LIBRARY_PATH ubuntu在环境中增加这个可解决。路径酌情修改

[GromZhang]

我觉得问题的核心在这里 CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so... /lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so) 可以通过更新libstdc++.so.6的版本，来解决上述问题 亲测，可用