Chinese-Vicuna
Chinese-Vicuna copied to clipboard
Facico
运行了generate.py，出现以下错误，似乎是bitsandbytes 的问题，找到了许多其他项目的类似问题，但是我并没有找到合适的解决方案
===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please run
python -m bitsandbytes
and submit this information together with your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
bin D:\anaconda3\envs\Vicuna\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths...
CUDA SETUP: WARNING! libcuda.so not found! Do you have a CUDA driver installed? If you are on a cluster, make sure you are on a CUDA machine!
CUDA SETUP: Loading binary D:\anaconda3\envs\Vicuna\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so...
argument of type 'WindowsPath' is not iterable
CUDA SETUP: Problem: The main issue seems to be that the main CUDA library was not detected.
CUDA SETUP: Solution 1): Your paths are probably not up-to-date. You can update them via: sudo ldconfig.
CUDA SETUP: Solution 2): If you do not have sudo rights, you can do the following:
CUDA SETUP: Solution 2a): Find the cuda library via: find / -name libcuda.so 2>/dev/null
CUDA SETUP: Solution 2b): Once the library is found add it to the LD_LIBRARY_PATH: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:FOUND_PATH_FROM_2a
CUDA SETUP: Solution 2c): For a permanent solution add the export from 2b into your .bashrc file, located at ~/.bashrc
D:\anaconda3\envs\Vicuna\lib\site-packages\bitsandbytes\cuda_setup\main.py:145: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {WindowsPath('/anaconda3/envs/Vicuna/lib'), WindowsPath('D')}
warn(msg)
D:\anaconda3\envs\Vicuna\lib\site-packages\bitsandbytes\cuda_setup\main.py:145: UserWarning: D:\anaconda3\envs\Vicuna did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths...
warn(msg)
D:\anaconda3\envs\Vicuna\lib\site-packages\bitsandbytes\cuda_setup\main.py:145: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {WindowsPath('/usr/local/cuda/lib64')}
warn(msg)
D:\anaconda3\envs\Vicuna\lib\site-packages\bitsandbytes\cuda_setup\main.py:145: UserWarning: WARNING: No libcudart.so found! Install CUDA or the cudatoolkit package (anaconda)!
warn(msg)
D:\anaconda3\envs\Vicuna\lib\site-packages\bitsandbytes\cuda_setup\main.py:145: UserWarning: WARNING: No GPU detected! Check your CUDA paths. Proceeding to load CPU-only library...
warn(msg)
Traceback (most recent call last):
File "E:\LLM\Chinese-Vicuna\generate.py", line 3, in
python -m bitsandbytes
Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
试试
conda install -c "nvidia/label/cuda-12.1.0" cuda-toolkit还是不行啊老哥
如果报错中也有“CUDA Setup failed despite GPU being available. Please run the following command to get more information”这样的字眼，你可以在网上搜搜如何安装cuda
试试
conda install -c "nvidia/label/cuda-12.1.0" cuda-toolkit还是不行啊老哥
如果报错中也有“CUDA Setup failed despite GPU being available. Please run the following command to get more information”这样的字眼，你可以在网上搜搜如何安装cuda
感谢老哥建议！我重装了环境还是不行，但是用以下命令重新安装bitsandbytes之后解决了这个问题： pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.39.1-py3-none-win_amd64.whl