zhangzhancheng

When I'm on the cpu, everything works fine, when I switch to the GPU, all sorts of errors. Currently, NVCC -V is version 12.1, corresponding to torch 2.1.2+cu121 torchaudio 2.1.2+cu121...

when I reinstalled transformers slove the problems but now error: python ingest.py --device_type cuda 2024-05-15 04:34:22,580 - INFO - ingest.py:148 - Loading documents from /workspace/localGPT/SOURCE_DOCUMENTS Importing: Orca_paper.pdf 2024-05-15 04:34:22,587 -...

I hava resolved it by "apt-get install ffmpeg libsm6 libxext6 -y" and error next: python ingest.py --device_type cuda 2024-05-15 04:44:01,619 - INFO - ingest.py:148 - Loading documents from /workspace/localGPT/SOURCE_DOCUMENTS Importing:...

if you cannot download from https://huggingface.co/, you can edit the .py add import os os.environ['HF_ENDPOINT'] = 'https://hf-mirror.com'

python run_localGPT.py error,solve: pip install bitsandbytes-cuda113 pip uninstall bitsandbytes-cuda113 pip install bitsandbytes