Lishijie

I have this issue in the ubuntu 18.04. Building wheels for collected packages: llama-cpp-python, peft Building wheel for llama-cpp-python (pyproject.toml) ... error error: subprocess-exited-with-error × Building wheel for llama-cpp-python (pyproject.toml)...

conda install -c conda-forge cudatoolkit=11.7 cudatoolkit-dev=11.7

i give up. you can try fastchat to use this model

> Found GPU1 NVIDIA GeForce GTX 650 which is of cuda capability 3.0. PyTorch no longer supports this GPU because it is too old. 你的这个显卡不能用，因为太老了，这个模型跑起来基本占用了14GB左右。