Jackson-cj

ImportError: /root/anaconda3/envs/test2/lib/python3.10/site-packages/awq_inference_engine.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi

1

I try to use TheBloke/OpenHermes-2.5-Mistral-7B-AWQ,but to happen the error,ask for help,thanks. nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2022 NVIDIA Corporation Built on Mon_Oct_24_19:12:58_PDT_2022 Cuda compilation tools, release 12.0,...