exllama icon indicating copy to clipboard operation
exllama copied to clipboard

doesn't use CUDA_HOME?

Open j2l opened this issue 2 years ago • 0 comments

Hello, python test_benchmark_inference.py -d ./models -p -ppl throws:

/bin/sh: 1: /usr/bin/nvcc: not found
ninja: build stopped: subcommand failed.

but nvcc (Build cuda_11.8.r11.8) is installed

which nvcc
/usr/local/cuda/bin/nvcc

~/.bashrc

export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64"
export CUDA_HOME=/usr
export PATH="/usr/local/cuda/bin:$PATH"

Other AIs use it (Stable Diffusion, ...), so what is wrong?

Ubuntu 22.04 (PopOS) Nvidia 535 for RTX3060 Python 3.10.12

j2l avatar Sep 20 '23 08:09 j2l