Codi

Results 3 comments of Codi

I fixed this problem by following this tutorial: https://learn-with-gaurang-experience.medium.com/installing-cuda-11-7-and-cudnn-8-5-in-linux-22-04-for-opencv-a-step-by-step-guide-6d63a5fa4007 Running @freckletonj's command again, you'll see that the llama-cpp-python is (hopefully) installed with cuda. ```bash CMAKE_ARGS="-DGGML_CUDA=on" pip install llama-cpp-python --force-reinstall --no-cache-dir...

On NixOS 25.05, I get this error as well. I tested it, and Nvidia encoding only works with NixOS 24.05, no newer. This means the problem is between NixOS 24.05...