Open-Assistant icon indicating copy to clipboard operation
Open-Assistant copied to clipboard

Running versions of CUDA, other than 11.8 or 12.0

Open phalexo opened this issue 2 years ago • 0 comments

I need the OA to use CUDA version 11.3. It appears that it is built around 11.8 or greater. Although I changed the docker image from nvidia/cuda:12.0.0-devel-ubuntu22.04 to nvidia/cuda:11.3.0-cudnn8-devel-ubuntu20.04 in the ./docker/inference/Dockerfile.worker-hf and set the env variables to what's below, I am still getting an error about the wrong driver version.

How can I go about getting a lit of all the places where CUDA/nvidia is referenced, so that I could build with 11.3?

ENV CUDA_VERSION=11.3 ENV NVIDIA_VISIBLE_DEVICES all ENV NVIDIA_DRIVER_CAPABILITIES compute,utility ENV NVIDIA_REQUIRE_CUDA "cuda>=11.3"

phalexo avatar Apr 27 '23 17:04 phalexo