vllm-env icon indicating copy to clipboard operation
vllm-env copied to clipboard

Published 20 hours ago • verified publisher icon kemingy
→

Metadata

setup the env for vllm users

Results 1 vllm-env issues
Sort by recently updated
recently updated
newest added

RuntimeError: No CUDA GPUs are available

5 comment

We are planning to deploy the vLLM using the docker image. Please find below the code for docker image ``` ARG base=nvidia/cuda:11.8.0-cudnn8-devel-ubuntu20.04 ARG commit=main FROM ${base} ENV DEBIAN_FRONTEND=noninteractive LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8...

nithin-nk avatar nithin-nk

← Metadata

15
Stars
1
Forks
Watchers

Owner

verified publisher icon kemingy

Metadata

setup the env for vllm users

Back