vllm icon indicating copy to clipboard operation
vllm copied to clipboard
verified publisher icon vllm-project

Bug: Windows installation

Open 0xqd opened this issue 2 years ago • 1 comments

I got this message when trying out vllm with windows; No CUDA runtime is found, using CUDA_HOME='C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8\bin'

Cuda is installed and available in the directory. Does vllm support windows installation now? Thanks for great work

0xqd avatar Jun 21 '23 06:06 0xqd

Unfortunately, vLLM does not support Windows at the moment.

WoosukKwon avatar Jun 21 '23 08:06 WoosukKwon

vLLM can run on Windows WSL as in #188. Please try it out!

zhuohan123 avatar Jun 27 '23 15:06 zhuohan123