Zihan Wang

icon location PhD student at Northwestern University. Previously @deepseek-ai @uiucnlp & Renmin University

Results 1 issues of Zihan Wang

Issue with raylet error

13 comment

Hi, I'm using vllm to run llama-13B on two V100-16GB GPUs. I deployed vllm with the API server. However, When the context is long, the server returns: [2023-08-09 22:39:16,002 E...