Zhoujiecheng

icon indicating a website link https://www.ustc.edu.cn/

icon company USTC icon location China icon location A PhD student at the University of Science and Technology of China (USTC)

Results 1 issues of Zhoujiecheng

Bug when using vllm async rollout

3 comment

I encountered the following error when trying to use vllm's async rollout. env: python 3.10, pytorch 2.6, vllm 0.8.5 (AsyncvLLMServer pid=5222) Process EngineCore_0: (AsyncvLLMServer pid=5222) Traceback (most recent call last):...