Yongkai Wang

icon indicating a website link https://www.dlut.edu.cn/

icon company dalian university of technology icon location 大连 icon location dalian university of technology/major in computer science

Results 1 comments of Yongkai Wang

[Bug]: Vllm0.6.2 UserWarning: resource_tracker: There appear to be 1 leaked shared_memory objects to clean up at shutdown

WARNING 01-12 08:36:16 config.py:1656] Casting torch.bfloat16 to torch.float16. INFO 01-12 08:36:17 config.py:899] Defaulting to use mp for distributed inference WARNING 01-12 08:36:17 arg_utils.py:940] The model has a long context length...