Xingkai Yu

icon company @deepseek-ai

Results 6 comments of Xingkai Yu

Test

Nice!

您好，请问这个包含可运行程序么，具体该怎么启动呢

Release页面里有exe和dll的压缩包

NoneType check

The modification is not need because `i in range(self.experts_start_idx, self.experts_end_idx)`.

A potential problem with GPU memory allocation

Yes, this could indeed cause problems. A more robust approach would be to: 1. Calculate the maximum number of blocks each GPU can allocate independently based on its own available...

Implement support for Qwen2.5vl

Thank you for your interest in extending nano-vllm! As nano-vllm is primarily designed for educational purposes to demonstrate the core concepts of LLM serving, we're currently keeping the scope limited...

ERROR while installing with pip

Thanks for reporting this issue. I suspect you might be trying to install triton on Windows which has limited platform support. This is a known issue that's been discussed in...