jianglan89
Results
2
comments of
jianglan89
> 没看到是否支持流式的相关文档和例子 普通的prompt 请求以及openai 请求格式都支持参考文档 https://github.com/alibaba/rtp-llm/blob/main/docs/Request.md https://github.com/alibaba/rtp-llm/blob/main/docs/OpenAI-Tutorial.md
> Does sglang now support deepseekv3 inference with EP>1? When I added --enable-ep-moe to the command to start the service, I found that the process would hang. I'm not sure...