Qwen2.5
Qwen2.5 copied to clipboard
[Question]: 2*A100部署qwen2.5-72B-instruct的问题
Has this been raised before?
- [X] I have checked the GitHub README.
- [X] I have checked the Qwen documentation and cannot find an answer there.
- [X] I have searched the issues and there is not a similar one.
- [X] I confirm that this is not a bug report, a feature request, or a badcase.
Description
你好 使用vllm框架 默认配置 2*A100部署qwen2.5-72B-instruct的并发大概是多少啊