Qwen2.5 icon indicating copy to clipboard operation
Qwen2.5 copied to clipboard

[Question]: 2*A100部署qwen2.5-72B-instruct的问题

Open lxb0425 opened this issue 5 months ago • 0 comments

Has this been raised before?

  • [X] I have checked the GitHub README.
  • [X] I have checked the Qwen documentation and cannot find an answer there.
  • [X] I have searched the issues and there is not a similar one.
  • [X] I confirm that this is not a bug report, a feature request, or a badcase.

Description

你好 使用vllm框架 默认配置 2*A100部署qwen2.5-72B-instruct的并发大概是多少啊

lxb0425 avatar Sep 20 '24 03:09 lxb0425