InternVL icon indicating copy to clipboard operation
InternVL copied to clipboard

[Bug] 用vllm跑internvl3.5卡住

Open AKCqhzdy opened this issue 3 months ago • 1 comments

跑一批图片的时候总有中间卡住的 然后就不动了 2025-09-23 17:51:22.419 [1;36m(APIServer pid=12)[0;0m INFO 09-23 02:51:16 [loggers.py:123] Engine 000: Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 128.2 tokens/s, Running: 1 reqs, Waiting: 0 reqs, GPU KV cache usage: 16.7%, Prefix cache hit rate: 6.9% 这时必须手动结束掉对应的请求

AKCqhzdy avatar Sep 23 '25 10:09 AKCqhzdy

同样遇到了,怎么解决的呢?

Developer-Isaac-Xu avatar Sep 29 '25 06:09 Developer-Isaac-Xu