InternVL
InternVL copied to clipboard
[Bug] 用vllm跑internvl3.5卡住
跑一批图片的时候总有中间卡住的 然后就不动了 2025-09-23 17:51:22.419 [1;36m(APIServer pid=12)[0;0m INFO 09-23 02:51:16 [loggers.py:123] Engine 000: Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 128.2 tokens/s, Running: 1 reqs, Waiting: 0 reqs, GPU KV cache usage: 16.7%, Prefix cache hit rate: 6.9% 这时必须手动结束掉对应的请求
同样遇到了,怎么解决的呢?