Junjie
Results
34
comments of
Junjie
This [issue](https://github.com/vllm-project/vllm/issues/16334) seems related, but no response so far.
qwen 2/2.5 vl please. Thanks.
> > ### Your current environment > > 这是部署启动命令： CUDA_VISIBLE_DEVICES=2,34,5 vllm serve /mnt/cfs/ljc/ckpt/Qwen/Qwen2___5-VL-72B-Instruct --tensor-parallel-size 4 --gpu-memory-utilization 0.8 --port 20772 --limit-mm-per-prompt image=5 > qwen2.5_vl_72B_instruct_20772_new.log 2>&1 & > > ### 🐛 Describe...