Nikita Zakharov

Results 1 comments of Nikita Zakharov

[Bug]: Qwen2.5-VL-72B-Instruct-AWQ error with TP=2 and low throughput (~2 tokens/s) on VLLM_USE_V1=1

i got this problem too