weijiejx

Results 3 comments of


                                            weijiejx

MTL platform with ARC 770 cannot allocate memory block with size lager than 4GB when running vLLM Qwen2-VL-2B

Thank you! But I need double confirm, I use ipex to run Qwen2-VL-2B, not OpenVINO, vLLM 0.5.4 not support, right?

MTL platform with ARC 770 cannot allocate memory block with size lager than 4GB when running vLLM Qwen2-VL-2B

Thanks again. One more question, is any vLLM model available that I can use with vllm 0.5.4? Can you advise me one or two that I can try it. Thanks.

MTL platform with ARC 770 cannot allocate memory block with size lager than 4GB when running vLLM Qwen2-VL-2B

Hi， Could you kindly point out what schedule of 0.6.1 for release if you know it, thanks.