Qasim
Results
2
comments of
Qasim
Even after setting VLLM_USE_V1=1 , deploying vllm 0.8.2 with ray 2.44 , falls back to using V0 engine. I have not tested it with ray 2.43. Do note, starting vllm...
> > Even after setting VLLM_USE_V1=1 , deploying vllm 0.8.2 with ray 2.44 , falls back to using V0 engine. I have not tested it with ray 2.43. > >...