Chitranshu Agrawal
Results
1
issues of
Chitranshu Agrawal
As per vllm community, vllm 0.6.0 is improved version with 5x throughput. I have installed vllm==0.6.0 but the throughput remains same as earlier. Also the response quality of output is...
usage