vLLM

Results 1 repositories owned by vLLM

vllm

22.7k
Stars
3.2k
Forks
206
Watchers

A high-throughput and memory-efficient inference and serving engine for LLMs