vLLM
Results
1
repositories owned by
vLLM
vllm
28.7k
Stars
4.3k
Forks
241
Watchers
A high-throughput and memory-efficient inference and serving engine for LLMs