vLLM

Results 1 repositories owned by vLLM

vllm

28.7k
Stars
4.3k
Forks
241
Watchers

A high-throughput and memory-efficient inference and serving engine for LLMs