sgl-project
Results
5
repositories owned by
sgl-project
sglang
20.3k
Stars
3.5k
Forks
20.3k
Watchers
SGLang is a fast serving framework for large language models and vision language models.
SpecForge
500
Stars
112
Forks
500
Watchers
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
ome
322
Stars
46
Forks
322
Watchers
OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)
rbg
117
Stars
32
Forks
117
Watchers
A workload for deploying LLM inference services on Kubernetes
whl
16
Stars
3
Forks
16
Watchers
Kernel Library Wheel for SGLang