kaito icon indicating copy to clipboard operation
kaito copied to clipboard

Add support for SGLang

Open ritazh opened this issue 5 months ago • 3 comments

Is your feature request related to a problem? Please describe.

Describe the solution you'd like

In addition to vLLM, add support for SGLang as an inference engine option in KAITO.

Describe alternatives you've considered

Additional context

ritazh avatar Jun 30 '25 16:06 ritazh

Hi has any work started on this, I'd be interested in helping!

kris-gaudel avatar Aug 07 '25 06:08 kris-gaudel

@kris-gaude, thanks, we have not started the work. Do you want to lead the implementation, or join the implementation with others? If you want to lead the implementation, can you start from submitting an integration proposal? thanks.

Fei-Guo avatar Aug 07 '25 16:08 Fei-Guo

@Fei-Guo Hi Fei, I can submit an integration proposal but I would like to work with a few other engineers to help facilitate the project. I've been looking into contributions to OSS projects in the MLOps space mainly for personal learning

kris-gaudel avatar Aug 07 '25 23:08 kris-gaudel