Add support for SGLang
Is your feature request related to a problem? Please describe.
Describe the solution you'd like
In addition to vLLM, add support for SGLang as an inference engine option in KAITO.
Describe alternatives you've considered
Additional context
Hi has any work started on this, I'd be interested in helping!
@kris-gaude, thanks, we have not started the work. Do you want to lead the implementation, or join the implementation with others? If you want to lead the implementation, can you start from submitting an integration proposal? thanks.
@Fei-Guo Hi Fei, I can submit an integration proposal but I would like to work with a few other engineers to help facilitate the project. I've been looking into contributions to OSS projects in the MLOps space mainly for personal learning