ybyang
ybyang
### Pre-requisites - [X] I have double-checked my configuration - [X] I can confirm the issues exists when I tested with `:latest` - [ ] I'd like to contribute the...
### The Feature Support Iflytek [SparkLLM](https://xinghuo.xfyun.cn/) ### Motivation, pitch iflytek sparkLLM have more advantages in china ### Twitter / LinkedIn details _No response_
### Tell us what feature you want? 开发者定义openapi, 从openapi生成插件协议部分
### Tell us what feature you want? Support Gradio , to generate gradio APP
### Feature request can support https://huggingface.co/BAAI/bge-visualized/blob/main/README.md ? ### Motivation can support https://huggingface.co/BAAI/bge-visualized/blob/main/README.md ### Your contribution testing
新特性 [*] 支持[星火maas平台](https://training.xfyun.cn/)微调后模型部署的API, 欢迎使用 [*] Meta信息添加支持 LoraID,用户可以通过OpenAI的客户端或者 Httpclient设置 extra body: lora_id: 来访问lora小包模型 [*] 响应设置 random.uuid 替换为讯飞返回SID [*] 讯飞响应报错返回讯飞Code信息 我已确认该 PR 已自测通过,相关截图如下: 使用方法: 1. 使用Maas微调模型:  2. 使用Lora_ID 3. 响应设置讯飞sid 其中Lora_ID...
### Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [x] 2. The bug has not been fixed in the latest version. -...
# Motivation 1. The community lacks a good example of distributed inference in a K8s environment. 2. The community lacks examples of containerized environments combined with high-speed networks like RoCE....
### Checklist - [x] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed. - [x]...