是否有计划支持 lora？

[Haskely]

Same as https://github.com/vllm-project/vllm/issues/182#issuecomment-1627176207

[hiworldwzj]

@shihaobai How do you think about this?

[shihaobai]

@Haskely Adaptations to lora are easier to add if we can follow a more uniform parameter naming convention. We'll add a corresponding adaptation later

[Ying1123]

@hiworldwzj @Haskely @shihaobai We have developed a high-performance, multi-LoRA serving system utilizing LightLLM (https://github.com/S-LoRA/S-LoRA). We appreciate LightLLM for its lightweight design. If you're interested, we can arrange a time to chat.