lightllm
lightllm copied to clipboard
是否有计划支持 lora?
Same as https://github.com/vllm-project/vllm/issues/182#issuecomment-1627176207
@shihaobai How do you think about this?
@Haskely Adaptations to lora are easier to add if we can follow a more uniform parameter naming convention. We'll add a corresponding adaptation later
@hiworldwzj @Haskely @shihaobai We have developed a high-performance, multi-LoRA serving system utilizing LightLLM (https://github.com/S-LoRA/S-LoRA). We appreciate LightLLM for its lightweight design. If you're interested, we can arrange a time to chat.