sglang icon indicating copy to clipboard operation
sglang copied to clipboard
Published 1 month ago • verified publisher icon sgl-project

[Feature] Support Lora for VocabParallelEmbedding layer

Open Fridge003 opened this issue 10 months ago • 0 comments

Checklist

  • [x] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
  • [x] 2. Please use English, otherwise it will be closed.

Motivation

Support lora for VocabParallelEmbedding. Not a trivial task.

Related resources

No response

Fridge003 avatar Feb 09 '25 19:02 Fridge003