sglang icon indicating copy to clipboard operation
sglang copied to clipboard
Published 1 month ago • verified publisher icon sgl-project

[Feature] Support unified paging in multi-lora serving

Open Sunt-ing opened this issue 10 months ago • 3 comments

Checklist

  • [x] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
  • [x] 2. Please use English, otherwise it will be closed.

Motivation

Currently, SGL doesn't support the unified paging feature proposed by S-LoRA. However, this feature is important for memory management in multi-LoRA serving.

Related resources

No response

Sunt-ing avatar Feb 17 '25 19:02 Sunt-ing

We will try to implement it soon.

Link: https://github.com/sgl-project/sglang/issues/2929

Sunt-ing avatar Feb 17 '25 19:02 Sunt-ing

Sure! Thank you for your help~ cc @Fridge003

jhinpan avatar Feb 17 '25 19:02 jhinpan

@Sunt-ing Thanks! Looking forward to your contribution!

Fridge003 avatar Feb 17 '25 19:02 Fridge003

This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.

github-actions[bot] avatar Apr 19 '25 00:04 github-actions[bot]

This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.

github-actions[bot] avatar Jun 19 '25 00:06 github-actions[bot]

This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.

github-actions[bot] avatar Aug 19 '25 00:08 github-actions[bot]

This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.

github-actions[bot] avatar Oct 19 '25 00:10 github-actions[bot]