long-context-attention icon indicating copy to clipboard operation
long-context-attention copied to clipboard
Published 2 months ago • verified publisher icon feifeibear

How to add this attention to SGLang?

Open miter6 opened this issue 4 months ago • 1 comments

How to add this attention to SGLang?

miter6 avatar Aug 18 '25 09:08 miter6

The UPS can work for the prefill phase of LLM inference.

feifeibear avatar Sep 28 '25 02:09 feifeibear