aibrix icon indicating copy to clipboard operation
aibrix copied to clipboard

when use stormservice to deploy sglang pd case, "routing role" and "pd_disaggregation.go doPrefillRequest" which one make sense??

Open carolove opened this issue 1 month ago • 0 comments

🐛 Describe the bug

i want to deploy sglang pd, i use stormservice to make it. 1\ i found in stormservice there is a role named "routing", it seems the routing pod handle PD routing. 2\ but , i found in pkg/plugins/gateway/algorithms/pd_disaggregation.go there are two functions call, doPrefillRequest and preparePrefillPayload , those function call have already adapted SGLangEngine logic,

i don't know which one make sense

Steps to Reproduce

none

Expected behavior

none

Environment

none

carolove avatar Nov 21 '25 04:11 carolove