Skip to content

router: --decode-request-weight balances decode DP ranks by held requests - #213

Merged
llying-001 merged 3 commits into
feat/sglang-mix-glm5.2-tp4-v0522from
feat/decode-dp-request-balance
Oct 23, 2026
Merged

router: --decode-request-weight balances decode DP ranks by held requests#213
llying-001 merged 3 commits into
feat/sglang-mix-glm5.2-tp4-v0522from
feat/decode-dp-request-balance

examples/sglang_2p1d_glm5.2: balance the decode ranks by held request…

3ad7527
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar