Skip to content

适配 Motor 和 vLLM 的用量监控 - #39

Draft
huangxinV587 wants to merge 28 commits into
mainfrom
branch/motor-usage-restore
Draft

huangxinV587 wants to merge 28 commits into
mainfrom
branch/motor-usage-restore

Conversation

@huangxinV587

@huangxinV587 huangxinV587 commented Nov 5, 2026 •

Copy link
Copy Markdown
Contributor

变更

原用量看板使用固定设备组和日志口径,切换到 Motor 与 vLLM 后无法展示当前设备吞吐。此候选通过 Motor 管理端发现动态 PD 拓扑,使用 vLLM 计数器增量展示各组及汇总的 Prefill、Decode 吞吐和阶段直方图均值。

验证

  • python -m unittest discover -s tests -v:397 项,其中 8 项跳过;包含隔离 Caddy 集成测试。
  • 完成独立审查及针对性反例验证。
  • 实际入口部署与真实请求验收需针对目标环境单独核实;不能将隔离测试视为生产性能结论。

huangxinV587 and others added 28 commits November 1, 2026 11:30

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant