Repository navigation

Reduce the runtime of benchmarking draining phase - #556

Merged

nvzhihanj merged 6 commits into

mlcommons:mainfrom

zihaok:zihaok_batched_full_run_osl

Nov 6, 2026

Merged

Reduce the runtime of benchmarking draining phase#556
nvzhihanj merged 6 commits into
mlcommons:mainfrom
zihaok:zihaok_batched_full_run_osl

Commits on Nov 3, 2026
- address finalization bottleneck in high concurrency high dataset repeat run
  zihaok
  committed
  7c9b731
- speeed up drain and final OSL processing
  zihaok
  committed
  fe67d74
- address bottleneck in the inline accuracy calculation
  zihaok
  committed
  87440ed
- style: ruff-format trailing comment spacing in token_metrics
  zihaok
  committed
  28f6d9e
Commits on Nov 5, 2026
- incorprate commit 561
  zihaok
  committed
  100cf94
- address comments
  zihaok
  committed
  b0ffb2c