You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 0480c3e
Browse filesBrowse the repository at this point in the historyBrowse files
* feat(report): add Ship / No-ship verdict table and collapsible PR comment sections
- Add `classifyGroupVerdict` and `renderVerdictSummaryTable` to surface
per-eval `✅ Ship`, `🛑 No ship`, and `⚠️ Re-run` verdicts at the top
of comparison PR comments.
- Order actionable `🛑 No ship` and `⚠️ Re-run` `<details>` sections
above `---`, and place passing `<details>`, unchanged eval coverage,
and full `Baseline vs. Candidate` / `Quality & token summary`
telemetry below `---`.
- Align the aggregate `Outcome` row in `renderComparisonSection` with
the headline verdict and preserve comment byte-budget notices.
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
* fix(report): bound unchanged/telemetry rows to comment budget and classify zero-trial baselines
- Bound unchanged coverage rows and telemetry Eval/Trials/Result rows
against the 60 KB PR comment limit.
- Sum stimuliTotal separately in unchanged coverage summaries and report
skipped scenario counts accurately.
- Let failing candidate groups with zero-trial baselines reach the No-ship
classification.
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
* fix(report): prevent unverified baseline failures from reporting as fixed in Outcome
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
* fix(report): show dash for missing candidate model and keep unchanged failure delta
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
* fix(report): require usable baseline for Ship verdict and distinguish score regressions
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
* refactor(report): remove duplicate per-group details blocks in PR comment
Keep only the top-level Ship / No-ship verdict table above the fold and
a single collapsible Telemetry, token deltas & run evidence section.
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
* fix(report): address review findings on still-failing verdicts, incomplete runs, and byte limits
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
---------
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
0 commit comments