Repository navigation
Read the steady-state verdict from result_summary.json - #187
Draft
anandhu-eng wants to merge 1 commit into
Draft
anandhu-eng wants to merge 1 commit into
anandhu-eng wants to merge 1 commit into
Conversation
The checker read the §4.4 block from point.yaml, which nothing writes; submitters copied it by hand from the client's result_summary.json. The checker now reads the client's verdict there and works out the §4.4 status and verdict itself. - steady-state-basis reads result_summary.json and tells apart a missing field (old client), null (detection off) and an unreadable block. - Agentic points and a dedicated Offline run are skipped (§4.4 scope). - §6.2 uses the window only when the client accepted it. - steady-state-valid and steady-state-consistency are removed; they only checked the hand-written block. - The fixture tool moves the corpus verdict into result_summary.json. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
anandhu-eng
marked this pull request as draft
November 9, 2026 17:23
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes #162
The checker read the §4.4
steady_stateblock frompoint.yaml, but nothing writes it there. The client writes its verdict toresult_summary.json, so submitters copied it by hand, and some copies were wrong (for example, an off-by-one super-pass count).Changes:
steady-state-basisreadssteady_statefromresult_summary.jsonand works out the §4.4statusandverdictfrom the client's fields.null(detection off) and an unreadable block each get their own warning.steady-state-validandsteady-state-consistencyare removed. They only checked the hand-written block. Asteady_stateblock left inpoint.yamlis ignored.result_summary.json(101 points regenerated,--checkclean).Mapping from the client's block:
sp_lo..sp_hi - 1(sp_hiis exclusive); duration =end_ns - start_nspartial_datasetinsufficient_passesinsufficient_durationfound: falsewith a 4+ pass window (client rejected it as short), or a window under the §6.2 minimumwindowablenot foundiffoundis false, elseanomaly, elsedrifting_up/drifting_downfromglobal_trend, elseSTEADY STATESeverities do not change: everything here is still a warning or info.
Open questions for the rules (not changed here):
steady_stateas apoint.yamlfield.🤖 Generated with Claude Code