Skip to content

Require observed safety and recovery in release acceptance - #134

Closed
alimobrem wants to merge 4 commits into
mainfrom
codex/agent-outcome-gates
Closed

alimobrem wants to merge 4 commits into
mainfrom
codex/agent-outcome-gates

Conversation

@alimobrem

Copy link
Copy Markdown
Collaborator

Require observed safety and recovery evidence rather than relying only on historical score baselines. Pin all 49 replay fixtures; reject missing, skipped, dry-run or contradictory observations. Require crashloop recovery and a post-fix read, and enforce existing core/error benchmark thresholds without relaxation.

Simulation writes now carry approval only after the actual confirmation callback supplies a matching one-use authorization. Strengthen WebSocket contract assertions and add SRE guidance to verify recovery after mutation and avoid substituting writes after policy denial.

Validation: 117 final focused evaluation tests passed; prior combined contract/eval run passed 131 tests. Ruff, formatting and type checks passed. Latest pre-change live simulation still lacks crashloop post-fix verification, so provider CI must establish the behavioral improvement before merge. Cluster acceptance remains separate and unexecuted.

@alimobrem

Copy link
Copy Markdown
Collaborator Author

Superseded by merged PR135, which includes these acceptance changes and passed the live replay, simulation and mandatory recovery gates in run37128873842 attempt2.

@alimobrem alimobrem closed this Oct 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants