ci: track engine main, retire ENGINE_REF, add bias-history (gitgalaxy#2682) - #46
Merged
Merged
Conversation
…#2682) The committed ENGINE_REF file and gitgalaxy's KEYWORD_ROSETTA_REF variable pointed at each other, so no merge order satisfied both; the corpus merged with a knowingly wrong ref and owed a reset nothing enforced (#39 was a PR whose only content was that reset). Both checks are advisory, so both pins are retired. verify.yml always checks out engine main. The rare "verify against an unmerged engine PR in CI" case is a workflow_dispatch input (engine_ref), a run parameter with nothing to reset. The gate loop now counts what it ran, fails on zero, and treats a verifier that exits without PASS/FAIL as a broken audit rather than corpus drift. bias-history.yml is the twin of gitgalaxy's tri-comparison-history.yml: on every push to main and daily, it runs every gate against engine main, regenerates the bias report, chart, cache and findings doc at full precision and commits them, and keeps one issue ("corpus owes a re-bless against engine main") open with the failing languages until the re-bless lands. It never touches manifests or the ledger. Direct commit rather than an auto-merged PR because this repo has no automation PAT and the workflow token cannot open PRs here; token pushes never re-trigger workflows, so there is no loop. GATING.md's choreography section is rewritten to the three-step flow and says plainly that the old procedure did not close. AGENTS.md rule 4, the sweep skill's Phases 4-5 and README follow. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Owner
Author
|
Cross-repo companion: squid-protocol/gitgalaxy#2699 ( Full-sweep dispatch of this branch's |
Owner
Author
|
Full-sweep dispatch of this branch's |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Corpus half of gitgalaxy#2682. Makes this repo behave like gitgalaxy's tri-comparison system: PR-time verification only measures, a push-to-main job regenerates the published artifacts by itself, and no pin points at the other repo.
What changes
ENGINE_REFverify.ymlalways checks out enginemain. To verify against an unmerged engine PR in CI:gh workflow run verify.yml -f engine_ref=pull/<N>/head— a run parameter, nothing committed, nothing to reset..github/workflows/verify.ymlPASS/FAILis a broken audit (exit 2), not corpus drift.pipefailset so the verifier's status survivestee..github/workflows/bias-history.yml(new)bias_report.pyat full precision → commitdocs/bias_*+findings_by_language.mdto main if changed → open/update/close one issue "corpus owes a re-bless against engine main" listing the failing languages.dry_runinput for a no-push rehearsal. Never touches manifests or the ledger.docs/GATING.mdAGENTS.mdrules 4 & 6,rosetta-language-sweepskill Phases 4–5 + checklist,README.mdstep 5Why a direct commit and not a PR like tri-comparison-history
This repo has no
AUTOMATION_PATand "Allow GitHub Actions to create and approve pull requests" is off, so the workflow token cannot open a PR. A token push never re-triggers workflows, so there is no loop to guard. Same mechanism squid-telemetry uses daily. If you would rather have the PR shape, add the PAT secret and I will mirror tri-comparison-history exactly.Verified
verify.ymldispatched on this branch for the full 46-gate sweep, andbias-history.ymldispatched withdry_run=true(links in a comment once they finish).Cross-repo
Companion: squid-protocol/gitgalaxy PR "ci: rosetta-audit without pins" (its
rosetta-auditnow checks out this repo'smain). Either side can merge first; neither depends on the other's SHA any more. Nothing owed afterwards.🤖 Generated with Claude Code