Repository navigation
test(seed-policy): inventory every seed flag; guard the shared study runner - #305
Merged
Merged
Conversation
…runner's --seeds The inventory test fails when a module adds a seed flag without a listed refusal case. It found one gap: report/runner.py accepted --seeds for a study with Flags(seeds=True) without the policy check. No study sets that flag today, so nothing ran. The runner now refuses seeds from 100 before any case runs. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
| import re | ||
| from pathlib import Path | ||
|
|
||
| import navkit |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Follow-up to the post-remediation audit (CN-AUD-02: every seed-taking path needs a refusal).
src/navkitfor--...seed...arguments and fails if a module is neither listed as guarded nor as a gate. It also checks the list for stale entries.--seedsforFlags(seeds=True)without the policy check. No study sets that flag, so no held-out seed was ever reachable. The runner now callsrequire_developmentbefore any case runs.--growth-seeds,--fault-seeds,--ensemble-seedsand the runner. No seed of 100 or more is run.Not changed: the two gate procedures, which may use held-out seeds by design.
🤖 Generated with Claude Code