Repository navigation

Run v2 on fresh Microcosm households in judged batches - #240

Draft

MaxGhenis wants to merge 78 commits into

mainfrom

v2-microcosm-batches

Draft

Run v2 on fresh Microcosm households in judged batches#240
MaxGhenis wants to merge 78 commits into
mainfrom
v2-microcosm-batches

Commits on Oct 22, 2026
- Build fresh household sets and run the tool pilot on them
  
  MaxGhenis
  and
  claude
  committed
  cee4ee4
- Judge each household-set batch with the reference adversary
  
  MaxGhenis
  and
  claude
  committed
  c62b48d
- Let the Claude adversary runner bill a declared API key
  
  MaxGhenis
  and
  claude
  committed
  078cafc
- Let a judge exclude the blocked domains by operator
  
  MaxGhenis
  and
  claude
  committed
  879fd2b
Commits on Oct 23, 2026
- Build test household sets on a named dataset; v2 needs a certified pair
  
  MaxGhenis
  and
  claude
  committed
  b6d835a
- Add calculator tool version 2 (the pe2 arm)
  
  MaxGhenis
  and
  claude
  committed
  6e1578f
- Judge a batch from any model set
  
  MaxGhenis
  and
  claude
  committed
  5bbd571
- Calculator features one at a time: tool v3 and ablation arms
  
  MaxGhenis
  and
  claude
  committed
  e881a6a
- Read facts as the prompt labels them (labels feature)
  
  MaxGhenis
  and
  claude
  committed
  b3ec406
- Labels: read the v2-pilot relabelings; flat: names optional
  
  MaxGhenis
  and
  claude
  committed
  fd3f5d0
- Flat: a household of one's person fact goes to that person
  
  MaxGhenis
  and
  claude
  committed
  5c0f3ec
- Keep tool version 2's request as it was: detail only under concise
  
  MaxGhenis
  and
  claude
  committed
  9c43f4f
- Tool v3 review r1: frame, resume, labels, flat and text fixes
  
  MaxGhenis
  and
  claude
  committed
  6478e8f
Commits on Oct 24, 2026
- Tool v3 review r2: report malformed repeats, resumable harness errors
  
  MaxGhenis
  and
  claude
  committed
  d570b8e
- Format the r2 fix
  
  MaxGhenis
  and
  claude
  committed
  fb35d82
- Tool v3 review r3: check every record's treatment, at resume and at score
  
  MaxGhenis
  and
  claude
  committed
  6b00a6f
- Tool v3: calculator features one at a time, for the ablation pilot (#243)
  MaxGhenis
  authored
  5d807bb
Commits on Oct 25, 2026
- Confirmatory runner: lanes, one engine pool per model, admission, the ceiling
  
  MaxGhenis
  and
  claude
  committed
  6e15d71
- Confirmatory runner: tests
  
  MaxGhenis
  and
  claude
  committed
  c04ffe5
- Confirmatory runner: create both logs at the start
  
  MaxGhenis
  and
  claude
  committed
  ec31e83
- Confirmatory runner: a clock that never goes back, and three test-oracle fixes
  
  MaxGhenis
  and
  claude
  committed
  808ccc8
- Confirmatory runner: the review's eight runner findings, stop causes, chains and anchors
  
  MaxGhenis
  and
  claude
  committed
  fdbd411
- Confirmatory runner: log excerpts from a day before the run's start
  
  MaxGhenis
  and
  claude
  committed
  06abd1f
- Confirmatory runner tests: the interrupt test without a timer
  
  MaxGhenis
  and
  claude
  committed
  f5099db
- Confirmatory runner: round-2 fixes, part 1 (not yet tested)
  
  MaxGhenis
  and
  claude
  committed
  f210b6e
Commits on Oct 26, 2026
- Confirmatory runner: round-2 fixes, part 2
  
  committed
  36d553a
- Confirmatory runner: round-3 fixes
  
  committed
  00d267a
- Confirmatory runner: round-4 fixes
  
  committed
  019f842
Commits on Oct 27, 2026
- Confirmatory runner: round-5 fixes
  
  committed
  9b30a77
- Confirmatory runner: round-6 wording and coverage
  
  committed
  4002f8e
- Run the no-tools stage with recoverable attempts and cumulative spend.
  
  committed
  047c868
- Confirmatory runner: wait for host-log samples in two timing tests
  
  MaxGhenis
  and
  claude
  committed
  060b287
- Confirmatory runner: coordinate no-tools shutdown and freeze inputs
  
  committed
  08d7b18
- Confirmatory runner: require standing no-tools finals before calculation
  
  committed
  5a9735b
- Confirmatory runner: coordinate interruption and worker cleanup
  
  committed
  c60086b
- Confirmatory runner: validate every saved final and baseline inventory
  
  committed
  248e777
- Confirmatory runner: keep exceptional cleanup signal-safe
  
  committed
  4ce7f8e
Commits on Oct 28, 2026
- Confirmatory runner: defer signals and track worker completion
  
  committed
  2f795ea
- Confirmatory runner: restore signal handlers before closing the wake pipe
  
  MaxGhenis
  and
  claude
  committed
  6597adb
- Confirmatory runner: let the forced-exit probe wait for the handler
  
  MaxGhenis
  and
  claude
  committed
  9acc920
- Confirmatory runner: cover watcher startup and pipe teardown
  
  committed
  a1114fe
- Confirmatory runner: qualify signal and cleanup guarantees
  
  committed
  89dd946
- Confirmatory runner: refuse undecodable files with their paths
  
  committed
  4dafb83
- Confirmatory runner: name board and cost refusals
  
  committed
  040d206
- Confirmatory runner: check the CLI with a real board
  
  committed
  6928b06
- Confirmatory runner: guard board rereads and strict saved costs
  MaxGhenis
  committed
  8b6c8f7
- Confirmatory runner: align saved treatment and link checks
  MaxGhenis
  committed
  0300257
Commits on Oct 29, 2026
- Confirmatory runner tests: build preflight finals the treatment checks accept
  
  MaxGhenis
  and
  claude
  committed
  4fb80d9
- Confirmatory runner: reproduce unreadable evidence refusals
  MaxGhenis
  committed
  5e334d9
- Confirmatory runner: bind decoded inputs and name evidence failures
  MaxGhenis
  committed
  d31c1d7
- Confirmatory runner: guard intermediate stage inventories
  MaxGhenis
  committed
  cccc381
- Confirmatory runner: name the new test modules for what they check
  
  MaxGhenis
  and
  claude
  committed
  4d93b40
- Confirmatory runner: refuse listed entries without metadata; one read per record
  
  MaxGhenis
  and
  claude
  committed
  0ae6df5
Commits on Oct 30, 2026
- Confirmatory runner: refuse an archive move before creating its folder
  
  MaxGhenis
  and
  claude
  committed
  c2ca2dc
- Confirmatory runner: refuse unfinished optional histories and special files
  
  MaxGhenis
  and
  claude
  committed
  274e1c7
- Confirmatory runner: format to CI's ruff 0.15.2 and wrap long lines
  
  MaxGhenis
  and
  claude
  committed
  d3673c3
- Confirmatory runner: pin the archive move's descriptor guard
  
  MaxGhenis
  and
  claude
  committed
  0193811
- Confirmatory runner tests: hold the deadline test's second turn for the abandon
  
  MaxGhenis
  and
  claude
  committed
  a8226dd
- Confirmatory runner: hold the preflight to the report's spend and baseline rules
  
  MaxGhenis
  and
  claude
  committed
  4441364
Commits on Oct 31, 2026
- Confirmatory runner: sum saved spend exactly, as the report does
  
  MaxGhenis
  and
  claude
  committed
  ceae93f
- Confirmatory no-tools: pin startup's exact spend at the stage cap
  
  MaxGhenis
  and
  claude
  committed
  3c80377
- No-tools startup: test the sum across models at the cap and the lock's release
  
  MaxGhenis
  and
  claude
  committed
  58ba64b
- No-tools startup: test costs whose sum overflows
  
  MaxGhenis
  and
  claude
  committed
  3846666
- Stub the host facts in the confirmatory tests' World
  
  MaxGhenis
  and
  claude
  committed
  2ee8acf
- Test the host facts that World stubs
  
  MaxGhenis
  and
  claude
  committed
  0ab2b1e
- Confirmatory runner: lanes, one engine pool per model, admission and the ceiling (#244)
  
  MaxGhenis
  and
  claude
  authored
  4ddb784
Commits on Nov 1, 2026
- v2 prompt: carry out d1970, d1971, d1972 and d1029
  
  MaxGhenis
  and
  claude
  committed
  34c51a4
- Read the Louisiana parameter's last date directly
  
  MaxGhenis
  and
  claude
  committed
  b798d7e
Commits on Nov 2, 2026
- Test canonical amounts on the prompt's real people
  
  MaxGhenis
  and
  claude
  committed
  2b233b7
- Drop households by the dependent income the engine counts, as printed
  
  MaxGhenis
  and
  claude
  committed
  edab388
- Drop households by the engine's count of a dependent's gross income, and by losses
  
  MaxGhenis
  and
  claude
  committed
  9e904b2
- Test that a missing amount keeps the household; isolate the frame test
  
  MaxGhenis
  and
  claude
  committed
  fc52bef
- Cite page 4 of the 2025 PA-40 instructions for Pennsylvania's filing rules
  
  MaxGhenis
  and
  claude
  committed
  9e0b858
- Close the d1029 filter's self-employment and income-part gaps (review r3)
  
  MaxGhenis
  and
  claude
  committed
  4f7cfbb
- Leave Alaska out of v2's draw (review r4)
  
  MaxGhenis
  and
  claude
  committed
  1c8c645
Commits on Nov 3, 2026
- Pin the filters' weights and the state check's probe (review r5)
  
  MaxGhenis
  and
  claude
  committed
  7aeefd6
- Move the treatment commit to 1c8c645b
  
  MaxGhenis
  and
  claude
  committed
  ecb8583
- Merge pull request #249 from PolicyEngine/v2-prompt-rulings
  MaxGhenis
  authored
  27a1903

Commits

Commits on Oct 22, 2026

Commits on Oct 23, 2026

Commits on Oct 24, 2026

Commits on Oct 25, 2026

Commits on Oct 26, 2026

Commits on Oct 27, 2026

Commits on Oct 28, 2026

Commits on Oct 29, 2026

Commits on Oct 30, 2026

Commits on Oct 31, 2026

Commits on Nov 1, 2026

Commits on Nov 2, 2026

Commits on Nov 3, 2026