Add codex and change cost calc - #3

Draft

Intron7 wants to merge 25 commits into

mainfrom

add-codex-and-change-cost-calc

Commits on Aug 7, 2026

add codex and change cost calc

Intron7
authored and
PauBadiaM
committed
3d2e490
fix claude costs

Intron7
authored and
PauBadiaM
committed
1311a82
[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
PauBadiaM
committed
30b2e8f
update gitignore

Intron7
authored and
PauBadiaM
committed
d948eca
update codex and report

Intron7
authored and
PauBadiaM
committed
87a7b6c
Support target dependency groups and pip packages
PauBadiaM
committed
bf94e18
Ignore hidden paths in backend import test
PauBadiaM
committed
40ae489
Add dual cost tracking and fail-closed agent sandboxes
PauBadiaM
committed
e3a73d9
Use inferred costs in benchmark reports
PauBadiaM
committed
6806fec
ci: install agent CLIs for tests
PauBadiaM
committed
c398ee9
Invalidate benchmark passes on provider quota exhaustion

PauBadiaM
and
claude
committed
cba285b
Bench every arm when none is selected

PauBadiaM
and
claude
committed
b761a55
Order the OpenAI ramp by tier potency

PauBadiaM
and
claude
committed
c947b8c
Read token rates live instead of shipping a table

PauBadiaM
and
claude
committed
235c00d
avoid future warning

Intron7
authored and
PauBadiaM
committed
ef2bc43
fix sandbox and config

Intron7
authored and
PauBadiaM
committed
364eeec
Surface allowed_domains in the scaffolded config

authored and
PauBadiaM
committed
3c22027
Give isolated agents unrestricted internet again

PauBadiaM
and
claude
committed
63d1b8b

Commits on Aug 9, 2026

fix codex issues
Intron7
committed
f02854c
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committed
024a7ee

Commits on Aug 17, 2026

Verify task ground truth, and order the cost figure with arrows

PauBadiaM
and
claude
committed
fb695e4

Commits on Aug 19, 2026

Record what a capped Codex run spent, and grade the answer it wrote

PauBadiaM
and
claude
committed
7b50bf1

Commits on Aug 21, 2026

Price every run acumen shows from its own frozen rate table

PauBadiaM
and
claude
committed
83c1271
Close a Claude run's session before grading what it wrote

PauBadiaM
and
claude
committed
51c8c2d

Commits on Aug 22, 2026

Strip the target's own skill from the venv acumen hands an agent

PauBadiaM
and
claude
committed
9992595