Skip to content

fix(test): make aggregate runner fail loudly - #627

Merged
hyperpolymath merged 2 commits into
mainfrom
fix/test-runner-honesty
Aug 24, 2026
Merged

fix(test): make aggregate runner fail loudly#627
hyperpolymath merged 2 commits into
mainfrom
fix/test-runner-honesty

Conversation

@hyperpolymath

Copy link
Copy Markdown
Owner

Closes #626

Replaces the false-soft just test aggregate with four required, currently executable suites and a helper that keeps failures observable.

  • missing target exits 66
  • missing executable exits 127 with UNAVAILABLE
  • test failures preserve the underlying exit code
  • required suites never become SKIP
  • behavioral regression harness plants passing, unavailable, failing, and missing-target cases
  • TEST-NEEDS distinguishes runnable suites from extracted Groove and pending AXEL infrastructure
  • MCP scorecard no longer claims the deleted deno.json task exists

Validation:

  • just test-runner-test (5/5)
  • just test (MCP 36, offline guardian 29, A2ML 47 + 3 doctests, K9 42 + 3 doctests)
  • just validate
  • just scorecards-check
  • ShellCheck and bash -n on the new scripts
  • git diff --check

Adjacent failure-swallowing debt in build/fmt/lint is documented in #626 and deliberately left outside this focused patch.

@gitar-bot

gitar-bot Bot commented Aug 24, 2026

Copy link
Copy Markdown

Important

You are using the Gitar free plan. Upgrade to unlock code review, CI analysis, auto-apply, custom automations, and more.

Gitar

@hyperpolymath
hyperpolymath merged commit bbfae30 into main Aug 24, 2026
19 of 23 checks passed
@hyperpolymath
hyperpolymath deleted the fix/test-runner-honesty branch August 24, 2026 20:24
@sonarqubecloud

Copy link
Copy Markdown

hyperpolymath added a commit that referenced this pull request Aug 24, 2026
Post-merge repair for #625 and #627.

#625 regenerated the registry before #627 changed tracked content in ten
registered homes. After both merged, `main` failed the hard
registry/topology drift gate. This reruns the canonical generator from
current `main`; only ten generated source hashes change and a second
generation is clean.

Validation:
- `bash scripts/build-registry.sh`
- `bash scripts/build-registry.sh --check`
- `just validate`
- `just test-runner-test` (5/5)
- `git diff --check`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test runner reports false green for missing and failing suites

1 participant