Skip to content

test runner reports false green for missing and failing suites #626

Description

@hyperpolymath

The root just test aggregate currently converts every missing directory, missing tool, configuration error, compile failure, and failing test into exit 0 via || echo SKIP.

Observed causes:

Required repair:

  • run the four currently executable suites directly
  • fail distinctly for missing target and missing executable
  • preserve the real test process exit code
  • add behavioral regression coverage proving the failure modes do not become SKIP
  • refresh TEST-NEEDS and the MCP scorecard

Adjacent debt, intentionally out of the first patch: build, fmt, and lint contain similar failure-swallowing recipes; build and clean retain extracted Groove paths.

Observation horizon: the tracked standards tree/history, PRs #228 and #612, and direct execution of the four currently runnable suites. This is not an estate-wide test inventory.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions