Skip to content

fix(live-claims): diagnostic sentences are not test-run claims (#201) - #207

Merged
surlymochan merged 1 commit into
mainfrom
openswarm/20261116-073054-c543cf
Nov 16, 2026
Merged

surlymochan merged 1 commit into
mainfrom
openswarm/20261116-073054-c543cf

Conversation

@surlymochan

Copy link
Copy Markdown
Owner

swrm intake ticket tkt-013537d14d3b — evalid #201, run 20261116-073054-c543cf (pi, MiniMax-M3.1-Flash-Preview).

What

A sentence reporting a command failing to run (failed spawn / ENOENT / command not found) is diagnostic context, not an assertion the agent made. The extractor now drops such sentences from the claim set; a command an ordinary sentence also asserts is still claimed.

M15 evidence set session 7: the pytest diagnostic sentence (test/env-python.test.js failed … spawnSync("pytest", …) got ENOENT) no longer yields a claim, so it can no longer be replay-confirmed.

Evidence (operator verify, not executor self-report)

  • node test/live-claims.test.js in the run worktree: 36 pass, 0 fail (7 new diagnostic-context tests).
  • Full-suite CI runs on this PR; bench-number acceptance is out of scope for this fix (unit + regression tests only).

Recovery note

The dispatch run was killed mid-flight by a VM runtime restart (no result.json; the poll process died at dispatch_started). The executor's uncommitted work survived in the run worktree and was verified, committed (52e00d2), and pushed by the operator. Ledger gap disclosed in swrm #244.

A sentence reporting a command failing to run (failed spawn / ENOENT /
command not found) is diagnostic context, not an assertion the agent
made. The extractor now drops such sentences from the claim set;
a command an ordinary sentence also asserts is still claimed.

M15 evidence set session 7: the pytest diagnostic sentence no longer
yields a claim, so it can no longer be replay-confirmed. 7 new tests.
@surlymochan
surlymochan merged commit b504fd4 into main Nov 16, 2026
2 checks passed
@surlymochan surlymochan mentioned this pull request Nov 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant