Skip to content

fix(bench): pi_shim.sh executable so the openswarm arm can run (#208) - #209

Merged
surlymochan merged 1 commit into
mainfrom
openswarm/20261116-140430-2be5aa
Nov 16, 2026
Merged

surlymochan merged 1 commit into
mainfrom
openswarm/20261116-140430-2be5aa

Conversation

@surlymochan

Copy link
Copy Markdown
Owner

Fixes #208.

The SWE-bench openswarm arm points OPENSWARM_PI_BIN at bench/swebench/harness/pi_shim.sh, and swrm pi_bin() only accepts a path that is executable. The shim was tracked with mode 100644, so a fresh checkout produced a non-executable shim and every openswarm cell in the M16 MiniMax pilot died in ~1s with status unroutable ("no working pi binary") — 0/6, an infrastructure failure rather than a model signal.

Change:

  • bench/swebench/harness/pi_shim.sh: mode 100644 -> 100755, content unchanged.
  • test/bench-pi-shim-exec.test.js (new): regression test asserting the on-disk exec bit, the committed 100755 mode via git ls-files -s, the bash shebang, and the OPENSWARM_PI_BIN wiring in harness/arms.py.

Verification (operator, independent re-run on PR head 84b4a88):

  • node --test test/bench-pi-shim-exec.test.js -> 4/4 pass.
  • Related suites + acceptance: node --test test/bench-harness-isolation.test.js test/bench-planner-prompt.test.js test/head-to-head-bench.test.js test/live-claims.test.js -> 43/43 pass.
  • Negative control: with the mode reverted the test fails (EACCES), so the regression is genuinely covered.

No other files changed. pi_bin()/plan_pi() logic, other bench arms, and #187/#203 untouched. Produced by openswarm intake (ticket tkt-d3a96be948f3, run 20261116-140430-2be5aa, M29 slice 2).

@surlymochan
surlymochan merged commit 28d6416 into main Nov 16, 2026
2 checks passed
@surlymochan
surlymochan deleted the openswarm/20261116-140430-2be5aa branch November 16, 2026 14:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

bench: pi_shim.sh 非可执行,openswarm 臂先导 6 格全部 unroutable(0/6)

1 participant