Repository navigation
BLOCKER: Strix full self-test baseline diverges after b50e4f7 #571
Copy link
Copy link
Open
Labels
area: apiAPI, protocol, event, or external contractAPI, protocol, event, or external contractarea: authAuthentication, authorization, identity, or tenant isolationAuthentication, authorization, identity, or tenant isolationarea: performancePerformance, resource use, scalability, or benchmarkingPerformance, resource use, scalability, or benchmarkingbugSomething isn't workingSomething isn't workingpriority: criticalImmediate blocker, P0, urgent deadlock, or critical incidentImmediate blocker, P0, urgent deadlock, or critical incidentstatus: triagedOpen issue has an organization taxonomy assignmentOpen issue has an organization taxonomy assignmenttype: bugDefect or incorrect behaviorDefect or incorrect behaviortype: featureNew or expanded product capabilityNew or expanded product capability
Description
증거\n\nA full local run of scripts/ci/test_strix_quick_gate.sh from main commit dd078cc plus only the executable-permission fix ran for about 58 minutes and exposed pre-existing baseline divergences introduced by or visible after b50e4f7. It then ended 137 under memory pressure.\n\nObserved independent failures:\n\n- nonrecoverable expected the generic non-recoverable message, while the gate selected the stricter provider infrastructure or failure-signal branch.\n- provider-prefix-required-resource-path-primary-explicit-empty-default-provider still expects implicit vertex_ai normalization, while current policy rejects resource paths without an explicit Vertex provider.\n- two unchanged-file baseline scenarios expect a later successful fallback to continue, while the new success-with-threshold-report check fails before PR changed-file baseline attribution can permit continuation.\n- vertex-primary-hallucinated-endpoint-fallback-success expects a generic terminal message, while current PR attribution fails closed earlier.\n\n## 범위 경계\n\nThis blocker is separate from #569. Do not weaken executable integrity to resolve it. Reconcile the intended policy order and update both implementation and scenario expectations together.\n\n## 완료 기준\n\n- Each failing scenario is reproducible through STRIX_TEST_CASE_FILTER.\n- Policy precedence for successful process plus threshold report versus unchanged-file PR baseline is explicit.\n- The full self-test completes without baseline assertion failures or resource exhaustion.\n\nAgent: Codex\nRecorded: 2026-07-17T01:42:15+09:00\nPhase: Ops
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
area: apiAPI, protocol, event, or external contractAPI, protocol, event, or external contractarea: authAuthentication, authorization, identity, or tenant isolationAuthentication, authorization, identity, or tenant isolationarea: performancePerformance, resource use, scalability, or benchmarkingPerformance, resource use, scalability, or benchmarkingbugSomething isn't workingSomething isn't workingpriority: criticalImmediate blocker, P0, urgent deadlock, or critical incidentImmediate blocker, P0, urgent deadlock, or critical incidentstatus: triagedOpen issue has an organization taxonomy assignmentOpen issue has an organization taxonomy assignmenttype: bugDefect or incorrect behaviorDefect or incorrect behaviortype: featureNew or expanded product capabilityNew or expanded product capability
Type
Projects
- StatusShow more project fieldsIn Progress
Activity
seonghobae commentedon Aug 25, 2026
Codex pickup (2026-08-25 10:22 +0900): current central
maincommita724582changed Strix fallback models fromgpt-5.6-lunatogpt-5.4in.github/workflows/strix.yml, butscripts/ci/strix_required_workflow_smoke.shstill asserts the retiredgpt-5.6-lunacontract. This exact smoke mismatch fails every consumer Strix check (observed on ContextualWisdomLab/disksage#247 exact heada9c868a6e9c8d68a9c6ea6de381e188740b8f5db). I am reconciling the workflow/smoke contract with a focused test before considering the blocker resolved.seonghobae commentedon Aug 25, 2026
Clarification (2026-08-25): PR #1316 tracks the separate trusted-smoke/model-contract mismatch in new issue #1317. This issue #571 remains scoped to the independent full self-test baseline divergences and is not being closed by that PR.
seonghobae commentedon Sep 26, 2026
Fresh protected-branch reproduction (2026-09-27 evidence): a clean detached worktree at protected
main@e6334e229581a918e2f22de18733b76fa65d7e71ranscripts/ci/test_strix_quick_gate.shand failed immediately because the self-test still requiresTARGET_REPOSITORY: ${{ needs.validate-pr-metadata.outputs.target_repository }}, which the current OpenCode workflow no longer contains. The 12-second bounded probe exited 124 only because the monolithic suite kept running after recording the failure.A longer run on the #2382/#2385 convergence tree reproduced the same inherited assertion and then many fixture failures where temporary repositories omit
scripts/ci/strix_evidence_binding.py; the gate exits 2 before scenario-specific expectations. The same first failure on protected main proves this is not introduced by either PR's delta.No expectation was weakened and no leaf workaround was added. This remains a canonical
.githubbaseline defect: update the self-test fixtures and asserted workflow shape together with the intended trust boundary, then require the full script to finish GREEN without resource exhaustion.