Skip to content

test(forge): conformance departures carry sc-forge's real refusal texts; gate S and X - #315

Merged
tonibergholm-codento merged 3 commits into
mainfrom
p38-conformance-followups
Oct 25, 2026
Merged

tonibergholm-codento merged 3 commits into
mainfrom
p38-conformance-followups

Conversation

@tonibergholm-codento

@tonibergholm-codento tonibergholm-codento commented Oct 25, 2026 •

Copy link
Copy Markdown
Collaborator

Replaces the placeholder message_contains words (not, auth, merge, state, rename,
branch, password, not found) with the texts sc-forge sends, read off a run against
the in-tree server, so a departure no longer passes on any message containing a
common word. Adds the missing departure for S#13 (a read-only collaborator's tag
push is refused at the advertisement with 403) and adds S and X to the gate:
24/24 scenarios. Ticks the first item of #297.

Summary by CodeRabbit

  • Tests
    • Updated compatibility checks for error responses involving merge conflicts, unsupported merge modes, unknown references, authentication, invalid commit statuses, repository renames, and missing default branches.
    • Added a check confirming that read-only collaborators receive a forbidden response when attempting to push a tag.
    • Expanded the set of cases run during conformance checks.

…ts; gate S and X

Replaces the placeholder message_contains words (not, auth, merge, state, rename,
branch, password, not found) with the texts sc-forge sends, read off a run against
the in-tree server, so a departure no longer passes on any message containing a
common word. Adds the missing departure for S#13 (a read-only collaborator's tag
push is refused at the advertisement with 403) and adds S and X to the gate:
24/24 scenarios. Ticks the first item of #297.
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 25, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-25T07:14:30.045368Z 588a756 New commits
🔒 Security Review ✅ Completed 2026-10-25T07:14:55.981514Z 588a756 New commits
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@coderabbitai

coderabbitai Bot commented Oct 25, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

Important

Review skipped

Review was skipped as selected files did not have any reviewable changes.

Run configuration
  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: adc0f645-8838-4881-87e9-6fcf538d5964
Commits

Reviewing files that changed from the base of the PR and between 4c1b51e and 588a756.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

No actionable comments were generated in the recent review.

Recent review info
Run configuration
  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 239d1179-f513-4e80-a25c-74b921975549
Commits

Reviewing files that changed from the base of the PR and between 28a8269 and cfdd912.

Files selected for processing: 2
  • crates/forge/conformance/departures.json
  • crates/forge/conformance/forge-check.sh

Included review availability: This review used your included allowance. Your plan provides up to 10 included reviews per hour; 8 remain after this review.

Walkthrough

The conformance expectations now match more specific sc-forge error messages. The changes also add a read-only collaborator tag-push case and include scenarios S and X in the conformance check selection.

Changes: Forge conformance expectations

Layer / File(s) Summary
Merge and pull-request refusal expectations
crates/forge/conformance/departures.json
Merge conflict, unsupported merge mode, and already-merged pull-request expectations use more specific messages.
Status, ref, and repository error expectations
crates/forge/conformance/departures.json
Status, ref, and repository expectations use more specific target, branch, and repository error messages.
Authentication and API route expectations
crates/forge/conformance/departures.json
Token-route and API authentication expectations specify refusal messages. Team-route expectations use the “no such api route” wording.
Tag-push case and conformance selection
crates/forge/conformance/departures.json, crates/forge/conformance/forge-check.sh
A read-only collaborator tag-push case expects a forbidden response. The check script adds scenarios S and X to its selection.

Priority: Low

Estimated code review effort: 2 (Simple) | ~10 minutes

Change: Other

Possibly related issues

Possibly related PRs

Merge Risk: Minimal · up to cfdd9

The conformance updates are consistent with the server behavior and add the intended scenario coverage without an established merge-blocking risk.

Architecture risk: Low · up to cfdd9

The change affects 1 system.

Changed systems: crates

Architecture concerns
No architecture-level concerns identified.

Review details

Systems and components

  • observed — crates (service) was modified; 2 changed files map to changed impact.

Before / after behavior

  • observed — Modified behavior in crates/forge/conformance/departures.json: The merge-conflict message expectation now matches “merge conflict” instead of the broader “conflict.”
  • observed — Modified behavior in crates/forge/conformance/departures.json: The unsupported merge-mode expectation now matches “only do=merge is supported” instead of “merge.”
  • observed — Modified behavior in crates/forge/conformance/departures.json: The unsupported rebase-mode expectation now matches “only do=merge is supported” instead of “merge.”
  • observed — Modified behavior in crates/forge/conformance/departures.json: The unsupported rebase-merge expectation now matches “only do=merge is supported” instead of “merge.”
Pre-merge checks: Passed 5
Check name Status Explanation
Description Check Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check Passed The title clearly summarizes both main changes: updating conformance departures with sc-forge refusal texts and adding scenarios S and X to the gate.
Docstring Coverage Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 1…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Full details: Docstring Coverage

Explanation

No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 1 files. (1 skipped: 1 unsupported.)

Finishing Touches
📝 Generate docstrings
  • Commit to this branch
  • Create a new PR
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

@tonibergholm tonibergholm left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Gate 24/24; Codex and CodeRabbit clean.

@tonibergholm-codento
tonibergholm-codento merged commit 4cda9b3 into main Oct 25, 2026
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants