Skip to content

fix(review): prevent empty deep reviews - #40

Merged
luckyPipewrench merged 2 commits into
mainfrom
fix/deep-review-contract
Aug 8, 2026
Merged

luckyPipewrench merged 2 commits into
mainfrom
fix/deep-review-contract

Conversation

@luckyPipewrench

@luckyPipewrench luckyPipewrench commented Aug 8, 2026

Copy link
Copy Markdown
Owner

Deep reviews use xhigh reasoning, but the existing 25,000-token shared ceiling can be consumed entirely by reasoning, leaving no visible review. Raise the shared ceiling to 64,000 and pin the deep reasoning settings in the runner tests. Default reviews are unchanged.

Summary by CodeRabbit

  • Enhancements
    • Deep reviews can now generate more comprehensive responses with a larger output limit.
    • Improved reasoning quality for deep review results.

@coderabbitai

coderabbitai Bot commented Aug 8, 2026

Copy link
Copy Markdown

Review Change Stack

Warning

Review limit reached

@luckyPipewrench, you've reached your PR review limit, so we couldn't start this review.

Next review available in: 56 minutes

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: e3c6aad9-0083-4fda-bb71-9477f04eebab

📥 Commits

Reviewing files that changed from the base of the PR and between a2f60ed and af2a2c0.

📒 Files selected for processing (1)
  • tests/test_pr_review_routing.py
📝 Walkthrough

Walkthrough

Deep reviews now allow up to 64,000 completion tokens and use xhigh reasoning effort. Fast-mode settings and timeout values remain unchanged.

Changes

Deep review settings

Layer / File(s) Summary
Update deep review configuration
scripts/pr-review.py
DEEP_MAX_COMPLETION_TOKENS increases from 25000 to 64000. DEEP_REASONING_EFFORT changes from medium to xhigh. Fast-mode settings remain unchanged.

Estimated code review effort: 1 (Trivial) | ~2 minutes

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly describes the purpose of increasing deep-review limits to prevent empty reviews.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch fix/deep-review-contract

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@scripts/pr-review.py`:
- Around line 55-56: Update the expected deep reasoning effort in the deep-mode
routing test in test_pr_review_routing.py to match DEEP_REASONING_EFFORT, which
is now "xhigh", while preserving the existing routing assertions.
🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 8ed9d550-b16b-42ed-b078-8d8685cc618f

📥 Commits

Reviewing files that changed from the base of the PR and between c1f98ea and a2f60ed.

📒 Files selected for processing (1)
  • scripts/pr-review.py

Comment thread scripts/pr-review.py
@luckyPipewrench
luckyPipewrench merged commit afe6127 into main Aug 8, 2026
14 checks passed
@luckyPipewrench
luckyPipewrench deleted the fix/deep-review-contract branch August 8, 2026 03:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant