Skip to content

Measure NFR-1 against hono - #37

Merged
ARCoder181105 merged 1 commit into
mainfrom
benchmark
Aug 30, 2026
Merged

Measure NFR-1 against hono#37
ARCoder181105 merged 1 commit into
mainfrom
benchmark

Conversation

@ARCoder181105

Copy link
Copy Markdown
Owner

No description provided.

Three of the four targets pass with 20-50x of headroom: 358 files cloned,
parsed, resolved and written in 3.9s against a 90s budget;
functions-for-file p95 3.1ms against 150ms; a 5-hop traversal 4.4ms p95,
9.1ms worst case, against 500ms.

The fourth could not be tested at its stated scale. Opening and expanding
every function in hono's largest file produces 210 nodes, and nothing on
this repository approaches the 2,000-node ceiling. What was measured at 210
nodes is recorded rather than extrapolated.

Two traps found by running it, both recorded so the next person does not
lose an hour to them. The parser's summary counts call sites and the
database stores deduplicated edges, so 37,116 against 5,292 is not a
discrepancy. And the API rate-limits at 100 requests a minute, which the
first latency run silently measured instead of the API -- 429s are fast.
That second one is R40: it also means a restored canvas with many open
branches can spend the budget on one load.
@coderabbitai

coderabbitai Bot commented Aug 30, 2026

Copy link
Copy Markdown

Warning

Review limit reached

Next included review available in 33 minutes.

View limit details

Limit details: You’ve used the included review currently available.

Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available.
You're only billed for reviews past your plan's rate limits ($0.25/file).

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Free

Run ID: 7e744bbc-2597-4669-8455-3dd132bbc0aa

📥 Commits

Reviewing files that changed from the base of the PR and between 7c801bc and ce700c8.

📒 Files selected for processing (4)
  • PLAN.md
  • PRD.md
  • README.md
  • docs/RISKS.md

Note

🎁 Summarized by CodeRabbit Free

Your organization is on the Free plan. CodeRabbit will generate a high-level summary and a walkthrough for each pull request. For a comprehensive line-by-line review, please upgrade your subscription to CodeRabbit Pro by visiting https://app.coderabbit.ai/settings/billing.

Comment @coderabbitai help to get the list of available commands.

@ARCoder181105
ARCoder181105 merged commit 420ed36 into main Aug 30, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant