Skip to content

Bound and measure provider requests during generation - #328

Merged
Ankit6149 merged 8 commits into
masterfrom
feat/connector-truth-batch
Sep 25, 2026
Merged

Ankit6149 merged 8 commits into
masterfrom
feat/connector-truth-batch

Conversation

@Ankit6149

Copy link
Copy Markdown
Owner

Advances #27 and #34 with one shared generation execution budget.

Implemented:

  • hard server ceiling of 40 provider calls per campaign execution
  • worst-case planning before provider spend: strategy + initial destination + quality revision + duplicate repair
  • full 12-destination campaign remains supported at a worst-case plan of 37 calls
  • callers cannot raise the hard ceiling above 40
  • every provider call is accounted centrally before adapter invocation
  • request telemetry records provider/model, request kind, destination, max output-token ceiling, status and duration without prompts/source content
  • campaign response/package expose planned vs actual request execution
  • repair/revision requests are counted separately
  • stable safe request-budget failure with reduce-destinations recovery guidance
  • regression tests pin ceiling, preflight ordering, accounting, privacy, duration and 12-destination capacity

Still open:

@vercel

vercel Bot commented Sep 25, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment
Project Deployment Actions Updated
signal-flow-studio Ignored Ignored Preview Sep 25, 2026 11:20am UTC

@Ankit6149
Ankit6149 merged commit 6304544 into master Sep 25, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant