Skip to content

feat: add deterministic request routing rules - #15

Merged
phaedrus-on-git merged 1 commit into
devrail-dev:mainfrom
phaedrus-on-git:feat/request-model-routing
Sep 16, 2026
Merged

feat: add deterministic request routing rules#15
phaedrus-on-git merged 1 commit into
devrail-dev:mainfrom
phaedrus-on-git:feat/request-model-routing

Conversation

@phaedrus-on-git

@phaedrus-on-git phaedrus-on-git commented Sep 16, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • add per-alias ordered request routing rules for prompt size, requested output size, and keywords
  • expose max_output_tokens/tool_call in model cards and clamp oversized max_tokens when routing to a configured target alias
  • document request routing and add config/server tests

Validation

  • go test ./...
  • make check

@phaedrus-on-git
phaedrus-on-git merged commit 40bdbcb into devrail-dev:main Sep 16, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@phaedrus-on-git