Skip to content

docs: bring-your-own LLM provider (SDK + CLI) - #4

Merged
irl-dan merged 1 commit into
mainfrom
docs/byo-llm-provider
Jun 3, 2026
Merged

docs: bring-your-own LLM provider (SDK + CLI)#4
irl-dan merged 1 commit into
mainfrom
docs/byo-llm-provider

Conversation

@irl-dan

@irl-dan irl-dan commented Jun 3, 2026

Copy link
Copy Markdown
Contributor

Documents how to point Reactor at a non-OpenRouter LLM provider.

SDK (sdk/agents.mdx)

New "Bring your own LLM provider" section: build a scoped OpenAIProvider from @openai/agents and pass it as render.provider + compile.options.provider. Covers OpenAI / Anthropic / Google with a base-URL/key/model table and the useResponses: false note.

CLI (cli/configuration.mdx)

Documents model.provider / model.base_url / model.api_key_env in reactor.yml, a built-in provider table (openrouter/openai/anthropic/google), generalized env-var guidance, and the non-zero-exit-on-missing-key behavior.

Known limitation (documented in both)

Anthropic's direct OpenAI-compat endpoint rejects our structured-output response_format unless strict: true (400 response_format.json_schema.strict). OpenAI, Google, and every model via OpenRouter work. Guidance: route Anthropic models through OpenRouter today.

cspell

Allow Gemini / OpenAI / OpenRouter.

Verified locally under Node 22: pnpm spell and pnpm check:emdash both clean.

Document how to point Reactor at a non-OpenRouter LLM:

- SDK: a "Bring your own LLM provider" section showing native @openai/agents
  OpenAIProvider config for OpenAI / Anthropic / Google, passed as
  render.provider + compile.options.provider (sdk/agents.mdx).
- CLI: model.provider / base_url / api_key_env in reactor.yml, a built-in
  provider table, and generalized env-var guidance (cli/configuration.mdx).
- Note the Anthropic-direct structured-output limitation (route Anthropic
  models through OpenRouter today) in both pages.
- cspell: allow Gemini / OpenAI / OpenRouter.
@irl-dan
irl-dan merged commit 30b3b47 into main Jun 3, 2026
4 checks passed
@irl-dan
irl-dan deleted the docs/byo-llm-provider branch June 3, 2026 06:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant