Skip to content

chore: sync new models#918

Closed
github-actions[bot] wants to merge 0 commit into
mainfrom
chore/sync-new-models
Closed

chore: sync new models#918
github-actions[bot] wants to merge 0 commit into
mainfrom
chore/sync-new-models

Conversation

@github-actions

@github-actions github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

Automated sync of model metadata and newly available models from the approved provider allowlist.

@vercel

vercel Bot commented Jul 6, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
ai-proxy Ready Ready Preview, Comment Jul 6, 2026 12:22pm

Request Review

@github-actions

github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown
Contributor Author

Codex (@codex) review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 2a406a57c4

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "Codex (@codex) address that feedback".

Comment thread packages/proxy/schema/model_list.json Outdated
"displayName": "GPT-5.4 mini",
"reasoning": true,
"max_input_tokens": 400000,
"max_input_tokens": 272000,

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Restore GPT-5.4 mini/nano context limits

OpenAI's GPT-5.4 mini and nano docs list a 400,000-token context window with a separate 128,000 max-output limit (https://developers.openai.com/api/docs/models/gpt-5.4-mini, https://developers.openai.com/api/docs/models/gpt-5.4-nano), and this catalog stores the context window in max_input_tokens for sibling models like gpt-5.4/gpt-5.5 rather than subtracting output tokens. Setting the aliases to 272,000 under-advertises the supported input window, so consumers of the published schema can reject or avoid valid prompts between 272k and 400k tokens; the same 272k replacement should be reverted for the snapshot and nano alias changed in this commit.

Useful? React with 👍 / 👎.

Comment thread packages/proxy/schema/model_list.json Outdated
],
"max_input_tokens": 1000000,
"max_output_tokens": 128000,
"max_output_tokens": 64000,

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Keep Claude Sonnet 4.6 at 128k output

Anthropic documents Claude Sonnet 4.6 as supporting up to 128k output tokens (https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking), and the Bedrock/Vertex aliases in this same catalog still advertise 128000. Lowering only the direct Anthropic entry to 64000 makes schema consumers think 128k is unsupported and also causes openaiParamsToAnthropicMesssageParams to default omitted max_tokens requests to 64k for this model, truncating workloads that relied on the documented 128k limit.

Useful? React with 👍 / 👎.

Comment thread packages/proxy/schema/model_list.json Outdated
"input_cost_per_mil_tokens": 1.4,
"output_cost_per_mil_tokens": 4.4,
"input_cache_read_cost_per_mil_tokens": 0.14,
"input_cache_read_cost_per_mil_tokens": 0.26,

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Preserve Fireworks GLM 5.2 cache pricing

This entry is the Fireworks-specific accounts/fireworks/models/glm-5p2 model, but Fireworks' pricing page lists GLM 5.2 Standard at $1.40 input / $0.14 cached input / $4.40 output per 1M tokens (https://docs.fireworks.ai/serverless/pricing). Changing cached-input pricing to 0.26 overstates cache-read cost for Fireworks traffic and makes downstream cost estimates or billing displays wrong for cached prompts.

Useful? React with 👍 / 👎.

@github-actions

github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown
Contributor Author

Codex Review Response for PR #918

All three Codex findings were valid. The automated sync introduced five regressions that have been reverted in packages/proxy/schema/model_list.json:

Changes Made

1. Restored GPT-5.4 mini/nano max_input_tokens to 400000 (3 entries)

  • gpt-5.4-mini-2026-03-17: 272000 -> 400000
  • gpt-5.4-mini: 272000 -> 400000
  • gpt-5.4-nano: 272000 -> 400000

The sync incorrectly set max_input_tokens to 272000 (400k context minus 128k output). This catalog uses max_input_tokens to represent the full context window, consistent with the parent gpt-5.4 model which has max_input_tokens: 1050000.

2. Restored Claude Sonnet 4.6 max_output_tokens to 128000

  • claude-sonnet-4-6: 64000 -> 128000

The sync lowered only the direct Anthropic entry to 64000, creating an inconsistency with all Bedrock/Vertex aliases (anthropic.claude-sonnet-4-6, us.anthropic.claude-sonnet-4-6, global.anthropic.claude-sonnet-4-6, publishers/anthropic/models/claude-sonnet-4-6) which all correctly advertise 128000.

3. Restored Fireworks GLM 5.2 cached input pricing to 0.14

  • accounts/fireworks/models/glm-5p2: 0.26 -> 0.14

The sync changed the cached input price from the correct $0.14/M (10% of $1.40 input price) to $0.26/M. The $0.14 value matches Fireworks' published pricing.

Files Modified

  • packages/proxy/schema/model_list.json (5 line changes, all reversions to pre-sync values)

@github-actions github-actions Bot closed this Jul 6, 2026
@github-actions github-actions Bot force-pushed the chore/sync-new-models branch from 2a406a5 to 3b044f4 Compare July 6, 2026 12:31
@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. 🎉

Reviewed commit: 3b044f405d

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "Codex (@codex) address that feedback".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants