From 56af0e4bac4084773bf54c41e7f2faf64eea6af5 Mon Sep 17 00:00:00 2001 From: Jason Carter Date: Fri, 2 Oct 2026 21:12:20 +0800 Subject: [PATCH 1/2] docs: RELEASELOG 0.11.0-rc.0 --- RELEASELOG.md | 43 +++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 43 insertions(+) diff --git a/RELEASELOG.md b/RELEASELOG.md index 4b8177cf..763e1c68 100644 --- a/RELEASELOG.md +++ b/RELEASELOG.md @@ -1,5 +1,48 @@ # Release Log +## v0.11.0-rc.0 + +**候选发布（RC）**——自 `v0.10.1` 起的首个候选版。本版主题是 **Agent 自愈 / 自我管理机制的重构** 与 **Team Chat 流式交互可靠性**，包含一次架构级重构（存活仲裁、记忆与认知机制）和多项 P0 稳定性修复。 + +### Bug Fixes + +- **心跳风暴根治（A/B/C）** — 单个 Agent 曾出现单日 600+ 次心跳的循环。根因：兜底器在「心跳暂时新鲜」时提前释放重试状态、`lastHeartbeat` 从未落库、心跳能力被错误放开。修复：心跳只在**状态或队列真正变化**时才触发巡检（纯时间戳 skip）、`lastHeartbeat` 随每次心跳落库、心跳路径统一收口。 +- **shell 工具超时失效根治** — 设 120s 超时但到点后命令仍在跑。实为三层叠加缺陷：超时定时器只 resolve Promise 而**从不终止进程**；进程组判定在 spawn 后用 `ps` 竞态探测而失败，退化成「只杀 wrapper」；`bash -i` 的 job control 让工作进程逃出会话进程组。修复：超时后按**负 PID 做权威进程组 kill**、会话启动关闭 monitor mode（`set +m`），超时真正终止整棵进程树。 +- **后台执行子孙进程泄漏** — 自我守护型命令（`sh -c 'cmd & exit 0'`）的子孙在 wrapper 退出后被漏杀。修复：`isolatedGroup` 改由 spawn 契约（`detached` ⇒ `setsid` ⇒ `pgid === pid`）决定，不再用 `ps` 反推。 +- **并发实体锁粒度修正** — 设了 5 并发却仍在排队：邮箱实体亲和锁把同一需求下的所有任务连坐串行。修复：实体锁去掉 `requirement` 维度，同需求多任务可并行。 +- **任务被 cancelled 后停滞** — 外部取消后任务既不恢复也不收尾，永久卡在 in_progress。修复：补 `cancelled` 分支，视同可恢复中断延后重放。 +- **Agent 终态语义修正** — 此前「卡死自愈」「超时孤儿」「一次取消」「重试耗尽」都被错标为 completed（绿点），既假装成功又抑制补偿重投。修复：**只有明确正常完成才 completed**，异常一律 dropped（异常可见 + 允许重投）。 +- **会话上下文压缩失效（P0）** — 长会话被内存 LRU 逐出后调用 compact 返回假成功（`flushedCount:0`），下一轮仍超限并被硬裁剪腰斩任务。修复：`compactSession` 补磁盘回退，并区分「未找到 / 无需压缩 / 已压缩」。 +- **Team Chat 流式断连误判为回合结束** — 浏览器断流后气泡被当成「答完了」而收起，需手动刷新才看到仍在输出。修复：仅收到终止事件才算回合结束，断线自动重连并在**同一气泡**续写、拉取权威快照。 +- **Team Chat 重复气泡** — 同一条回复渲染出两个气泡（前端本地 id 与服务端持久化 id 不一致）。修复：流结束后把气泡 id 对齐服务端 `messageId`。 +- **流式「输出中」无反馈** — LLM 首 token 未返回的空窗期气泡看起来像卡死。修复：只要仍在流式且是最后一块就持续显示活动反馈，输出完成自动收束。 +- **Agent 头像 / 头衔编辑、回调会话路由修复、消息气泡折叠与 i18n 回退** 等 UI 修复。 + +### Features + +- **Agent 自我管理机制（P0/P1）** — 修复「工具声明了却激活不了」的深层缺陷（`schedule_wakeup` / `set_heartbeat_interval` 等 schema 注入型工具激活即失败）；新增 `memory_stats` / `memory_organize`，让 Agent 能主动整理记忆；并发分身之间共享工作记忆，不再互相失明。 +- **Agent 记忆与认知机制彻底重构** — 单一写入者（禁止直接改写记忆文件，拒绝并引导改用记忆工具）、超预算**无损归档**（不再截断、不再拒绝写入）、预算单位统一为字符、损坏自愈先备份、摘要改为追加式多代锚点、观察与压缩碎片分池、`## Your Knowledge` 顶部新增**记忆健康横幅**、`knowledge_*` 重命名为 `kb_*` 去歧、notebook 工具归一、旧数据**迁移读取层**（读旧格式、只写新格式）。 + +### Refactor + +- **存活机制重新设计** — 以 **Conservator 统一存活仲裁**取代三套互相打架的兜底器；**删除** `agent-dirty` / `agent-stall` / `agent-dirty-reconciler` 三个旧模块及全部对应测试。 +- **状态机收敛** — 全部状态写入收敛到单一派生函数 `transitionStatus`（error 粘性、并行不覆盖、聚合守卫、force/reset 语义集中）。 +- **移除认知准备管道（CPP）** — 删除 `cognitive.ts` 的多阶段 LLM 管线，改为确定性情境装配；深层召回交给 Agent 主动检索（更快、更省）。 + +### Docs + +- 9 篇机制文档对齐（`MEMORY-SYSTEM` / `COGNITIVE-ARCHITECTURE` / `STATE-MACHINES` / `MAILBOX-SYSTEM` / `CONCURRENT-PROCESSING` / `PROMPT-ENGINEERING` / `AGENT-RUNTIME` / `ARCHITECTURE` / `GUIDE`）；新增 3 篇设计文档（记忆与认知重构、自我管理、存活机制），历史叙述中的旧名保留并标注「removed」便于追溯。 + +### Tests + +- 新增回归：状态机收敛、心跳存活、记忆健康 / 迁移 / 观察顺序 / 整理工具、写入门禁、schema 工具激活、shell 超时终止进程树、后台执行子孙回收、Team Chat 重连等。**删除**被新架构取代的旧测试（`cognitive*.test.ts`、`agent-dirty*` / `agent-stall` 测试）。 + +### Stats + +- 自 `v0.10.1`：19 个提交（PR #331 / #332 / #333），113 files changed, 6232 insertions(+), 2985 deletions(-)；净删除旧兜底模块 3 个、认知管道 1 个。 + +--- + ## v0.10.1 **正式版发布**——从 `v0.10.1-rc.0` 候选版提升为稳定版。rc.0 的全部内容见下方条目；候选期后追加一项修复： From 743da41662109a712cc619743906f4bbb8873e36 Mon Sep 17 00:00:00 2001 From: Jason Carter Date: Fri, 2 Oct 2026 21:12:40 +0800 Subject: [PATCH 2/2] =?UTF-8?q?release=20v0.11.0-rc.0:=20feat:=200.11.0-rc?= =?UTF-8?q?.0=20=E2=80=94=20=E5=AD=98=E6=B4=BB=E4=BB=B2=E8=A3=81=E9=87=8D?= =?UTF-8?q?=E6=9E=84=20+=20=E8=AE=B0=E5=BF=86/=E8=AE=A4=E7=9F=A5=E6=9C=BA?= =?UTF-8?q?=E5=88=B6=E9=87=8D=E6=9E=84=20+=20Team=20Chat=20=E6=B5=81?= =?UTF-8?q?=E5=BC=8F=E5=8F=AF=E9=9D=A0=E6=80=A7=20+=20=E5=A4=9A=E9=A1=B9?= =?UTF-8?q?=20P0=20=E4=BF=AE=E5=A4=8D?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- package.json | 2 +- packages/a2a/package.json | 2 +- packages/chrome-extension/package.json | 2 +- packages/cli/package.json | 2 +- packages/comms/package.json | 2 +- .../core/data/model-catalog-baseline.json | 56405 +++++++++------- packages/core/package.json | 2 +- packages/desktop/package.json | 2 +- packages/gui/package.json | 2 +- packages/org-manager/package.json | 2 +- packages/remote/package.json | 2 +- packages/shared/package.json | 2 +- packages/storage/package.json | 2 +- packages/web-ui/package.json | 2 +- 14 files changed, 30361 insertions(+), 26070 deletions(-) diff --git a/package.json b/package.json index 72f6f0e1..441fc1a7 100644 --- a/package.json +++ b/package.json @@ -68,5 +68,5 @@ "node-pty" ] }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/a2a/package.json b/packages/a2a/package.json index 50537710..0ab01ab4 100644 --- a/packages/a2a/package.json +++ b/packages/a2a/package.json @@ -13,5 +13,5 @@ "dependencies": { "@markus/shared": "workspace:*" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/chrome-extension/package.json b/packages/chrome-extension/package.json index 977d7ad8..893d3640 100644 --- a/packages/chrome-extension/package.json +++ b/packages/chrome-extension/package.json @@ -13,5 +13,5 @@ "esbuild": "^0.25.0", "typescript": "^5.6.0" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/cli/package.json b/packages/cli/package.json index c3e797b9..a5b9af9e 100644 --- a/packages/cli/package.json +++ b/packages/cli/package.json @@ -48,5 +48,5 @@ "commander": "^14.0.3", "esbuild": "^0.27.4" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/comms/package.json b/packages/comms/package.json index 4ba8eaa1..a5c7af46 100644 --- a/packages/comms/package.json +++ b/packages/comms/package.json @@ -13,5 +13,5 @@ "dependencies": { "@markus/shared": "workspace:*" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/core/data/model-catalog-baseline.json b/packages/core/data/model-catalog-baseline.json index 4d92825b..3b9956ad 100644 --- a/packages/core/data/model-catalog-baseline.json +++ b/packages/core/data/model-catalog-baseline.json @@ -53,13 +53,6 @@ "mode": "image_generation", "output_cost_per_image": 0.04 }, - "1024-x-1024/dall-e-2": { - "deprecation_date": "2026-05-12", - "input_cost_per_pixel": 1.9e-08, - "litellm_provider": "openai", - "mode": "image_generation", - "output_cost_per_pixel": 0.0 - }, "1024-x-1024/max-steps/stability.stable-diffusion-xl-v1": { "litellm_provider": "bedrock", "max_input_tokens": 77, @@ -67,13 +60,6 @@ "mode": "image_generation", "output_cost_per_image": 0.08 }, - "256-x-256/dall-e-2": { - "deprecation_date": "2026-05-12", - "input_cost_per_pixel": 2.4414e-07, - "litellm_provider": "openai", - "mode": "image_generation", - "output_cost_per_pixel": 0.0 - }, "512-x-512/50-steps/stability.stable-diffusion-xl-v0": { "litellm_provider": "bedrock", "max_input_tokens": 77, @@ -81,13 +67,6 @@ "mode": "image_generation", "output_cost_per_image": 0.018 }, - "512-x-512/dall-e-2": { - "deprecation_date": "2026-05-12", - "input_cost_per_pixel": 6.86e-08, - "litellm_provider": "openai", - "mode": "image_generation", - "output_cost_per_pixel": 0.0 - }, "512-x-512/max-steps/stability.stable-diffusion-xl-v0": { "litellm_provider": "bedrock", "max_input_tokens": 77, @@ -102,7 +81,8 @@ "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_token": 1.25e-05 + "output_cost_per_token": 1.25e-05, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "ai21.j2-ultra-v1": { "input_cost_per_token": 1.88e-05, @@ -111,7 +91,8 @@ "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_token": 1.88e-05 + "output_cost_per_token": 1.88e-05, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "ai21.jamba-1-5-large-v1:0": { "deprecation_date": "2026-11-26", @@ -121,7 +102,8 @@ "max_output_tokens": 256000, "max_tokens": 256000, "mode": "chat", - "output_cost_per_token": 8e-06 + "output_cost_per_token": 8e-06, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "ai21.jamba-1-5-mini-v1:0": { "deprecation_date": "2026-11-26", @@ -131,7 +113,8 @@ "max_output_tokens": 256000, "max_tokens": 256000, "mode": "chat", - "output_cost_per_token": 4e-07 + "output_cost_per_token": 4e-07, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "ai21.jamba-instruct-v1:0": { "input_cost_per_token": 5e-07, @@ -141,6 +124,7 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 7e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_system_messages": true }, "aiml/dall-e-2": { @@ -316,6 +300,7 @@ "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 1e-05, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_pdf_input": true }, @@ -327,6 +312,7 @@ "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 6e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_pdf_input": true }, @@ -338,6 +324,7 @@ "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 1e-05, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_pdf_input": true }, @@ -349,6 +336,7 @@ "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 6e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_pdf_input": true }, @@ -360,7 +348,7 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 6e-07, - "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-writer-palmyra-vision-7b.html", + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_vision": true }, "amazon.nova-lite-v1:0": { @@ -578,17 +566,6 @@ "supports_vision": true, "supports_tool_choice": true }, - "amazon.nova-sonic-v1:0": { - "deprecation_date": "2026-09-14", - "input_cost_per_audio_token": 3.4e-06, - "input_cost_per_token": 6e-08, - "litellm_provider": "bedrock", - "mode": "realtime", - "output_cost_per_audio_token": 1.36e-05, - "output_cost_per_token": 2.4e-07, - "supports_audio_input": true, - "supports_audio_output": true - }, "amazon.nova-2-sonic-v1:0": { "input_cost_per_audio_token": 3e-06, "input_cost_per_token": 3.3e-07, @@ -846,7 +823,7 @@ "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 5e-06, - "source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock", + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json", "supports_assistant_prefill": true, "supports_computer_use": true, "supports_function_calling": true, @@ -972,23 +949,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "anthropic.claude-3-haiku-20240307-v1:0": { - "deprecation_date": "2026-09-10", - "input_cost_per_token": 2.5e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.25e-06, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 2.5e-08, - "cache_creation_input_token_cost": 3.125e-07 - }, "anthropic.claude-3-opus-20240229-v1:0": { "input_cost_per_token": 1.5e-05, "litellm_provider": "bedrock", @@ -1004,23 +964,6 @@ "cache_read_input_token_cost": 1.5e-06, "cache_creation_input_token_cost": 1.875e-05 }, - "anthropic.claude-3-sonnet-20240229-v1:0": { - "deprecation_date": "2026-07-30", - "input_cost_per_token": 3e-06, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 3e-07, - "cache_creation_input_token_cost": 3.75e-06 - }, "anthropic.claude-instant-v1": { "input_cost_per_token": 8e-07, "litellm_provider": "bedrock", @@ -1114,7 +1057,8 @@ "supports_output_config": true, "bedrock_output_config_effort_ceiling": "high", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, "anthropic.claude-opus-4-6-v1": { "supports_adaptive_thinking": true, @@ -1149,7 +1093,8 @@ "supports_max_reasoning_effort": true, "bedrock_output_config_effort_ceiling": "max", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, "global.anthropic.claude-opus-4-6-v1": { "supports_adaptive_thinking": true, @@ -1184,7 +1129,8 @@ "supports_max_reasoning_effort": true, "bedrock_output_config_effort_ceiling": "max", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us.anthropic.claude-opus-4-6-v1": { "supports_adaptive_thinking": true, @@ -1219,7 +1165,8 @@ "supports_max_reasoning_effort": true, "bedrock_output_config_effort_ceiling": "max", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "eu.anthropic.claude-opus-4-6-v1": { "supports_adaptive_thinking": true, @@ -1254,7 +1201,8 @@ "supports_max_reasoning_effort": true, "bedrock_output_config_effort_ceiling": "max", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "au.anthropic.claude-opus-4-6-v1": { "supports_adaptive_thinking": true, @@ -1289,7 +1237,8 @@ "supports_max_reasoning_effort": true, "bedrock_output_config_effort_ceiling": "max", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "anthropic.claude-opus-4-7": { "bedrock_converse_supports_strict_tools": false, @@ -1321,7 +1270,7 @@ "supports_tool_choice": true, "supports_vision": true, "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, + "supports_native_structured_output": false, "supports_max_reasoning_effort": true, "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", @@ -1330,8 +1279,11 @@ "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, "anthropic.claude-mythos-preview": { - "input_cost_per_token": 0, - "output_cost_per_token": 0, + "cache_creation_input_token_cost": 3.4375e-05, + "cache_creation_input_token_cost_above_1hr": 5.5e-05, + "cache_read_input_token_cost": 2.75e-06, + "input_cost_per_token": 2.75e-05, + "output_cost_per_token": 0.0001375, "litellm_provider": "bedrock", "max_input_tokens": 1000000, "max_output_tokens": 128000, @@ -1340,10 +1292,11 @@ "thinking_always_on": true, "supports_function_calling": true, "supports_vision": true, - "supports_prompt_caching": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_tool_choice": true, - "supports_output_config": true + "supports_output_config": true, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, "global.anthropic.claude-opus-4-7": { "bedrock_converse_supports_strict_tools": false, @@ -1375,13 +1328,13 @@ "supports_tool_choice": true, "supports_vision": true, "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, + "supports_native_structured_output": false, "supports_max_reasoning_effort": true, "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 2048, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us.anthropic.claude-opus-4-7": { "bedrock_converse_supports_strict_tools": false, @@ -1413,13 +1366,13 @@ "supports_tool_choice": true, "supports_vision": true, "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, + "supports_native_structured_output": false, "supports_max_reasoning_effort": true, "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 2048, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, "eu.anthropic.claude-opus-4-7": { "bedrock_converse_supports_strict_tools": false, @@ -1451,12 +1404,13 @@ "supports_tool_choice": true, "supports_vision": true, "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, + "supports_native_structured_output": false, "supports_max_reasoning_effort": true, "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 2048 + "prompt_cache_min_tokens": 2048, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "au.anthropic.claude-opus-4-7": { "bedrock_converse_supports_strict_tools": false, @@ -1488,12 +1442,13 @@ "supports_tool_choice": true, "supports_vision": true, "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, + "supports_native_structured_output": false, "supports_max_reasoning_effort": true, "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 2048 + "prompt_cache_min_tokens": 2048, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "anthropic.claude-fable-5": { "cache_creation_input_token_cost": 1.25e-05, @@ -1608,7 +1563,7 @@ "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 512, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, "global.anthropic.claude-fable-5-1": { "cache_creation_input_token_cost": 1.25e-05, @@ -1647,7 +1602,7 @@ "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 512, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us.anthropic.claude-fable-5": { "cache_creation_input_token_cost": 1.375e-05, @@ -1685,7 +1640,7 @@ "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 512, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us.anthropic.claude-fable-5-1": { "cache_creation_input_token_cost": 1.375e-05, @@ -1724,7 +1679,7 @@ "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 512, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, "eu.anthropic.claude-fable-5": { "cache_creation_input_token_cost": 1.375e-05, @@ -1761,7 +1716,8 @@ "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 512 + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "eu.anthropic.claude-fable-5-1": { "cache_creation_input_token_cost": 1.375e-05, @@ -1839,21 +1795,21 @@ "prompt_cache_min_tokens": 512, "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "global.anthropic.claude-opus-5": { + "anthropic.claude-opus-5-5": { "bedrock_converse_supports_strict_tools": false, "supports_adaptive_thinking": true, "supports_mid_conversation_system": true, - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_1hr": 1e-05, - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 5e-06, + "cache_creation_input_token_cost": 5e-06, + "cache_creation_input_token_cost_above_1hr": 8e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 4e-06, "litellm_provider": "bedrock_converse", "supports_tool_search": true, "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-05, + "output_cost_per_token": 2e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -1875,23 +1831,25 @@ "supports_output_config": true, "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 512, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json", + "thinking_always_on": true, + "supports_forced_tool_use": false }, - "us.anthropic.claude-opus-5": { + "global.anthropic.claude-opus-5": { "bedrock_converse_supports_strict_tools": false, "supports_adaptive_thinking": true, "supports_mid_conversation_system": true, - "cache_creation_input_token_cost": 6.875e-06, - "cache_creation_input_token_cost_above_1hr": 1.1e-05, - "cache_read_input_token_cost": 5.5e-07, - "input_cost_per_token": 5.5e-06, + "cache_creation_input_token_cost": 6.25e-06, + "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token": 5e-06, "litellm_provider": "bedrock_converse", "supports_tool_search": true, "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.75e-05, + "output_cost_per_token": 2.5e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -1913,23 +1871,23 @@ "supports_output_config": true, "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 512, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "eu.anthropic.claude-opus-5": { + "global.anthropic.claude-opus-5-5": { "bedrock_converse_supports_strict_tools": false, "supports_adaptive_thinking": true, "supports_mid_conversation_system": true, - "cache_creation_input_token_cost": 6.875e-06, - "cache_creation_input_token_cost_above_1hr": 1.1e-05, - "cache_read_input_token_cost": 5.5e-07, - "input_cost_per_token": 5.5e-06, + "cache_creation_input_token_cost": 5e-06, + "cache_creation_input_token_cost_above_1hr": 8e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 4e-06, "litellm_provider": "bedrock_converse", "supports_tool_search": true, "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.75e-05, + "output_cost_per_token": 2e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -1950,9 +1908,12 @@ "supports_max_reasoning_effort": true, "supports_output_config": true, "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 512 + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/", + "thinking_always_on": true, + "supports_forced_tool_use": false }, - "au.anthropic.claude-opus-5": { + "us.anthropic.claude-opus-5": { "bedrock_converse_supports_strict_tools": false, "supports_adaptive_thinking": true, "supports_mid_conversation_system": true, @@ -1987,23 +1948,24 @@ "supports_max_reasoning_effort": true, "supports_output_config": true, "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 512 + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "jp.anthropic.claude-opus-5": { + "us.anthropic.claude-opus-5-5": { "bedrock_converse_supports_strict_tools": false, "supports_adaptive_thinking": true, "supports_mid_conversation_system": true, - "cache_creation_input_token_cost": 6.875e-06, - "cache_creation_input_token_cost_above_1hr": 1.1e-05, - "cache_read_input_token_cost": 5.5e-07, - "input_cost_per_token": 5.5e-06, + "cache_creation_input_token_cost": 5.5e-06, + "cache_creation_input_token_cost_above_1hr": 8.8e-06, + "cache_read_input_token_cost": 2.2e-07, + "input_cost_per_token": 4.4e-06, "litellm_provider": "bedrock_converse", "supports_tool_search": true, "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.75e-05, + "output_cost_per_token": 2.2e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -2024,87 +1986,12 @@ "supports_max_reasoning_effort": true, "supports_output_config": true, "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 512 - }, - "anthropic.claude-opus-4-8": { - "bedrock_converse_supports_strict_tools": false, - "supports_adaptive_thinking": true, - "supports_mid_conversation_system": true, - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_1hr": 1e-05, - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 5e-06, - "litellm_provider": "bedrock_converse", - "supports_tool_search": true, - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 2.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": false, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_sampling_params": false, - "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, - "supports_max_reasoning_effort": true, - "supports_output_config": true, - "bedrock_output_config_effort_ceiling": "xhigh", - "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" - }, - "global.anthropic.claude-opus-4-8": { - "bedrock_converse_supports_strict_tools": false, - "supports_adaptive_thinking": true, - "supports_mid_conversation_system": true, - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_1hr": 1e-05, - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 5e-06, - "litellm_provider": "bedrock_converse", - "supports_tool_search": true, - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 2.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": false, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_sampling_params": false, - "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, - "supports_max_reasoning_effort": true, - "supports_output_config": true, - "bedrock_output_config_effort_ceiling": "xhigh", - "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/", + "thinking_always_on": true, + "supports_forced_tool_use": false }, - "us.anthropic.claude-opus-4-8": { + "eu.anthropic.claude-opus-5": { "bedrock_converse_supports_strict_tools": false, "supports_adaptive_thinking": true, "supports_mid_conversation_system": true, @@ -2135,7 +2022,241 @@ "supports_tool_choice": true, "supports_vision": true, "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/" + }, + "eu.anthropic.claude-opus-5-5": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 5.5e-06, + "cache_creation_input_token_cost_above_1hr": 8.8e-06, + "cache_read_input_token_cost": 2.2e-07, + "input_cost_per_token": 4.4e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.2e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "thinking_always_on": true, + "supports_forced_tool_use": false, + "source": "https://aws.amazon.com/bedrock/pricing/" + }, + "au.anthropic.claude-opus-5": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 6.875e-06, + "cache_creation_input_token_cost_above_1hr": 1.1e-05, + "cache_read_input_token_cost": 5.5e-07, + "input_cost_per_token": 5.5e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.75e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/" + }, + "au.anthropic.claude-opus-5-5": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 5.5e-06, + "cache_creation_input_token_cost_above_1hr": 8.8e-06, + "cache_read_input_token_cost": 2.2e-07, + "input_cost_per_token": 4.4e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.2e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "thinking_always_on": true, + "supports_forced_tool_use": false, + "source": "https://aws.amazon.com/bedrock/pricing/" + }, + "jp.anthropic.claude-opus-5": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 6.875e-06, + "cache_creation_input_token_cost_above_1hr": 1.1e-05, + "cache_read_input_token_cost": 5.5e-07, + "input_cost_per_token": 5.5e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.75e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/" + }, + "jp.anthropic.claude-opus-5-5": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 5.5e-06, + "cache_creation_input_token_cost_above_1hr": 8.8e-06, + "cache_read_input_token_cost": 2.2e-07, + "input_cost_per_token": 4.4e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.2e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "thinking_always_on": true, + "supports_forced_tool_use": false, + "source": "https://aws.amazon.com/bedrock/pricing/" + }, + "anthropic.claude-opus-4-8": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 6.25e-06, + "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token": 5e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.5e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, "supports_max_reasoning_effort": true, "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", @@ -2143,6 +2264,84 @@ "prompt_cache_min_tokens": 1024, "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, + "global.anthropic.claude-opus-4-8": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 6.25e-06, + "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token": 5e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.5e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" + }, + "us.anthropic.claude-opus-4-8": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 6.875e-06, + "cache_creation_input_token_cost_above_1hr": 1.1e-05, + "cache_read_input_token_cost": 5.5e-07, + "input_cost_per_token": 5.5e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.75e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" + }, "eu.anthropic.claude-opus-4-8": { "bedrock_converse_supports_strict_tools": false, "supports_adaptive_thinking": true, @@ -2174,12 +2373,13 @@ "supports_tool_choice": true, "supports_vision": true, "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, + "supports_native_structured_output": false, "supports_max_reasoning_effort": true, "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "au.anthropic.claude-opus-4-8": { "bedrock_converse_supports_strict_tools": false, @@ -2212,12 +2412,13 @@ "supports_tool_choice": true, "supports_vision": true, "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, + "supports_native_structured_output": false, "supports_max_reasoning_effort": true, "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "jp.anthropic.claude-opus-4-8": { "bedrock_converse_supports_strict_tools": false, @@ -2250,16 +2451,18 @@ "supports_tool_choice": true, "supports_vision": true, "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, + "supports_native_structured_output": false, "supports_max_reasoning_effort": true, "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "jp.anthropic.claude-opus-4-7": { "bedrock_converse_supports_strict_tools": false, "cache_creation_input_token_cost": 6.875e-06, + "cache_creation_input_token_cost_above_1hr": 1.1e-05, "cache_read_input_token_cost": 5.5e-07, "input_cost_per_token": 5.5e-06, "litellm_provider": "bedrock_converse", @@ -2286,11 +2489,12 @@ "supports_tool_choice": true, "supports_vision": true, "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, + "supports_native_structured_output": false, "supports_max_reasoning_effort": true, "supports_minimal_reasoning_effort": true, "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 2048 + "prompt_cache_min_tokens": 2048, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "anthropic.claude-sonnet-5": { "bedrock_converse_supports_strict_tools": false, @@ -2368,7 +2572,7 @@ "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 1024, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us.anthropic.claude-sonnet-5": { "bedrock_converse_supports_strict_tools": false, @@ -2407,7 +2611,7 @@ "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 1024, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, "eu.anthropic.claude-sonnet-5": { "bedrock_converse_supports_strict_tools": false, @@ -2445,7 +2649,8 @@ "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "au.anthropic.claude-sonnet-5": { "bedrock_converse_supports_strict_tools": false, @@ -2483,7 +2688,8 @@ "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "jp.anthropic.claude-sonnet-5": { "bedrock_converse_supports_strict_tools": false, @@ -2521,7 +2727,8 @@ "supports_output_config": true, "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "anthropic.claude-sonnet-4-6": { "supports_adaptive_thinking": true, @@ -2591,7 +2798,7 @@ "supports_output_config": true, "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 1024, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us.anthropic.claude-sonnet-4-6": { "supports_adaptive_thinking": true, @@ -2626,7 +2833,7 @@ "supports_output_config": true, "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 1024, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, "eu.anthropic.claude-sonnet-4-6": { "supports_adaptive_thinking": true, @@ -2660,7 +2867,8 @@ "supports_native_structured_output": true, "supports_output_config": true, "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "au.anthropic.claude-sonnet-4-6": { "supports_adaptive_thinking": true, @@ -2694,7 +2902,8 @@ "supports_native_structured_output": true, "supports_output_config": true, "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "jp.anthropic.claude-sonnet-4-6": { "supports_adaptive_thinking": true, @@ -2728,7 +2937,8 @@ "supports_native_structured_output": true, "supports_output_config": true, "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "anthropic.claude-sonnet-4-20250514-v1:0": { "cache_creation_input_token_cost": 3.75e-06, @@ -2760,7 +2970,8 @@ "supports_tool_choice": true, "supports_vision": true, "bedrock_converse_supports_strict_tools": false, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "anthropic.claude-sonnet-4-5-20250929-v1:0": { "cache_creation_input_token_cost": 3.75e-06, @@ -2797,7 +3008,8 @@ "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 1024, "input_cost_per_token_batches": 1.5e-06, - "output_cost_per_token_batches": 7.5e-06 + "output_cost_per_token_batches": 7.5e-06, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, "anthropic.claude-v1": { "input_cost_per_token": 8e-06, @@ -2982,60 +3194,6 @@ "supports_vision": true, "supports_tool_choice": true }, - "apac.anthropic.claude-3-5-sonnet-20240620-v1:0": { - "deprecation_date": "2026-07-30", - "input_cost_per_token": 3e-06, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 3e-07, - "cache_creation_input_token_cost": 3.75e-06 - }, - "apac.anthropic.claude-3-5-sonnet-20241022-v2:0": { - "cache_creation_input_token_cost": 3.75e-06, - "cache_read_input_token_cost": 3e-07, - "deprecation_date": "2026-07-30", - "input_cost_per_token": 3e-06, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "apac.anthropic.claude-3-haiku-20240307-v1:0": { - "deprecation_date": "2026-09-10", - "input_cost_per_token": 2.5e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.25e-06, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 2.5e-08, - "cache_creation_input_token_cost": 3.125e-07 - }, "apac.anthropic.claude-haiku-4-5-20251001-v1:0": { "cache_creation_input_token_cost": 1.375e-06, "cache_read_input_token_cost": 1.1e-07, @@ -3063,23 +3221,6 @@ "input_cost_per_token_batches": 5.5e-07, "output_cost_per_token_batches": 2.75e-06 }, - "apac.anthropic.claude-3-sonnet-20240229-v1:0": { - "deprecation_date": "2026-07-30", - "input_cost_per_token": 3e-06, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 3e-07, - "cache_creation_input_token_cost": 3.75e-06 - }, "apac.anthropic.claude-sonnet-4-20250514-v1:0": { "cache_creation_input_token_cost": 3.75e-06, "cache_read_input_token_cost": 3e-07, @@ -3110,7 +3251,8 @@ "supports_tool_choice": true, "supports_vision": true, "bedrock_converse_supports_strict_tools": false, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "assemblyai/best": { "input_cost_per_second": 3.333e-05, @@ -3159,15 +3301,18 @@ "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 1024, "input_cost_per_token_batches": 1.65e-06, - "output_cost_per_token_batches": 8.25e-06 + "output_cost_per_token_batches": 8.25e-06, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "azure/ada": { + "deprecation_date": "2028-02-09", "input_cost_per_token": 1e-07, "litellm_provider": "azure", "max_input_tokens": 8191, "max_tokens": 8191, "mode": "embedding", - "output_cost_per_token": 0.0 + "output_cost_per_token": 0.0, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/model-retirement-schedule" }, "azure/codex-mini": { "cache_read_input_token_cost": 3.75e-07, @@ -3201,6 +3346,7 @@ "supports_vision": true }, "azure/command-r-plus": { + "deprecation_date": "2025-06-30", "input_cost_per_token": 3e-06, "litellm_provider": "azure", "max_input_tokens": 128000, @@ -3208,10 +3354,11 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 1.5e-05, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_function_calling": true }, "azure_ai/claude-haiku-4-5": { - "deprecation_date": "2026-10-19", + "deprecation_date": "2026-11-15", "cache_creation_input_token_cost": 1.25e-06, "cache_creation_input_token_cost_above_1hr": 2e-06, "cache_read_input_token_cost": 1e-07, @@ -3231,10 +3378,11 @@ "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/model-retirement-schedule" }, "azure_ai/claude-opus-4-5": { - "deprecation_date": "2026-10-19", + "deprecation_date": "2026-11-24", "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, "cache_read_input_token_cost": 5e-07, @@ -3255,7 +3403,8 @@ "supports_tool_choice": true, "supports_vision": true, "supports_output_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/model-retirement-schedule" }, "azure_ai/claude-opus-4-6": { "deprecation_date": "2027-02-02", @@ -3424,12 +3573,10 @@ "supports_max_reasoning_effort": true, "prompt_cache_min_tokens": 512 }, - "azure_ai/claude-opus-4-8": { - "deprecation_date": "2027-09-01", + "azure_ai/claude-opus-5-5": { "supports_mid_conversation_system": true, - "supports_adaptive_thinking": true, - "input_cost_per_token": 5e-06, - "output_cost_per_token": 2.5e-05, + "input_cost_per_token": 4e-06, + "output_cost_per_token": 2e-05, "litellm_provider": "azure_ai", "max_input_tokens": 1000000, "max_output_tokens": 128000, @@ -3440,12 +3587,16 @@ "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_1hr": 1e-05, - "cache_read_input_token_cost": 5e-07, + "cache_creation_input_token_cost": 5e-06, + "cache_creation_input_token_cost_above_1hr": 8e-06, + "cache_read_input_token_cost": 2e-07, + "supports_adaptive_thinking": true, + "thinking_always_on": true, "supports_assistant_prefill": false, "supports_computer_use": true, + "supports_forced_tool_use": false, "supports_function_calling": true, + "supports_native_structured_output": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, @@ -3455,33 +3606,43 @@ "supports_vision": true, "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 512 }, - "azure_ai/claude-opus-4-1": { - "deprecation_date": "2026-08-05", - "cache_creation_input_token_cost": 1.875e-05, - "cache_creation_input_token_cost_above_1hr": 3e-05, - "cache_read_input_token_cost": 1.5e-06, - "input_cost_per_token": 1.5e-05, + "azure_ai/claude-opus-4-8": { + "deprecation_date": "2027-09-01", + "supports_mid_conversation_system": true, + "supports_adaptive_thinking": true, + "input_cost_per_token": 5e-06, + "output_cost_per_token": 2.5e-05, "litellm_provider": "azure_ai", - "max_input_tokens": 200000, - "max_output_tokens": 32000, - "max_tokens": 32000, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 7.5e-05, - "supports_assistant_prefill": true, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "cache_creation_input_token_cost": 6.25e-06, + "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_read_input_token_cost": 5e-07, + "supports_assistant_prefill": false, "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_max_reasoning_effort": true, "prompt_cache_min_tokens": 1024 }, "azure_ai/claude-sonnet-4-5": { - "deprecation_date": "2026-10-19", + "deprecation_date": "2026-11-30", "cache_creation_input_token_cost": 3.75e-06, "cache_creation_input_token_cost_above_1hr": 6e-06, "cache_read_input_token_cost": 3e-07, @@ -3501,7 +3662,8 @@ "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/model-retirement-schedule" }, "azure_ai/claude-sonnet-5": { "deprecation_date": "2027-06-30", @@ -3546,8 +3708,8 @@ "input_cost_per_token": 3e-06, "litellm_provider": "azure_ai", "max_input_tokens": 1000000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 1.5e-05, "supports_assistant_prefill": true, @@ -3561,7 +3723,8 @@ "supports_tool_choice": true, "supports_vision": true, "supports_output_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/claude-models" }, "azure/computer-use-preview": { "input_cost_per_token": 3e-06, @@ -3659,29 +3822,28 @@ "supports_web_search": true, "supports_xhigh_reasoning_effort": true }, - "azure_ai/gpt-5.5": { - "deprecation_date": "2027-10-26", - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_above_272k_tokens": 1e-06, - "cache_read_input_token_cost_priority": 1e-06, - "cache_read_input_token_cost_above_272k_tokens_priority": 2e-06, - "input_cost_per_token": 5e-06, - "input_cost_per_token_above_272k_tokens": 1e-05, - "input_cost_per_token_priority": 1e-05, - "input_cost_per_token_above_272k_tokens_priority": 2e-05, + "azure_ai/gpt-6-luna": { + "cache_creation_input_token_cost": 1.25e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-07, + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_272k_tokens": 2e-07, "litellm_provider": "azure_ai", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3e-05, - "output_cost_per_token_above_272k_tokens": 4.5e-05, - "output_cost_per_token_priority": 6e-05, - "output_cost_per_token_above_272k_tokens_priority": 9e-05, - "source": "https://ai.azure.com/catalog/models/gpt-5.5", + "output_cost_per_token": 5e-07, + "output_cost_per_token_above_272k_tokens": 7.5e-07, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://azure.microsoft.com/en-us/blog/gpt-6-astra-sol-and-luna-for-production-agents-in-microsoft-foundry/", "supported_endpoints": [ "/v1/chat/completions", - "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -3691,10 +3853,15 @@ "supported_output_modalities": [ "text" ], + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, "supports_native_streaming": true, + "supports_none_reasoning_effort": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, + "supports_prompt_cache_breakpoint": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, @@ -3702,21 +3869,28 @@ "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true, - "supports_none_reasoning_effort": true, - "supports_xhigh_reasoning_effort": true, - "supports_minimal_reasoning_effort": false + "supports_xhigh_reasoning_effort": true }, - "azure_ai/gpt-chat-latest": { - "cache_read_input_token_cost": 5e-07, - "deprecation_date": "2026-12-02", - "input_cost_per_token": 5e-06, + "azure_ai/gpt-6-sol": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, "litellm_provider": "azure_ai", - "max_input_tokens": 272000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3e-05, - "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/", + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://azure.microsoft.com/en-us/blog/gpt-6-astra-sol-and-luna-for-production-agents-in-microsoft-foundry/", "supported_endpoints": [ "/v1/chat/completions", "/v1/responses" @@ -3728,45 +3902,46 @@ "supported_output_modalities": [ "text" ], + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, "supports_native_streaming": true, + "supports_none_reasoning_effort": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, + "supports_prompt_cache_breakpoint": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true - }, - "azure_ai/gpt-image-2": { - "cache_read_input_image_token_cost": 2e-06, - "cache_read_input_token_cost": 1.25e-06, - "input_cost_per_image_token": 8e-06, - "input_cost_per_token": 5e-06, - "litellm_provider": "azure_ai", - "mode": "image_generation", - "output_cost_per_image_token": 3e-05, - "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/", - "supported_endpoints": [ - "/v1/images/generations", - "/v1/images/edits" - ], - "supports_vision": true + "supports_web_search": true, + "supports_xhigh_reasoning_effort": true }, - "azure_ai/codex-mini": { - "cache_read_input_token_cost": 3.75e-07, - "deprecation_date": "2026-11-15", - "input_cost_per_token": 1.5e-06, + "azure_ai/gpt-6.1-sol": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, "litellm_provider": "azure_ai", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, - "mode": "responses", - "output_cost_per_token": 6e-06, - "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/models", "supported_endpoints": [ + "/v1/chat/completions", "/v1/responses" ], "supported_modalities": [ @@ -3776,25 +3951,26 @@ "supported_output_modalities": [ "text" ], + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_native_streaming": true, + "supports_none_reasoning_effort": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, + "supports_prompt_cache_breakpoint": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true - }, - "azure_ai/whisper": { - "deprecation_date": "2026-12-15", - "input_cost_per_second": 0.0001, - "litellm_provider": "azure_ai", - "mode": "audio_transcription", - "output_cost_per_second": 0.0001, - "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/" + "supports_vision": true, + "supports_web_search": true, + "supports_xhigh_reasoning_effort": true }, - "azure_ai/gpt-5.5-2026-04-23": { + "azure_ai/gpt-5.5": { + "deprecation_date": "2027-10-26", "cache_read_input_token_cost": 5e-07, "cache_read_input_token_cost_above_272k_tokens": 1e-06, "cache_read_input_token_cost_priority": 1e-06, @@ -3804,7 +3980,142 @@ "input_cost_per_token_priority": 1e-05, "input_cost_per_token_above_272k_tokens_priority": 2e-05, "litellm_provider": "azure_ai", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 3e-05, + "output_cost_per_token_above_272k_tokens": 4.5e-05, + "output_cost_per_token_priority": 6e-05, + "output_cost_per_token_above_272k_tokens_priority": 9e-05, + "source": "https://ai.azure.com/catalog/models/gpt-5.5", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_none_reasoning_effort": true, + "supports_xhigh_reasoning_effort": true, + "supports_minimal_reasoning_effort": false + }, + "azure_ai/gpt-chat-latest": { + "cache_read_input_token_cost": 5e-07, + "deprecation_date": "2026-12-02", + "input_cost_per_token": 5e-06, + "litellm_provider": "azure_ai", + "max_input_tokens": 272000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 3e-05, + "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, + "azure_ai/gpt-image-2": { + "cache_read_input_image_token_cost": 2e-06, + "cache_read_input_token_cost": 1.25e-06, + "deprecation_date": "2027-10-21", + "input_cost_per_image_token": 8e-06, + "input_cost_per_token": 5e-06, + "litellm_provider": "azure_ai", + "mode": "image_generation", + "output_cost_per_image_token": 3e-05, + "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/", + "supported_endpoints": [ + "/v1/images/generations", + "/v1/images/edits" + ], + "supports_vision": true + }, + "azure_ai/codex-mini": { + "cache_read_input_token_cost": 3.75e-07, + "deprecation_date": "2026-11-15", + "input_cost_per_token": 1.5e-06, + "litellm_provider": "azure_ai", + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, + "mode": "responses", + "output_cost_per_token": 6e-06, + "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/", + "supported_endpoints": [ + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "azure_ai/whisper": { + "deprecation_date": "2026-12-15", + "input_cost_per_second": 0.0001, + "litellm_provider": "azure_ai", + "mode": "audio_transcription", + "output_cost_per_second": 0.0001, + "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/" + }, + "azure_ai/gpt-5.5-2026-04-23": { + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_272k_tokens": 1e-06, + "cache_read_input_token_cost_priority": 1e-06, + "cache_read_input_token_cost_above_272k_tokens_priority": 2e-06, + "input_cost_per_token": 5e-06, + "input_cost_per_token_above_272k_tokens": 1e-05, + "input_cost_per_token_priority": 1e-05, + "input_cost_per_token_above_272k_tokens_priority": 2e-05, + "litellm_provider": "azure_ai", + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -3851,7 +4162,7 @@ "input_cost_per_token_priority": 1e-05, "input_cost_per_token_above_272k_tokens_priority": 2e-05, "litellm_provider": "azure_ai", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -3898,7 +4209,7 @@ "input_cost_per_token_priority": 5e-06, "input_cost_per_token_above_272k_tokens_priority": 1e-05, "litellm_provider": "azure_ai", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -3946,7 +4257,7 @@ "input_cost_per_token_priority": 5e-06, "input_cost_per_token_above_272k_tokens_priority": 1e-05, "litellm_provider": "azure_ai", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -3994,7 +4305,7 @@ "input_cost_per_token_priority": 6e-05, "input_cost_per_token_above_272k_tokens_priority": 0.00012, "litellm_provider": "azure_ai", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "responses", @@ -4040,7 +4351,7 @@ "input_cost_per_token_priority": 6e-05, "input_cost_per_token_above_272k_tokens_priority": 0.00012, "litellm_provider": "azure_ai", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "responses", @@ -4370,12 +4681,13 @@ "input_cost_per_audio_token": 4.4e-05, "input_cost_per_token": 5.5e-06, "litellm_provider": "azure", - "max_input_tokens": 128000, + "max_input_tokens": 16000, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "realtime", "output_cost_per_audio_token": 8e-05, "output_cost_per_token": 2.2e-05, + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure", "supported_modalities": [ "text", "audio" @@ -4428,7 +4740,8 @@ "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "cache_read_input_token_cost_batches": 6.875e-08 }, "azure/eu/gpt-5-mini-2025-08-07": { "cache_read_input_token_cost": 2.75e-08, @@ -4467,11 +4780,13 @@ "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "cache_read_input_token_cost_batches": 1.375e-08 }, "azure/eu/gpt-5.1": { "deprecation_date": "2027-05-15", "cache_read_input_token_cost": 1.375e-07, + "cache_read_input_token_cost_batches": 6.875e-08, "cache_read_input_token_cost_priority": 2.75e-07, "input_cost_per_token": 1.375e-06, "litellm_provider": "azure", @@ -4511,43 +4826,6 @@ "output_cost_per_token_priority": 2.2e-05, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "azure/eu/gpt-5.1-chat": { - "cache_read_input_token_cost": 1.375e-07, - "deprecation_date": "2026-06-29", - "input_cost_per_token": 1.375e-06, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 1.1e-05, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/batch", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text", - "image" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_none_reasoning_effort": true, - "default_reasoning_effort": "none", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" - }, "azure/eu/gpt-5.1-codex": { "deprecation_date": "2027-05-15", "cache_read_input_token_cost": 1.375e-07, @@ -4646,7 +4924,8 @@ "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "cache_read_input_token_cost_batches": 2.75e-09 }, "azure/eu/o1-2024-12-17": { "cache_read_input_token_cost": 8.25e-06, @@ -4684,21 +4963,6 @@ "supports_prompt_caching": true, "supports_vision": false }, - "azure/eu/o1-preview-2024-09-12": { - "cache_read_input_token_cost": 8.25e-06, - "input_cost_per_token": 1.65e-05, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 6.6e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_vision": false - }, "azure/eu/o3-mini-2025-01-31": { "cache_read_input_token_cost": 6.05e-07, "deprecation_date": "2026-11-19", @@ -4814,6 +5078,7 @@ "azure/global/gpt-5.1": { "deprecation_date": "2027-05-15", "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_batches": 6.25e-08, "cache_read_input_token_cost_priority": 2.5e-07, "input_cost_per_token": 1.25e-06, "litellm_provider": "azure", @@ -4853,43 +5118,6 @@ "output_cost_per_token_priority": 2e-05, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "azure/global/gpt-5.1-chat": { - "cache_read_input_token_cost": 1.25e-07, - "deprecation_date": "2026-06-29", - "input_cost_per_token": 1.25e-06, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 1e-05, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/batch", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text", - "image" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_none_reasoning_effort": true, - "default_reasoning_effort": "none", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" - }, "azure/global/gpt-5.1-codex": { "deprecation_date": "2027-05-15", "cache_read_input_token_cost": 1.25e-07, @@ -4965,19 +5193,6 @@ "supports_function_calling": true, "supports_tool_choice": true }, - "azure/gpt-3.5-turbo-0125": { - "deprecation_date": "2025-03-31", - "input_cost_per_token": 5e-07, - "litellm_provider": "azure", - "max_input_tokens": 16384, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-06, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true - }, "azure/gpt-3.5-turbo-instruct-0914": { "input_cost_per_token": 1.5e-06, "litellm_provider": "azure_text", @@ -4997,33 +5212,8 @@ "supports_function_calling": true, "supports_tool_choice": true }, - "azure/gpt-35-turbo-0125": { - "deprecation_date": "2025-05-31", - "input_cost_per_token": 5e-07, - "litellm_provider": "azure", - "max_input_tokens": 16384, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-06, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true - }, - "azure/gpt-35-turbo-1106": { - "deprecation_date": "2025-03-31", - "input_cost_per_token": 1e-06, - "litellm_provider": "azure", - "max_input_tokens": 16384, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 2e-06, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true - }, "azure/gpt-35-turbo-16k": { + "deprecation_date": "2025-04-30", "input_cost_per_token": 3e-06, "litellm_provider": "azure", "max_input_tokens": 16385, @@ -5031,9 +5221,11 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 4e-06, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/legacy-models", "supports_tool_choice": true }, "azure/gpt-35-turbo-16k-0613": { + "deprecation_date": "2025-04-30", "input_cost_per_token": 3e-06, "litellm_provider": "azure", "max_input_tokens": 16385, @@ -5041,6 +5233,7 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 4e-06, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/legacy-models", "supports_function_calling": true, "supports_tool_choice": true }, @@ -5061,6 +5254,7 @@ "output_cost_per_token": 2e-06 }, "azure/gpt-4": { + "deprecation_date": "2025-06-06", "input_cost_per_token": 3e-05, "litellm_provider": "azure", "max_input_tokens": 8192, @@ -5068,6 +5262,7 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 6e-05, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_function_calling": true, "supports_tool_choice": true }, @@ -5084,6 +5279,7 @@ "supports_tool_choice": true }, "azure/gpt-4-0613": { + "deprecation_date": "2025-06-06", "input_cost_per_token": 3e-05, "litellm_provider": "azure", "max_input_tokens": 8192, @@ -5091,6 +5287,7 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 6e-05, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/legacy-models", "supports_function_calling": true, "supports_tool_choice": true }, @@ -5107,6 +5304,7 @@ "supports_tool_choice": true }, "azure/gpt-4-32k": { + "deprecation_date": "2025-06-06", "input_cost_per_token": 6e-05, "litellm_provider": "azure", "max_input_tokens": 32768, @@ -5114,9 +5312,11 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 0.00012, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/legacy-models", "supports_tool_choice": true }, "azure/gpt-4-32k-0613": { + "deprecation_date": "2025-06-06", "input_cost_per_token": 6e-05, "litellm_provider": "azure", "max_input_tokens": 32768, @@ -5124,6 +5324,7 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 0.00012, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/legacy-models", "supports_tool_choice": true }, "azure/gpt-4-turbo": { @@ -5384,6 +5585,7 @@ }, "azure/gpt-4.5-preview": { "cache_read_input_token_cost": 3.75e-05, + "deprecation_date": "2025-07-14", "input_cost_per_token": 7.5e-05, "input_cost_per_token_batches": 3.75e-05, "litellm_provider": "azure", @@ -5393,6 +5595,7 @@ "mode": "chat", "output_cost_per_token": 0.00015, "output_cost_per_token_batches": 7.5e-05, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/legacy-models", "supports_function_calling": true, "supports_parallel_function_calling": true, "supports_prompt_caching": true, @@ -5419,7 +5622,7 @@ "supports_vision": true }, "azure/gpt-4o-2024-05-13": { - "deprecation_date": "2026-10-01", + "deprecation_date": "2026-12-09", "input_cost_per_token": 5e-06, "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "azure", @@ -5476,6 +5679,39 @@ "supports_tool_choice": true, "supports_vision": true }, + "azure/gpt-audio": { + "deprecation_date": "2027-03-02", + "input_cost_per_audio_token": 4e-05, + "input_cost_per_token": 2.5e-06, + "litellm_provider": "azure", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_audio_token": 8e-05, + "output_cost_per_token": 1e-05, + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": false, + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure" + }, "azure/gpt-audio-2025-08-28": { "deprecation_date": "2027-03-02", "input_cost_per_audio_token": 4e-05, @@ -5508,6 +5744,39 @@ "supports_tool_choice": true, "supports_vision": false }, + "azure/gpt-audio-1.5": { + "deprecation_date": "2027-08-24", + "input_cost_per_audio_token": 4e-05, + "input_cost_per_token": 2.5e-06, + "litellm_provider": "azure", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_audio_token": 8e-05, + "output_cost_per_token": 1e-05, + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": false, + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure" + }, "azure/gpt-audio-1.5-2026-02-23": { "deprecation_date": "2027-08-24", "input_cost_per_audio_token": 4e-05, @@ -5541,7 +5810,7 @@ "supports_vision": false }, "azure/gpt-audio-mini": { - "deprecation_date": "2027-04-06", + "deprecation_date": "2027-06-15", "input_cost_per_audio_token": 1e-05, "input_cost_per_token": 6e-07, "litellm_provider": "azure", @@ -5638,13 +5907,13 @@ "azure/gpt-4o-mini": { "deprecation_date": "2027-04-14", "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_token": 1.65e-07, + "input_cost_per_token": 1.5e-07, "litellm_provider": "azure", "max_input_tokens": 128000, "max_output_tokens": 16384, "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 6.6e-07, + "output_cost_per_token": 6e-07, "supports_function_calling": true, "supports_parallel_function_calling": true, "supports_prompt_caching": true, @@ -5722,6 +5991,41 @@ "supports_system_messages": true, "supports_tool_choice": true }, + "azure/gpt-realtime": { + "cache_creation_input_audio_token_cost": 4e-06, + "cache_read_input_audio_token_cost": 4e-07, + "cache_read_input_token_cost": 4e-07, + "deprecation_date": "2027-03-02", + "input_cost_per_audio_token": 3.2e-05, + "input_cost_per_image_token": 5e-06, + "input_cost_per_token": 4e-06, + "litellm_provider": "azure", + "max_input_tokens": 32000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "realtime", + "output_cost_per_audio_token": 6.4e-05, + "output_cost_per_token": 1.6e-05, + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "image", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure" + }, "azure/gpt-realtime-2025-08-28": { "cache_creation_input_audio_token_cost": 4e-06, "cache_read_input_audio_token_cost": 4e-07, @@ -5756,7 +6060,7 @@ "supports_system_messages": true, "supports_tool_choice": true }, - "azure/gpt-realtime-1.5-2026-02-23": { + "azure/gpt-realtime-1.5": { "cache_creation_input_audio_token_cost": 4e-06, "cache_read_input_audio_token_cost": 4e-07, "cache_read_input_token_cost": 4e-07, @@ -5788,12 +6092,14 @@ "supports_function_calling": true, "supports_parallel_function_calling": true, "supports_system_messages": true, - "supports_tool_choice": true + "supports_tool_choice": true, + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure" }, - "azure/gpt-realtime-2": { + "azure/gpt-realtime-1.5-2026-02-23": { + "cache_creation_input_audio_token_cost": 4e-06, "cache_read_input_audio_token_cost": 4e-07, "cache_read_input_token_cost": 4e-07, - "deprecation_date": "2026-08-31", + "deprecation_date": "2027-08-24", "input_cost_per_audio_token": 3.2e-05, "input_cost_per_image_token": 5e-06, "input_cost_per_token": 4e-06, @@ -5803,8 +6109,7 @@ "max_tokens": 4096, "mode": "realtime", "output_cost_per_audio_token": 6.4e-05, - "output_cost_per_token": 2.4e-05, - "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure", + "output_cost_per_token": 1.6e-05, "supported_endpoints": [ "/v1/realtime" ], @@ -5828,7 +6133,7 @@ "cache_creation_input_audio_token_cost": 4e-07, "cache_read_input_audio_token_cost": 4e-07, "cache_read_input_token_cost": 4e-07, - "deprecation_date": "2027-06-25", + "deprecation_date": "2027-07-31", "input_cost_per_audio_token": 3.2e-05, "input_cost_per_image_token": 5e-06, "input_cost_per_token": 4e-06, @@ -5863,7 +6168,7 @@ "cache_creation_input_audio_token_cost": 3e-07, "cache_read_input_audio_token_cost": 3e-07, "cache_read_input_token_cost": 6e-08, - "deprecation_date": "2027-06-25", + "deprecation_date": "2027-07-31", "input_cost_per_audio_token": 1e-05, "input_cost_per_image_token": 8e-07, "input_cost_per_token": 6e-07, @@ -5898,6 +6203,7 @@ "cache_creation_input_audio_token_cost": 3e-07, "cache_read_input_audio_token_cost": 3e-07, "cache_read_input_token_cost": 6e-08, + "deprecation_date": "2027-06-15", "input_cost_per_audio_token": 1e-05, "input_cost_per_image_token": 8e-07, "input_cost_per_token": 6e-07, @@ -5931,6 +6237,7 @@ "cache_creation_input_audio_token_cost": 3e-07, "cache_read_input_audio_token_cost": 3e-07, "cache_read_input_token_cost": 6e-08, + "deprecation_date": "2027-04-06", "input_cost_per_audio_token": 1e-05, "input_cost_per_image_token": 8e-07, "input_cost_per_token": 6e-07, @@ -5961,7 +6268,8 @@ "supports_tool_choice": true }, "azure/gpt-4o-mini-transcribe": { - "input_cost_per_audio_token": 1.25e-06, + "deprecation_date": "2027-06-15", + "input_cost_per_audio_token": 3e-06, "input_cost_per_token": 1.25e-06, "litellm_provider": "azure", "max_input_tokens": 16000, @@ -5973,7 +6281,8 @@ ] }, "azure/gpt-4o-mini-tts": { - "input_cost_per_token": 2.5e-06, + "deprecation_date": "2027-06-15", + "input_cost_per_token": 6e-07, "litellm_provider": "azure", "mode": "audio_speech", "output_cost_per_audio_token": 1.2e-05, @@ -6014,12 +6323,13 @@ "input_cost_per_audio_token": 4e-05, "input_cost_per_token": 5e-06, "litellm_provider": "azure", - "max_input_tokens": 128000, + "max_input_tokens": 16000, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "realtime", "output_cost_per_audio_token": 8e-05, "output_cost_per_token": 2e-05, + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure", "supported_modalities": [ "text", "audio" @@ -6036,7 +6346,7 @@ "supports_tool_choice": true }, "azure/gpt-4o-transcribe": { - "deprecation_date": "2026-10-15", + "deprecation_date": "2026-12-31", "input_cost_per_audio_token": 2.5e-06, "input_cost_per_token": 2.5e-06, "litellm_provider": "azure", @@ -6044,6 +6354,7 @@ "max_output_tokens": 2000, "mode": "audio_transcription", "output_cost_per_token": 1e-05, + "source": "https://management.azure.com/subscriptions/c873328e-b572-4770-8dff-aaeb6f1f0e79/providers/Microsoft.CognitiveServices/locations/eastus2/models?api-version=2024-10-01", "supported_endpoints": [ "/v1/audio/transcriptions" ] @@ -6062,8 +6373,12 @@ ] }, "azure/gpt-realtime-whisper": { + "deprecation_date": "2027-05-06", "input_cost_per_second": 0.0002833333333333333, "litellm_provider": "azure", + "max_input_tokens": 32000, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "audio_transcription", "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/gpt-realtime-whisper", "supported_endpoints": [ @@ -6118,46 +6433,8 @@ "input_cost_per_token_batches": 6.25e-07, "output_cost_per_token_batches": 5e-06, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_minimal_reasoning_effort": true - }, - "azure/gpt-5.1-chat-2025-11-13": { - "cache_read_input_token_cost": 1.25e-07, - "cache_read_input_token_cost_priority": 2.5e-07, - "deprecation_date": "2026-06-29", - "input_cost_per_token": 1.25e-06, - "input_cost_per_token_priority": 2.5e-06, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1e-05, - "output_cost_per_token_priority": 2e-05, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text", - "image" - ], - "supports_function_calling": false, - "supports_native_streaming": true, - "supports_parallel_function_calling": false, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": false, - "supports_vision": true, - "supports_none_reasoning_effort": true, - "default_reasoning_effort": "none", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "supports_minimal_reasoning_effort": true, + "cache_read_input_token_cost_batches": 6.25e-08 }, "azure/gpt-5.1-codex-2025-11-13": { "cache_read_input_token_cost": 1.25e-07, @@ -6232,6 +6509,7 @@ "azure/gpt-5": { "deprecation_date": "2027-02-09", "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_batches": 6.25e-08, "cache_read_input_token_cost_priority": 2.5e-07, "input_cost_per_token": 1.25e-06, "input_cost_per_token_batches": 6.25e-07, @@ -6305,55 +6583,21 @@ "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "cache_read_input_token_cost_batches": 6.25e-08 }, - "azure/gpt-5-chat": { + "azure/gpt-5-codex": { "cache_read_input_token_cost": 1.25e-07, - "deprecation_date": "2026-06-29", + "deprecation_date": "2027-03-17", "input_cost_per_token": 1.25e-06, "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", + "max_input_tokens": 272000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", "output_cost_per_token": 1e-05, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/batch", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "azure/gpt-5-chat-latest": { - "cache_read_input_token_cost": 1.25e-07, - "deprecation_date": "2026-06-29", - "input_cost_per_token": 1.25e-06, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1e-05, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -6374,18 +6618,26 @@ "supports_tool_choice": true, "supports_vision": true }, - "azure/gpt-5-codex": { - "cache_read_input_token_cost": 1.25e-07, - "deprecation_date": "2027-03-17", - "input_cost_per_token": 1.25e-06, + "azure/gpt-5-mini": { + "deprecation_date": "2027-02-09", + "cache_read_input_token_cost": 2.5e-08, + "cache_read_input_token_cost_batches": 1.25e-08, + "cache_read_input_token_cost_priority": 4.5e-08, + "input_cost_per_token": 2.5e-07, + "input_cost_per_token_batches": 1.25e-07, + "input_cost_per_token_priority": 4.5e-07, "litellm_provider": "azure", "max_input_tokens": 272000, "max_output_tokens": 128000, "max_tokens": 128000, - "mode": "responses", - "output_cost_per_token": 1e-05, + "mode": "chat", + "output_cost_per_token": 2e-06, + "output_cost_per_token_batches": 1e-06, + "output_cost_per_token_priority": 3.6e-06, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -6406,10 +6658,10 @@ "supports_tool_choice": true, "supports_vision": true }, - "azure/gpt-5-mini": { - "deprecation_date": "2027-02-09", + "azure/gpt-5-mini-2025-08-07": { "cache_read_input_token_cost": 2.5e-08, "cache_read_input_token_cost_priority": 4.5e-08, + "deprecation_date": "2027-02-09", "input_cost_per_token": 2.5e-07, "input_cost_per_token_batches": 1.25e-07, "input_cost_per_token_priority": 4.5e-07, @@ -6443,23 +6695,22 @@ "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "cache_read_input_token_cost_batches": 1.25e-08 }, - "azure/gpt-5-mini-2025-08-07": { - "cache_read_input_token_cost": 2.5e-08, - "cache_read_input_token_cost_priority": 4.5e-08, + "azure/gpt-5-nano": { "deprecation_date": "2027-02-09", - "input_cost_per_token": 2.5e-07, - "input_cost_per_token_batches": 1.25e-07, - "input_cost_per_token_priority": 4.5e-07, + "cache_read_input_token_cost": 5e-09, + "cache_read_input_token_cost_batches": 2.5e-09, + "input_cost_per_token": 5e-08, + "input_cost_per_token_batches": 2.5e-08, "litellm_provider": "azure", "max_input_tokens": 272000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2e-06, - "output_cost_per_token_batches": 1e-06, - "output_cost_per_token_priority": 3.6e-06, + "output_cost_per_token": 4e-07, + "output_cost_per_token_batches": 2e-07, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supported_endpoints": [ "/v1/chat/completions", @@ -6484,9 +6735,9 @@ "supports_tool_choice": true, "supports_vision": true }, - "azure/gpt-5-nano": { - "deprecation_date": "2027-02-09", + "azure/gpt-5-nano-2025-08-07": { "cache_read_input_token_cost": 5e-09, + "deprecation_date": "2027-02-09", "input_cost_per_token": 5e-08, "input_cost_per_token_batches": 2.5e-08, "litellm_provider": "azure", @@ -6518,43 +6769,8 @@ "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true - }, - "azure/gpt-5-nano-2025-08-07": { - "cache_read_input_token_cost": 5e-09, - "deprecation_date": "2027-02-09", - "input_cost_per_token": 5e-08, - "input_cost_per_token_batches": 2.5e-08, - "litellm_provider": "azure", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 4e-07, - "output_cost_per_token_batches": 2e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/batch", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "cache_read_input_token_cost_batches": 2.5e-09 }, "azure/gpt-5-pro": { "deprecation_date": "2027-04-07", @@ -6591,6 +6807,7 @@ "azure/gpt-5.1": { "deprecation_date": "2027-05-15", "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_batches": 6.25e-08, "cache_read_input_token_cost_priority": 2.5e-07, "input_cost_per_token": 1.25e-06, "litellm_provider": "azure", @@ -6630,19 +6847,19 @@ "output_cost_per_token_priority": 2e-05, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "azure/gpt-5.1-chat": { + "azure/gpt-5-chat": { "cache_read_input_token_cost": 1.25e-07, "deprecation_date": "2026-06-29", "input_cost_per_token": 1.25e-06, "litellm_provider": "azure", "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "output_cost_per_token": 1e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supported_endpoints": [ "/v1/chat/completions", - "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -6650,22 +6867,234 @@ "image" ], "supported_output_modalities": [ - "text", - "image" + "text" + ], + "supports_prompt_caching": true, + "supports_vision": true + }, + "azure/gpt-5.1-chat": { + "cache_read_input_token_cost": 1.25e-07, + "deprecation_date": "2026-06-29", + "input_cost_per_token": 1.25e-06, + "litellm_provider": "azure", + "max_input_tokens": 111616, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" ], "supports_function_calling": true, - "supports_native_streaming": true, "supports_parallel_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_none_reasoning_effort": true, - "default_reasoning_effort": "none", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "supports_tool_choice": true + }, + "azure/gpt-5.2-chat": { + "cache_read_input_token_cost": 1.75e-07, + "deprecation_date": "2026-06-29", + "input_cost_per_token": 1.75e-06, + "litellm_provider": "azure", + "max_input_tokens": 111616, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.4e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "azure/gpt-5.3-chat": { + "cache_read_input_token_cost": 1.75e-07, + "deprecation_date": "2026-06-29", + "input_cost_per_token": 1.75e-06, + "litellm_provider": "azure", + "max_input_tokens": 111616, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.4e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "azure/us/gpt-5.1-chat": { + "cache_read_input_token_cost": 1.375e-07, + "deprecation_date": "2026-06-29", + "input_cost_per_token": 1.375e-06, + "litellm_provider": "azure", + "max_input_tokens": 111616, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.1e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "azure/us/gpt-5.2-chat": { + "cache_read_input_token_cost": 1.925e-07, + "deprecation_date": "2026-06-29", + "input_cost_per_token": 1.925e-06, + "litellm_provider": "azure", + "max_input_tokens": 111616, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.54e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "azure/us/gpt-5.3-chat": { + "cache_read_input_token_cost": 1.925e-07, + "deprecation_date": "2026-06-29", + "input_cost_per_token": 1.925e-06, + "litellm_provider": "azure", + "max_input_tokens": 111616, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.54e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "azure/eu/gpt-5.1-chat": { + "cache_read_input_token_cost": 1.375e-07, + "deprecation_date": "2026-06-29", + "input_cost_per_token": 1.375e-06, + "litellm_provider": "azure", + "max_input_tokens": 111616, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.1e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "azure/eu/gpt-5.2-chat": { + "cache_read_input_token_cost": 1.925e-07, + "deprecation_date": "2026-06-29", + "input_cost_per_token": 1.925e-06, + "litellm_provider": "azure", + "max_input_tokens": 111616, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.54e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "azure/eu/gpt-5.3-chat": { + "cache_read_input_token_cost": 1.925e-07, + "deprecation_date": "2026-06-29", + "input_cost_per_token": 1.925e-06, + "litellm_provider": "azure", + "max_input_tokens": 111616, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.54e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "azure/us/o1-preview": { + "cache_read_input_token_cost": 8.25e-06, + "deprecation_date": "2025-07-28", + "input_cost_per_token": 1.65e-05, + "litellm_provider": "azure", + "max_input_tokens": 128000, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 6.6e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_prompt_caching": true + }, + "azure/eu/o1-preview": { + "cache_read_input_token_cost": 8.25e-06, + "deprecation_date": "2025-07-28", + "input_cost_per_token": 1.65e-05, + "litellm_provider": "azure", + "max_input_tokens": 128000, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 6.6e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_prompt_caching": true }, "azure/gpt-5.1-codex": { "deprecation_date": "2027-05-15", @@ -6766,6 +7195,7 @@ "azure/gpt-5.2": { "deprecation_date": "2027-06-08", "cache_read_input_token_cost": 1.75e-07, + "cache_read_input_token_cost_batches": 8.75e-08, "cache_read_input_token_cost_priority": 3.5e-07, "input_cost_per_token": 1.75e-06, "input_cost_per_token_batches": 8.75e-07, @@ -6841,79 +7271,8 @@ "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true - }, - "azure/gpt-5.2-chat": { - "cache_read_input_token_cost": 1.75e-07, - "cache_read_input_token_cost_priority": 3.5e-07, - "deprecation_date": "2026-06-29", - "input_cost_per_token": 1.75e-06, - "input_cost_per_token_priority": 3.5e-06, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1.4e-05, - "output_cost_per_token_priority": 2.8e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "azure/gpt-5.2-chat-2025-12-11": { - "cache_read_input_token_cost": 1.75e-07, - "cache_read_input_token_cost_priority": 3.5e-07, - "deprecation_date": "2026-05-13", - "input_cost_per_token": 1.75e-06, - "input_cost_per_token_priority": 3.5e-06, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1.4e-05, - "output_cost_per_token_priority": 2.8e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "cache_read_input_token_cost_batches": 8.75e-08 }, "azure/gpt-5.2-codex": { "cache_read_input_token_cost": 1.75e-07, @@ -6947,42 +7306,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "azure/gpt-5.3-chat": { - "cache_read_input_token_cost": 1.75e-07, - "cache_read_input_token_cost_priority": 3.5e-07, - "deprecation_date": "2026-06-29", - "input_cost_per_token": 1.75e-06, - "input_cost_per_token_priority": 3.5e-06, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1.4e-05, - "output_cost_per_token_priority": 2.8e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true - }, "azure/gpt-5.3-codex": { "cache_read_input_token_cost": 1.75e-07, "cache_read_input_token_cost_priority": 3.5e-07, @@ -7100,15 +7423,17 @@ "deprecation_date": "2027-09-02", "cache_read_input_token_cost": 2.5e-07, "cache_read_input_token_cost_above_272k_tokens": 5e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 2.5e-07, "cache_read_input_token_cost_above_272k_tokens_flex": 2.5e-07, "cache_read_input_token_cost_priority": 5e-07, "cache_read_input_token_cost_above_272k_tokens_priority": 1e-06, + "cache_read_input_token_cost_batches": 1.3e-07, "input_cost_per_token": 2.5e-06, "input_cost_per_token_above_272k_tokens": 5e-06, "input_cost_per_token_priority": 5e-06, "input_cost_per_token_above_272k_tokens_priority": 1e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -7140,9 +7465,11 @@ "supports_vision": true, "supports_none_reasoning_effort": true, "default_reasoning_effort": "none", + "input_cost_per_token_above_272k_tokens_batches": 2.5e-06, "input_cost_per_token_above_272k_tokens_flex": 2.5e-06, "input_cost_per_token_batches": 1.25e-06, "input_cost_per_token_flex": 1.25e-06, + "output_cost_per_token_above_272k_tokens_batches": 1.125e-05, "output_cost_per_token_above_272k_tokens_flex": 1.125e-05, "output_cost_per_token_batches": 7.5e-06, "output_cost_per_token_flex": 7.5e-06, @@ -7154,13 +7481,15 @@ "deprecation_date": "2027-09-02", "cache_read_input_token_cost": 2.75e-07, "cache_read_input_token_cost_above_272k_tokens": 5.5e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 2.75e-07, + "cache_read_input_token_cost_batches": 1.43e-07, "cache_read_input_token_cost_priority": 5.5e-07, "input_cost_per_token": 2.75e-06, "input_cost_per_token_priority": 5.5e-06, "output_cost_per_token": 1.65e-05, "output_cost_per_token_priority": 3.3e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -7189,8 +7518,10 @@ "supports_none_reasoning_effort": true, "default_reasoning_effort": "none", "input_cost_per_token_above_272k_tokens": 5.5e-06, + "input_cost_per_token_above_272k_tokens_batches": 2.75e-06, "input_cost_per_token_batches": 1.375e-06, "output_cost_per_token_above_272k_tokens": 2.475e-05, + "output_cost_per_token_above_272k_tokens_batches": 1.2375e-05, "output_cost_per_token_batches": 8.25e-06, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_xhigh_reasoning_effort": true, @@ -7200,13 +7531,15 @@ "deprecation_date": "2027-09-02", "cache_read_input_token_cost": 2.75e-07, "cache_read_input_token_cost_above_272k_tokens": 5.5e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 2.75e-07, + "cache_read_input_token_cost_batches": 1.43e-07, "cache_read_input_token_cost_priority": 5.5e-07, "input_cost_per_token": 2.75e-06, "input_cost_per_token_priority": 5.5e-06, "output_cost_per_token": 1.65e-05, "output_cost_per_token_priority": 3.3e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -7235,8 +7568,10 @@ "supports_none_reasoning_effort": true, "default_reasoning_effort": "none", "input_cost_per_token_above_272k_tokens": 5.5e-06, + "input_cost_per_token_above_272k_tokens_batches": 2.75e-06, "input_cost_per_token_batches": 1.375e-06, "output_cost_per_token_above_272k_tokens": 2.475e-05, + "output_cost_per_token_above_272k_tokens_batches": 1.2375e-05, "output_cost_per_token_batches": 8.25e-06, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_xhigh_reasoning_effort": true, @@ -7254,7 +7589,7 @@ "input_cost_per_token_priority": 5e-06, "input_cost_per_token_above_272k_tokens_priority": 1e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -7294,7 +7629,11 @@ "output_cost_per_token_flex": 7.5e-06, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_xhigh_reasoning_effort": true, - "supports_minimal_reasoning_effort": true + "supports_minimal_reasoning_effort": true, + "cache_read_input_token_cost_above_272k_tokens_batches": 2.5e-07, + "cache_read_input_token_cost_batches": 1.3e-07, + "input_cost_per_token_above_272k_tokens_batches": 2.5e-06, + "output_cost_per_token_above_272k_tokens_batches": 1.125e-05 }, "azure/us/gpt-5.4-2026-03-05": { "cache_read_input_token_cost": 2.75e-07, @@ -7306,7 +7645,7 @@ "output_cost_per_token": 1.65e-05, "output_cost_per_token_priority": 3.3e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -7340,7 +7679,11 @@ "output_cost_per_token_batches": 8.25e-06, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_xhigh_reasoning_effort": true, - "supports_minimal_reasoning_effort": true + "supports_minimal_reasoning_effort": true, + "cache_read_input_token_cost_above_272k_tokens_batches": 2.75e-07, + "cache_read_input_token_cost_batches": 1.43e-07, + "input_cost_per_token_above_272k_tokens_batches": 2.75e-06, + "output_cost_per_token_above_272k_tokens_batches": 1.2375e-05 }, "azure/eu/gpt-5.4-2026-03-05": { "cache_read_input_token_cost": 2.75e-07, @@ -7352,7 +7695,7 @@ "output_cost_per_token": 1.65e-05, "output_cost_per_token_priority": 3.3e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -7386,7 +7729,11 @@ "output_cost_per_token_batches": 8.25e-06, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_xhigh_reasoning_effort": true, - "supports_minimal_reasoning_effort": true + "supports_minimal_reasoning_effort": true, + "cache_read_input_token_cost_above_272k_tokens_batches": 2.75e-07, + "cache_read_input_token_cost_batches": 1.43e-07, + "input_cost_per_token_above_272k_tokens_batches": 2.75e-06, + "output_cost_per_token_above_272k_tokens_batches": 1.2375e-05 }, "azure/gpt-5.4-pro": { "deprecation_date": "2027-09-07", @@ -7394,16 +7741,18 @@ "cache_read_input_token_cost_above_272k_tokens": 6e-06, "input_cost_per_token": 3e-05, "input_cost_per_token_above_272k_tokens": 6e-05, + "input_cost_per_token_above_272k_tokens_batches": 3e-05, "input_cost_per_token_above_272k_tokens_flex": 3e-05, "input_cost_per_token_batches": 1.5e-05, "input_cost_per_token_flex": 1.5e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "responses", "output_cost_per_token": 0.00018, "output_cost_per_token_above_272k_tokens": 0.00027, + "output_cost_per_token_above_272k_tokens_batches": 0.000135, "output_cost_per_token_above_272k_tokens_flex": 0.000135, "output_cost_per_token_batches": 9e-05, "output_cost_per_token_flex": 9e-05, @@ -7446,7 +7795,7 @@ "input_cost_per_token_batches": 1.5e-05, "input_cost_per_token_flex": 1.5e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "responses", @@ -7482,30 +7831,32 @@ "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "input_cost_per_token_above_272k_tokens_batches": 3e-05, + "output_cost_per_token_above_272k_tokens_batches": 0.000135 }, "azure/gpt-5.6": { - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_272k_tokens": 1.25e-05, - "cache_creation_input_token_cost_priority": 1.25e-05, - "cache_creation_input_token_cost_above_272k_tokens_priority": 2.5e-05, - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_above_272k_tokens": 1e-06, - "cache_read_input_token_cost_priority": 1e-06, - "cache_read_input_token_cost_above_272k_tokens_priority": 2e-06, - "input_cost_per_token": 5e-06, - "input_cost_per_token_above_272k_tokens": 1e-05, - "input_cost_per_token_priority": 1e-05, - "input_cost_per_token_above_272k_tokens_priority": 2e-05, + "cache_creation_input_token_cost": 5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 1e-05, + "cache_creation_input_token_cost_priority": 1e-05, + "cache_creation_input_token_cost_above_272k_tokens_priority": 2e-05, + "cache_read_input_token_cost": 4e-07, + "cache_read_input_token_cost_above_272k_tokens": 8e-07, + "cache_read_input_token_cost_priority": 8e-07, + "cache_read_input_token_cost_above_272k_tokens_priority": 1.6e-06, + "input_cost_per_token": 4e-06, + "input_cost_per_token_above_272k_tokens": 8e-06, + "input_cost_per_token_priority": 8e-06, + "input_cost_per_token_above_272k_tokens_priority": 1.6e-05, "litellm_provider": "azure", "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3e-05, - "output_cost_per_token_above_272k_tokens": 4.5e-05, - "output_cost_per_token_priority": 6e-05, - "output_cost_per_token_above_272k_tokens_priority": 9e-05, + "output_cost_per_token": 2e-05, + "output_cost_per_token_above_272k_tokens": 3e-05, + "output_cost_per_token_priority": 4e-05, + "output_cost_per_token_above_272k_tokens_priority": 6e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -7927,6 +8278,7 @@ "cache_creation_input_token_cost_above_272k_tokens": 2.5e-05, "cache_read_input_token_cost": 1e-06, "cache_read_input_token_cost_above_272k_tokens": 2e-06, + "deprecation_date": "2028-01-11", "input_cost_per_token": 1e-05, "input_cost_per_token_above_272k_tokens": 2e-05, "litellm_provider": "azure", @@ -7975,6 +8327,7 @@ "cache_creation_input_token_cost_above_272k_tokens": 2.5e-05, "cache_read_input_token_cost": 1e-06, "cache_read_input_token_cost_above_272k_tokens": 2e-06, + "deprecation_date": "2028-01-11", "input_cost_per_token": 1e-05, "input_cost_per_token_above_272k_tokens": 2e-05, "litellm_provider": "azure", @@ -8018,57 +8371,27 @@ "supports_web_search": true, "supports_xhigh_reasoning_effort": true }, - "azure/gpt-chat-latest": { - "cache_read_input_token_cost": 5e-07, - "deprecation_date": "2026-12-02", - "input_cost_per_token": 5e-06, - "litellm_provider": "azure", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 3e-05, - "reasoning_effort_levels": [ - "medium" - ], - "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true - }, - "azure/chat-latest": { - "cache_read_input_token_cost": 5e-07, - "deprecation_date": "2026-12-02", - "input_cost_per_token": 5e-06, + "azure/gpt-6-luna": { + "cache_creation_input_token_cost": 1.25e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-07, + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "deprecation_date": "2028-03-11", + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_272k_tokens": 2e-07, "litellm_provider": "azure", - "max_input_tokens": 272000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3e-05, - "reasoning_effort_levels": [ - "medium" - ], - "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/", + "output_cost_per_token": 5e-07, + "output_cost_per_token_above_272k_tokens": 7.5e-07, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://azure.microsoft.com/en-us/blog/gpt-6-astra-sol-and-luna-for-production-agents-in-microsoft-foundry/", "supported_endpoints": [ "/v1/chat/completions", "/v1/responses" @@ -8080,8 +8403,12 @@ "supported_output_modalities": [ "text" ], + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, "supports_native_streaming": true, + "supports_none_reasoning_effort": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, @@ -8090,38 +8417,32 @@ "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "supports_xhigh_reasoning_effort": true }, - "azure/us/gpt-5.6": { - "cache_creation_input_token_cost": 6.875e-06, - "cache_creation_input_token_cost_above_272k_tokens": 1.375e-05, - "cache_creation_input_token_cost_above_272k_tokens_priority": 2.75e-05, - "cache_creation_input_token_cost_priority": 1.375e-05, - "cache_read_input_token_cost": 5.5e-07, - "cache_read_input_token_cost_above_272k_tokens": 1.1e-06, - "cache_read_input_token_cost_above_272k_tokens_priority": 2.2e-06, - "cache_read_input_token_cost_priority": 1.1e-06, - "input_cost_per_token": 5.5e-06, - "input_cost_per_token_above_272k_tokens": 1.1e-05, - "input_cost_per_token_above_272k_tokens_priority": 2.2e-05, - "input_cost_per_token_priority": 1.1e-05, + "azure/gpt-6-luna-2026-09-22": { + "cache_creation_input_token_cost": 1.25e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-07, + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "deprecation_date": "2028-03-11", + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_272k_tokens": 2e-07, "litellm_provider": "azure", "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3.3e-05, - "output_cost_per_token_above_272k_tokens": 4.95e-05, - "output_cost_per_token_above_272k_tokens_priority": 9.9e-05, - "output_cost_per_token_priority": 6.6e-05, + "output_cost_per_token": 5e-07, + "output_cost_per_token_above_272k_tokens": 7.5e-07, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, + "source": "https://azure.microsoft.com/en-us/blog/gpt-6-astra-sol-and-luna-for-production-agents-in-microsoft-foundry/", "supported_endpoints": [ "/v1/chat/completions", - "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -8131,8 +8452,12 @@ "supported_output_modalities": [ "text" ], + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, "supports_native_streaming": true, + "supports_none_reasoning_effort": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, @@ -8142,42 +8467,31 @@ "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true, - "supports_none_reasoning_effort": true, - "supports_xhigh_reasoning_effort": true, - "supports_minimal_reasoning_effort": false + "supports_xhigh_reasoning_effort": true }, - "azure/us/gpt-5.6-sol": { - "cache_creation_input_token_cost": 5.5e-06, - "cache_creation_input_token_cost_above_272k_tokens": 1.1e-05, - "cache_creation_input_token_cost_above_272k_tokens_priority": 2.2e-05, - "cache_creation_input_token_cost_priority": 1.1e-05, - "cache_read_input_token_cost": 4.4e-07, - "cache_read_input_token_cost_above_272k_tokens": 8.8e-07, - "cache_read_input_token_cost_above_272k_tokens_priority": 1.76e-06, - "cache_read_input_token_cost_priority": 8.8e-07, - "deprecation_date": "2028-01-11", - "input_cost_per_token": 4.4e-06, - "input_cost_per_token_above_272k_tokens": 8.8e-06, - "input_cost_per_token_above_272k_tokens_priority": 1.76e-05, - "input_cost_per_token_priority": 8.8e-06, + "azure/gpt-6-sol": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "deprecation_date": "2028-03-11", + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, "litellm_provider": "azure", "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.2e-05, - "output_cost_per_token_above_272k_tokens": 3.3e-05, - "output_cost_per_token_above_272k_tokens_priority": 6.6e-05, - "output_cost_per_token_priority": 4.4e-05, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://azure.microsoft.com/en-us/blog/gpt-6-astra-sol-and-luna-for-production-agents-in-microsoft-foundry/", "supported_endpoints": [ "/v1/chat/completions", - "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -8187,8 +8501,12 @@ "supported_output_modalities": [ "text" ], + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, "supports_native_streaming": true, + "supports_none_reasoning_effort": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, @@ -8198,42 +8516,31 @@ "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true, - "supports_none_reasoning_effort": true, - "supports_xhigh_reasoning_effort": true, - "supports_minimal_reasoning_effort": false + "supports_xhigh_reasoning_effort": true }, - "azure/us/gpt-5.6-terra": { - "cache_creation_input_token_cost": 2.75e-06, - "cache_creation_input_token_cost_above_272k_tokens": 5.5e-06, - "cache_creation_input_token_cost_above_272k_tokens_priority": 1.1e-05, - "cache_creation_input_token_cost_priority": 5.5e-06, - "cache_read_input_token_cost": 2.2e-07, - "cache_read_input_token_cost_above_272k_tokens": 4.4e-07, - "cache_read_input_token_cost_above_272k_tokens_priority": 8.8e-07, - "cache_read_input_token_cost_priority": 4.4e-07, - "deprecation_date": "2028-01-11", - "input_cost_per_token": 2.2e-06, - "input_cost_per_token_above_272k_tokens": 4.4e-06, - "input_cost_per_token_above_272k_tokens_priority": 8.8e-06, - "input_cost_per_token_priority": 4.4e-06, + "azure/gpt-6-sol-2026-09-22": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "deprecation_date": "2028-03-11", + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, "litellm_provider": "azure", "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.32e-05, - "output_cost_per_token_above_272k_tokens": 1.98e-05, - "output_cost_per_token_above_272k_tokens_priority": 3.96e-05, - "output_cost_per_token_priority": 2.64e-05, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://azure.microsoft.com/en-us/blog/gpt-6-astra-sol-and-luna-for-production-agents-in-microsoft-foundry/", "supported_endpoints": [ "/v1/chat/completions", - "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -8243,8 +8550,12 @@ "supported_output_modalities": [ "text" ], + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, "supports_native_streaming": true, + "supports_none_reasoning_effort": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, @@ -8254,42 +8565,31 @@ "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true, - "supports_none_reasoning_effort": true, - "supports_xhigh_reasoning_effort": true, - "supports_minimal_reasoning_effort": false + "supports_xhigh_reasoning_effort": true }, - "azure/us/gpt-5.6-luna": { - "cache_creation_input_token_cost": 2.75e-07, - "cache_creation_input_token_cost_above_272k_tokens": 5.5e-07, - "cache_creation_input_token_cost_above_272k_tokens_priority": 1.1e-06, - "cache_creation_input_token_cost_priority": 5.5e-07, - "cache_read_input_token_cost": 2.2e-08, - "cache_read_input_token_cost_above_272k_tokens": 4.4e-08, - "cache_read_input_token_cost_above_272k_tokens_priority": 8.8e-08, - "cache_read_input_token_cost_priority": 4.4e-08, - "deprecation_date": "2028-01-11", - "input_cost_per_token": 2.2e-07, - "input_cost_per_token_above_272k_tokens": 4.4e-07, - "input_cost_per_token_above_272k_tokens_priority": 8.8e-07, - "input_cost_per_token_priority": 4.4e-07, + "azure/gpt-6.1-sol": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "deprecation_date": "2028-03-11", + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, "litellm_provider": "azure", "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.32e-06, - "output_cost_per_token_above_272k_tokens": 1.98e-06, - "output_cost_per_token_above_272k_tokens_priority": 3.96e-06, - "output_cost_per_token_priority": 2.64e-06, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/models", "supported_endpoints": [ "/v1/chat/completions", - "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -8299,8 +8599,12 @@ "supported_output_modalities": [ "text" ], + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, "supports_native_streaming": true, + "supports_none_reasoning_effort": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, @@ -8310,30 +8614,29 @@ "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true, - "supports_none_reasoning_effort": true, - "supports_xhigh_reasoning_effort": true, - "supports_minimal_reasoning_effort": false + "supports_xhigh_reasoning_effort": true }, - "azure/us/gpt-6-astra": { - "cache_creation_input_token_cost": 1.375e-05, - "cache_creation_input_token_cost_above_272k_tokens": 2.75e-05, - "cache_read_input_token_cost": 1.1e-06, - "cache_read_input_token_cost_above_272k_tokens": 2.2e-06, - "input_cost_per_token": 1.1e-05, - "input_cost_per_token_above_272k_tokens": 2.2e-05, + "azure/gpt-6.1-sol-2026-09-29": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "deprecation_date": "2028-03-11", + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, "litellm_provider": "azure", "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 5.5e-05, - "output_cost_per_token_above_272k_tokens": 8.25e-05, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/models", "supported_endpoints": [ "/v1/chat/completions", "/v1/responses" @@ -8347,7 +8650,7 @@ ], "supports_computer_use": true, "supports_function_calling": true, - "supports_max_reasoning_effort": false, + "supports_max_reasoning_effort": true, "supports_minimal_reasoning_effort": false, "supports_native_streaming": true, "supports_none_reasoning_effort": true, @@ -8362,16 +8665,16 @@ "supports_web_search": true, "supports_xhigh_reasoning_effort": true }, - "azure/us/gpt-chat-latest": { - "cache_read_input_token_cost": 5.5e-07, + "azure/gpt-chat-latest": { + "cache_read_input_token_cost": 5e-07, "deprecation_date": "2026-12-02", - "input_cost_per_token": 5.5e-06, + "input_cost_per_token": 5e-06, "litellm_provider": "azure", "max_input_tokens": 272000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3.3e-05, + "output_cost_per_token": 3e-05, "reasoning_effort_levels": [ "medium" ], @@ -8399,28 +8702,471 @@ "supports_vision": true, "supports_web_search": true }, - "azure/eu/gpt-5.6": { - "cache_creation_input_token_cost": 6.875e-06, - "cache_creation_input_token_cost_above_272k_tokens": 1.375e-05, - "cache_creation_input_token_cost_above_272k_tokens_priority": 2.75e-05, - "cache_creation_input_token_cost_priority": 1.375e-05, + "azure/chat-latest": { + "cache_read_input_token_cost": 5e-07, + "deprecation_date": "2026-12-02", + "input_cost_per_token": 5e-06, + "litellm_provider": "azure", + "max_input_tokens": 272000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 3e-05, + "reasoning_effort_levels": [ + "medium" + ], + "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, + "azure/us/gpt-5.6": { + "cache_creation_input_token_cost": 5.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 1.1e-05, + "cache_creation_input_token_cost_above_272k_tokens_priority": 2.2e-05, + "cache_creation_input_token_cost_priority": 1.1e-05, + "cache_read_input_token_cost": 4.4e-07, + "cache_read_input_token_cost_above_272k_tokens": 8.8e-07, + "cache_read_input_token_cost_above_272k_tokens_priority": 1.76e-06, + "cache_read_input_token_cost_priority": 8.8e-07, + "input_cost_per_token": 4.4e-06, + "input_cost_per_token_above_272k_tokens": 8.8e-06, + "input_cost_per_token_above_272k_tokens_priority": 1.76e-05, + "input_cost_per_token_priority": 8.8e-06, + "litellm_provider": "azure", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.2e-05, + "output_cost_per_token_above_272k_tokens": 3.3e-05, + "output_cost_per_token_above_272k_tokens_priority": 6.6e-05, + "output_cost_per_token_priority": 4.4e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_none_reasoning_effort": true, + "supports_xhigh_reasoning_effort": true, + "supports_minimal_reasoning_effort": false + }, + "azure/us/gpt-5.6-sol": { + "cache_creation_input_token_cost": 5.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 1.1e-05, + "cache_creation_input_token_cost_above_272k_tokens_priority": 2.2e-05, + "cache_creation_input_token_cost_priority": 1.1e-05, + "cache_read_input_token_cost": 4.4e-07, + "cache_read_input_token_cost_above_272k_tokens": 8.8e-07, + "cache_read_input_token_cost_above_272k_tokens_priority": 1.76e-06, + "cache_read_input_token_cost_priority": 8.8e-07, + "deprecation_date": "2028-01-11", + "input_cost_per_token": 4.4e-06, + "input_cost_per_token_above_272k_tokens": 8.8e-06, + "input_cost_per_token_above_272k_tokens_priority": 1.76e-05, + "input_cost_per_token_priority": 8.8e-06, + "litellm_provider": "azure", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.2e-05, + "output_cost_per_token_above_272k_tokens": 3.3e-05, + "output_cost_per_token_above_272k_tokens_priority": 6.6e-05, + "output_cost_per_token_priority": 4.4e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_none_reasoning_effort": true, + "supports_xhigh_reasoning_effort": true, + "supports_minimal_reasoning_effort": false + }, + "azure/us/gpt-5.6-terra": { + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5.5e-06, + "cache_creation_input_token_cost_above_272k_tokens_priority": 1.1e-05, + "cache_creation_input_token_cost_priority": 5.5e-06, + "cache_read_input_token_cost": 2.2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4.4e-07, + "cache_read_input_token_cost_above_272k_tokens_priority": 8.8e-07, + "cache_read_input_token_cost_priority": 4.4e-07, + "deprecation_date": "2028-01-11", + "input_cost_per_token": 2.2e-06, + "input_cost_per_token_above_272k_tokens": 4.4e-06, + "input_cost_per_token_above_272k_tokens_priority": 8.8e-06, + "input_cost_per_token_priority": 4.4e-06, + "litellm_provider": "azure", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 1.32e-05, + "output_cost_per_token_above_272k_tokens": 1.98e-05, + "output_cost_per_token_above_272k_tokens_priority": 3.96e-05, + "output_cost_per_token_priority": 2.64e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_none_reasoning_effort": true, + "supports_xhigh_reasoning_effort": true, + "supports_minimal_reasoning_effort": false + }, + "azure/us/gpt-5.6-luna": { + "cache_creation_input_token_cost": 2.75e-07, + "cache_creation_input_token_cost_above_272k_tokens": 5.5e-07, + "cache_creation_input_token_cost_above_272k_tokens_priority": 1.1e-06, + "cache_creation_input_token_cost_priority": 5.5e-07, + "cache_read_input_token_cost": 2.2e-08, + "cache_read_input_token_cost_above_272k_tokens": 4.4e-08, + "cache_read_input_token_cost_above_272k_tokens_priority": 8.8e-08, + "cache_read_input_token_cost_priority": 4.4e-08, + "deprecation_date": "2028-01-11", + "input_cost_per_token": 2.2e-07, + "input_cost_per_token_above_272k_tokens": 4.4e-07, + "input_cost_per_token_above_272k_tokens_priority": 8.8e-07, + "input_cost_per_token_priority": 4.4e-07, + "litellm_provider": "azure", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 1.32e-06, + "output_cost_per_token_above_272k_tokens": 1.98e-06, + "output_cost_per_token_above_272k_tokens_priority": 3.96e-06, + "output_cost_per_token_priority": 2.64e-06, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_none_reasoning_effort": true, + "supports_xhigh_reasoning_effort": true, + "supports_minimal_reasoning_effort": false + }, + "azure/us/gpt-6-astra": { + "deprecation_date": "2028-01-11", + "cache_creation_input_token_cost": 1.375e-05, + "cache_creation_input_token_cost_above_272k_tokens": 2.75e-05, + "cache_read_input_token_cost": 1.1e-06, + "cache_read_input_token_cost_above_272k_tokens": 2.2e-06, + "input_cost_per_token": 1.1e-05, + "input_cost_per_token_above_272k_tokens": 2.2e-05, + "litellm_provider": "azure", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 5.5e-05, + "output_cost_per_token_above_272k_tokens": 8.25e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": false, + "supports_minimal_reasoning_effort": false, + "supports_native_streaming": true, + "supports_none_reasoning_effort": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_xhigh_reasoning_effort": true + }, + "azure/us/gpt-6-luna": { + "deprecation_date": "2028-03-11", + "cache_creation_input_token_cost": 1.375e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.75e-07, + "cache_read_input_token_cost": 1.1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2.2e-08, + "input_cost_per_token": 1.1e-07, + "input_cost_per_token_above_272k_tokens": 2.2e-07, + "litellm_provider": "azure", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 5.5e-07, + "output_cost_per_token_above_272k_tokens": 8.25e-07, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://azure.microsoft.com/en-us/blog/gpt-6-astra-sol-and-luna-for-production-agents-in-microsoft-foundry/", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_native_streaming": true, + "supports_none_reasoning_effort": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_xhigh_reasoning_effort": true + }, + "azure/us/gpt-6-sol": { + "deprecation_date": "2028-03-11", + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5.5e-06, + "cache_read_input_token_cost": 2.2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4.4e-07, + "input_cost_per_token": 2.2e-06, + "input_cost_per_token_above_272k_tokens": 4.4e-06, + "litellm_provider": "azure", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 1.1e-05, + "output_cost_per_token_above_272k_tokens": 1.65e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://azure.microsoft.com/en-us/blog/gpt-6-astra-sol-and-luna-for-production-agents-in-microsoft-foundry/", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_native_streaming": true, + "supports_none_reasoning_effort": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_xhigh_reasoning_effort": true + }, + "azure/us/gpt-chat-latest": { "cache_read_input_token_cost": 5.5e-07, - "cache_read_input_token_cost_above_272k_tokens": 1.1e-06, - "cache_read_input_token_cost_above_272k_tokens_priority": 2.2e-06, - "cache_read_input_token_cost_priority": 1.1e-06, + "deprecation_date": "2026-12-02", "input_cost_per_token": 5.5e-06, - "input_cost_per_token_above_272k_tokens": 1.1e-05, - "input_cost_per_token_above_272k_tokens_priority": 2.2e-05, - "input_cost_per_token_priority": 1.1e-05, "litellm_provider": "azure", - "max_input_tokens": 922000, + "max_input_tokens": 272000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 3.3e-05, - "output_cost_per_token_above_272k_tokens": 4.95e-05, - "output_cost_per_token_above_272k_tokens_priority": 9.9e-05, - "output_cost_per_token_priority": 6.6e-05, + "reasoning_effort_levels": [ + "medium" + ], + "source": "https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, + "azure/eu/gpt-5.6": { + "cache_creation_input_token_cost": 5.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 1.1e-05, + "cache_creation_input_token_cost_above_272k_tokens_priority": 2.2e-05, + "cache_creation_input_token_cost_priority": 1.1e-05, + "cache_read_input_token_cost": 4.4e-07, + "cache_read_input_token_cost_above_272k_tokens": 8.8e-07, + "cache_read_input_token_cost_above_272k_tokens_priority": 1.76e-06, + "cache_read_input_token_cost_priority": 8.8e-07, + "input_cost_per_token": 4.4e-06, + "input_cost_per_token_above_272k_tokens": 8.8e-06, + "input_cost_per_token_above_272k_tokens_priority": 1.76e-05, + "input_cost_per_token_priority": 8.8e-06, + "litellm_provider": "azure", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.2e-05, + "output_cost_per_token_above_272k_tokens": 3.3e-05, + "output_cost_per_token_above_272k_tokens_priority": 6.6e-05, + "output_cost_per_token_priority": 4.4e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -8625,23 +9371,27 @@ "deprecation_date": "2027-10-26", "cache_read_input_token_cost": 5e-07, "cache_read_input_token_cost_above_272k_tokens": 1e-06, + "cache_read_input_token_cost_above_272k_tokens_batches": 5e-07, "cache_read_input_token_cost_priority": 1.25e-06, "cache_read_input_token_cost_above_272k_tokens_priority": 2e-06, + "cache_read_input_token_cost_batches": 2.5e-07, "cache_read_input_token_cost_flex": 2.5e-07, "input_cost_per_token": 5e-06, "input_cost_per_token_above_272k_tokens": 1e-05, + "input_cost_per_token_above_272k_tokens_batches": 5e-06, "input_cost_per_token_above_272k_tokens_flex": 5e-06, "input_cost_per_token_priority": 1.25e-05, "input_cost_per_token_above_272k_tokens_priority": 2e-05, "input_cost_per_token_batches": 2.5e-06, "input_cost_per_token_flex": 2.5e-06, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 3e-05, "output_cost_per_token_above_272k_tokens": 4.5e-05, + "output_cost_per_token_above_272k_tokens_batches": 2.25e-05, "output_cost_per_token_priority": 7.5e-05, "output_cost_per_token_above_272k_tokens_priority": 9e-05, "output_cost_per_token_batches": 1.5e-05, @@ -8682,19 +9432,23 @@ "deprecation_date": "2027-10-26", "cache_read_input_token_cost": 5.5e-07, "cache_read_input_token_cost_above_272k_tokens": 1.1e-06, + "cache_read_input_token_cost_above_272k_tokens_batches": 5.5e-07, + "cache_read_input_token_cost_batches": 2.75e-07, "cache_read_input_token_cost_priority": 1.375e-06, "input_cost_per_token": 5.5e-06, "input_cost_per_token_above_272k_tokens": 1.1e-05, + "input_cost_per_token_above_272k_tokens_batches": 5.5e-06, "input_cost_per_token_batches": 2.75e-06, "input_cost_per_token_priority": 1.375e-05, "output_cost_per_token": 3.3e-05, "output_cost_per_token_above_272k_tokens": 4.95e-05, "output_cost_per_token_priority": 8.25e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", + "output_cost_per_token_above_272k_tokens_batches": 2.475e-05, "output_cost_per_token_batches": 1.65e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, @@ -8733,19 +9487,23 @@ "deprecation_date": "2027-10-26", "cache_read_input_token_cost": 5.5e-07, "cache_read_input_token_cost_above_272k_tokens": 1.1e-06, + "cache_read_input_token_cost_above_272k_tokens_batches": 5.5e-07, + "cache_read_input_token_cost_batches": 2.75e-07, "cache_read_input_token_cost_priority": 1.375e-06, "input_cost_per_token": 5.5e-06, "input_cost_per_token_above_272k_tokens": 1.1e-05, + "input_cost_per_token_above_272k_tokens_batches": 5.5e-06, "input_cost_per_token_batches": 2.75e-06, "input_cost_per_token_priority": 1.375e-05, "output_cost_per_token": 3.3e-05, "output_cost_per_token_above_272k_tokens": 4.95e-05, "output_cost_per_token_priority": 8.25e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", + "output_cost_per_token_above_272k_tokens_batches": 2.475e-05, "output_cost_per_token_batches": 1.65e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, @@ -8783,15 +9541,17 @@ "azure/gpt-5.5-2026-04-23": { "cache_read_input_token_cost": 5e-07, "cache_read_input_token_cost_above_272k_tokens": 1e-06, + "cache_read_input_token_cost_above_272k_tokens_batches": 5e-07, "cache_read_input_token_cost_priority": 1.25e-06, "cache_read_input_token_cost_above_272k_tokens_priority": 2e-06, + "cache_read_input_token_cost_batches": 2.5e-07, "cache_read_input_token_cost_flex": 2.5e-07, "input_cost_per_token": 5e-06, "input_cost_per_token_above_272k_tokens": 1e-05, "input_cost_per_token_priority": 1.25e-05, "input_cost_per_token_above_272k_tokens_priority": 2e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -8828,9 +9588,11 @@ "supports_vision": true, "supports_web_search": true, "deprecation_date": "2027-10-26", + "input_cost_per_token_above_272k_tokens_batches": 5e-06, "input_cost_per_token_above_272k_tokens_flex": 5e-06, "input_cost_per_token_batches": 2.5e-06, "input_cost_per_token_flex": 2.5e-06, + "output_cost_per_token_above_272k_tokens_batches": 2.25e-05, "output_cost_per_token_batches": 1.5e-05, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, @@ -8849,7 +9611,7 @@ "input_cost_per_token_above_272k_tokens_priority": 2e-05, "input_cost_per_token_flex": 2.5e-06, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -8889,11 +9651,17 @@ "supports_none_reasoning_effort": true, "supports_xhigh_reasoning_effort": true, "supports_minimal_reasoning_effort": false, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "cache_read_input_token_cost_above_272k_tokens_batches": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, + "input_cost_per_token_above_272k_tokens_batches": 5e-06, + "output_cost_per_token_above_272k_tokens_batches": 2.25e-05 }, "azure/us/gpt-5.5-2026-04-23": { "cache_read_input_token_cost": 5.5e-07, "cache_read_input_token_cost_above_272k_tokens": 1.1e-06, + "cache_read_input_token_cost_above_272k_tokens_batches": 5.5e-07, + "cache_read_input_token_cost_batches": 2.75e-07, "cache_read_input_token_cost_priority": 1.375e-06, "input_cost_per_token": 5.5e-06, "input_cost_per_token_above_272k_tokens": 1.1e-05, @@ -8902,7 +9670,7 @@ "output_cost_per_token_above_272k_tokens": 4.95e-05, "output_cost_per_token_priority": 8.25e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -8935,7 +9703,9 @@ "supports_vision": true, "supports_web_search": true, "deprecation_date": "2027-10-26", + "input_cost_per_token_above_272k_tokens_batches": 5.5e-06, "input_cost_per_token_batches": 2.75e-06, + "output_cost_per_token_above_272k_tokens_batches": 2.475e-05, "output_cost_per_token_batches": 1.65e-05, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, @@ -8953,7 +9723,7 @@ "output_cost_per_token_above_272k_tokens": 4.95e-05, "output_cost_per_token_priority": 8.25e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -8988,11 +9758,17 @@ "supports_none_reasoning_effort": true, "supports_xhigh_reasoning_effort": true, "supports_minimal_reasoning_effort": false, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "cache_read_input_token_cost_above_272k_tokens_batches": 5.5e-07, + "cache_read_input_token_cost_batches": 2.75e-07, + "input_cost_per_token_above_272k_tokens_batches": 5.5e-06, + "output_cost_per_token_above_272k_tokens_batches": 2.475e-05 }, "azure/eu/gpt-5.5-2026-04-23": { "cache_read_input_token_cost": 5.5e-07, "cache_read_input_token_cost_above_272k_tokens": 1.1e-06, + "cache_read_input_token_cost_above_272k_tokens_batches": 5.5e-07, + "cache_read_input_token_cost_batches": 2.75e-07, "cache_read_input_token_cost_priority": 1.375e-06, "input_cost_per_token": 5.5e-06, "input_cost_per_token_above_272k_tokens": 1.1e-05, @@ -9001,7 +9777,7 @@ "output_cost_per_token_above_272k_tokens": 4.95e-05, "output_cost_per_token_priority": 8.25e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -9034,7 +9810,9 @@ "supports_vision": true, "supports_web_search": true, "deprecation_date": "2027-10-26", + "input_cost_per_token_above_272k_tokens_batches": 5.5e-06, "input_cost_per_token_batches": 2.75e-06, + "output_cost_per_token_above_272k_tokens_batches": 2.475e-05, "output_cost_per_token_batches": 1.65e-05, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, @@ -9052,7 +9830,7 @@ "output_cost_per_token_above_272k_tokens": 4.95e-05, "output_cost_per_token_priority": 8.25e-05, "litellm_provider": "azure", - "max_input_tokens": 1050000, + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", @@ -9087,7 +9865,11 @@ "supports_none_reasoning_effort": true, "supports_xhigh_reasoning_effort": true, "supports_minimal_reasoning_effort": false, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "cache_read_input_token_cost_above_272k_tokens_batches": 5.5e-07, + "cache_read_input_token_cost_batches": 2.75e-07, + "input_cost_per_token_above_272k_tokens_batches": 5.5e-06, + "output_cost_per_token_above_272k_tokens_batches": 2.475e-05 }, "azure/gpt-5.5-pro": { "cache_read_input_token_cost": 3e-06, @@ -9176,6 +9958,7 @@ "azure/gpt-5.4-mini": { "deprecation_date": "2027-09-21", "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, "cache_read_input_token_cost_flex": 3.75e-08, "cache_read_input_token_cost_priority": 1.5e-07, "input_cost_per_token": 7.5e-07, @@ -9273,11 +10056,13 @@ "output_cost_per_token_flex": 2.25e-06, "output_cost_per_token_priority": 9e-06, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_xhigh_reasoning_effort": true + "supports_xhigh_reasoning_effort": true, + "cache_read_input_token_cost_batches": 3.75e-08 }, "azure/gpt-5.4-nano": { "deprecation_date": "2027-09-21", "cache_read_input_token_cost": 2e-08, + "cache_read_input_token_cost_batches": 1e-08, "cache_read_input_token_cost_flex": 1e-08, "input_cost_per_token": 2e-07, "litellm_provider": "azure", @@ -9369,7 +10154,8 @@ "output_cost_per_token_batches": 6.25e-07, "output_cost_per_token_flex": 6.25e-07, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_xhigh_reasoning_effort": true + "supports_xhigh_reasoning_effort": true, + "cache_read_input_token_cost_batches": 1e-08 }, "azure/gpt-image-1": { "cache_read_input_token_cost": 1.25e-06, @@ -9772,39 +10558,6 @@ "supports_reasoning": true, "supports_vision": false }, - "azure/o1-preview": { - "cache_read_input_token_cost": 7.5e-06, - "input_cost_per_token": 1.5e-05, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 6e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_vision": false - }, - "azure/o1-preview-2024-09-12": { - "cache_read_input_token_cost": 7.5e-06, - "input_cost_per_token": 1.5e-05, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 6e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_vision": false - }, "azure/o3": { "deprecation_date": "2026-11-19", "cache_read_input_token_cost": 5e-07, @@ -10358,12 +11111,13 @@ "input_cost_per_audio_token": 4.4e-05, "input_cost_per_token": 5.5e-06, "litellm_provider": "azure", - "max_input_tokens": 128000, + "max_input_tokens": 16000, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "realtime", "output_cost_per_audio_token": 8e-05, "output_cost_per_token": 2.2e-05, + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure", "supported_modalities": [ "text", "audio" @@ -10416,7 +11170,8 @@ "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "cache_read_input_token_cost_batches": 6.875e-08 }, "azure/us/gpt-5-mini-2025-08-07": { "cache_read_input_token_cost": 2.75e-08, @@ -10455,7 +11210,8 @@ "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "cache_read_input_token_cost_batches": 1.375e-08 }, "azure/us/gpt-5-nano-2025-08-07": { "cache_read_input_token_cost": 5.5e-09, @@ -10491,11 +11247,13 @@ "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "cache_read_input_token_cost_batches": 2.75e-09 }, "azure/us/gpt-5.1": { "deprecation_date": "2027-05-15", "cache_read_input_token_cost": 1.375e-07, + "cache_read_input_token_cost_batches": 6.875e-08, "cache_read_input_token_cost_priority": 2.75e-07, "input_cost_per_token": 1.375e-06, "litellm_provider": "azure", @@ -10535,43 +11293,6 @@ "output_cost_per_token_priority": 2.2e-05, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "azure/us/gpt-5.1-chat": { - "cache_read_input_token_cost": 1.375e-07, - "deprecation_date": "2026-06-29", - "input_cost_per_token": 1.375e-06, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 1.1e-05, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/batch", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text", - "image" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_none_reasoning_effort": true, - "default_reasoning_effort": "none", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" - }, "azure/us/gpt-5.1-codex": { "deprecation_date": "2027-05-15", "cache_read_input_token_cost": 1.375e-07, @@ -10672,21 +11393,6 @@ "supports_prompt_caching": true, "supports_vision": false }, - "azure/us/o1-preview-2024-09-12": { - "cache_read_input_token_cost": 8.25e-06, - "input_cost_per_token": 1.65e-05, - "litellm_provider": "azure", - "max_input_tokens": 128000, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 6.6e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_vision": false - }, "azure/us/o3-2025-04-16": { "deprecation_date": "2026-11-19", "cache_read_input_token_cost": 5.5e-07, @@ -10810,6 +11516,8 @@ }, "azure_ai/FLUX-1.1-pro": { "litellm_provider": "azure_ai", + "max_input_tokens": 5000, + "max_tokens": 5000, "mode": "image_generation", "output_cost_per_image": 0.04, "source": "https://techcommunity.microsoft.com/blog/azure-ai-foundry-blog/black-forest-labs-flux-1-kontext-pro-and-flux1-1-pro-now-available-in-azure-ai-f/4434659", @@ -10819,9 +11527,11 @@ }, "azure_ai/FLUX.1-Kontext-pro": { "litellm_provider": "azure_ai", + "max_input_tokens": 5000, + "max_tokens": 5000, "mode": "image_generation", "output_cost_per_image": 0.04, - "source": "https://marketplace.microsoft.com/pt-br/marketplace/apps/cohere.cohere-embed-4-offer?tab=PlansAndPrice", + "source": "https://azure.microsoft.com/en-us/pricing/details/ai-foundry-models/black-forest-labs/", "supported_endpoints": [ "/v1/images/generations" ] @@ -11151,7 +11861,7 @@ "input_cost_per_token": 5e-06, "litellm_provider": "azure_ai", "mode": "image_generation", - "output_cost_per_image": 0.05, + "output_cost_per_image": 0.048, "output_cost_per_image_token": 4.7e-05, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supported_endpoints": [ @@ -11165,8 +11875,8 @@ "input_cost_per_token": 1.75e-06, "litellm_provider": "azure_ai", "mode": "image_generation", - "output_cost_per_image": 0.0338, - "output_cost_per_image_token": 3.3e-05, + "output_cost_per_image": 0.02, + "output_cost_per_image_token": 1.95e-05, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supported_endpoints": [ "/v1/images/generations", @@ -11175,6 +11885,7 @@ "deprecation_date": "2026-10-01" }, "azure_ai/MAI-Image-2.5-Pro": { + "deprecation_date": "2026-10-01", "input_cost_per_image_token": 8e-06, "input_cost_per_token": 5e-06, "litellm_provider": "azure_ai", @@ -11187,18 +11898,6 @@ "/v1/images/edits" ] }, - "azure_ai/MAI-Image-2e": { - "deprecation_date": "2026-08-15", - "input_cost_per_token": 5e-06, - "litellm_provider": "azure_ai", - "mode": "image_generation", - "output_cost_per_image": 0.02, - "output_cost_per_image_token": 1.95e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supported_endpoints": [ - "/v1/images/generations" - ] - }, "azure_ai/MAI-Thinking-1": { "cache_read_input_token_cost": 2e-07, "input_cost_per_token": 2e-06, @@ -11223,43 +11922,15 @@ "supports_reasoning": true, "supports_tool_choice": true }, - "azure_ai/Llama-3.2-11B-Vision-Instruct": { - "deprecation_date": "2026-06-13", - "input_cost_per_token": 3.7e-07, - "litellm_provider": "azure_ai", - "max_input_tokens": 128000, - "max_output_tokens": 2048, - "max_tokens": 2048, - "mode": "chat", - "output_cost_per_token": 3.7e-07, - "source": "https://marketplace.microsoft.com/en/marketplace/apps/metagenai.meta-llama-3-2-11b-vision-instruct-offer?tab=Overview", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "azure_ai/Llama-3.2-90B-Vision-Instruct": { - "deprecation_date": "2026-06-13", - "input_cost_per_token": 2.04e-06, - "litellm_provider": "azure_ai", - "max_input_tokens": 128000, - "max_output_tokens": 2048, - "max_tokens": 2048, - "mode": "chat", - "output_cost_per_token": 2.04e-06, - "source": "https://marketplace.microsoft.com/en/marketplace/apps/metagenai.meta-llama-3-2-90b-vision-instruct-offer?tab=Overview", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true - }, "azure_ai/Llama-3.3-70B-Instruct": { "input_cost_per_token": 7.1e-07, "litellm_provider": "azure_ai", "max_input_tokens": 128000, - "max_output_tokens": 2048, - "max_tokens": 2048, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 7.1e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure", "supports_function_calling": true, "supports_tool_choice": true }, @@ -11267,8 +11938,8 @@ "input_cost_per_token": 2.5e-07, "litellm_provider": "azure_ai", "max_input_tokens": 1000000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", "output_cost_per_token": 1e-06, "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", @@ -11290,6 +11961,7 @@ "supports_vision": true }, "azure_ai/Meta-Llama-3-70B-Instruct": { + "deprecation_date": "2025-06-30", "input_cost_per_token": 1.1e-06, "litellm_provider": "azure_ai", "max_input_tokens": 8192, @@ -11297,21 +11969,11 @@ "max_tokens": 2048, "mode": "chat", "output_cost_per_token": 3.7e-07, - "supports_tool_choice": true - }, - "azure_ai/Meta-Llama-3.1-405B-Instruct": { - "deprecation_date": "2026-06-13", - "input_cost_per_token": 5.33e-06, - "litellm_provider": "azure_ai", - "max_input_tokens": 128000, - "max_output_tokens": 2048, - "max_tokens": 2048, - "mode": "chat", - "output_cost_per_token": 1.6e-05, - "source": "https://marketplace.microsoft.com/en-us/marketplace/apps/metagenai.meta-llama-3-1-405b-instruct-offer?tab=PlansAndPrice", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true }, "azure_ai/Meta-Llama-3.1-70B-Instruct": { + "deprecation_date": "2025-06-30", "input_cost_per_token": 2.68e-06, "litellm_provider": "azure_ai", "max_input_tokens": 128000, @@ -11319,22 +11981,11 @@ "max_tokens": 2048, "mode": "chat", "output_cost_per_token": 3.54e-06, - "source": "https://marketplace.microsoft.com/en-us/marketplace/apps/metagenai.meta-llama-3-1-70b-instruct-offer?tab=PlansAndPrice", - "supports_tool_choice": true - }, - "azure_ai/Meta-Llama-3.1-8B-Instruct": { - "deprecation_date": "2026-06-13", - "input_cost_per_token": 3e-07, - "litellm_provider": "azure_ai", - "max_input_tokens": 128000, - "max_output_tokens": 2048, - "max_tokens": 2048, - "mode": "chat", - "output_cost_per_token": 6.1e-07, - "source": "https://marketplace.microsoft.com/en-us/marketplace/apps/metagenai.meta-llama-3-1-8b-instruct-offer?tab=PlansAndPrice", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true }, "azure_ai/Phi-3-medium-128k-instruct": { + "deprecation_date": "2025-08-30", "input_cost_per_token": 1.7e-07, "litellm_provider": "azure_ai", "max_input_tokens": 128000, @@ -11342,11 +11993,12 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 6.8e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true, "supports_vision": false }, "azure_ai/Phi-3-medium-4k-instruct": { + "deprecation_date": "2025-08-30", "input_cost_per_token": 1.7e-07, "litellm_provider": "azure_ai", "max_input_tokens": 4096, @@ -11354,11 +12006,12 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 6.8e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true, "supports_vision": false }, "azure_ai/Phi-3-mini-128k-instruct": { + "deprecation_date": "2025-08-30", "input_cost_per_token": 1.3e-07, "litellm_provider": "azure_ai", "max_input_tokens": 128000, @@ -11366,11 +12019,12 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 5.2e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true, "supports_vision": false }, "azure_ai/Phi-3-mini-4k-instruct": { + "deprecation_date": "2025-08-30", "input_cost_per_token": 1.3e-07, "litellm_provider": "azure_ai", "max_input_tokens": 4096, @@ -11378,11 +12032,12 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 5.2e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true, "supports_vision": false }, "azure_ai/Phi-3-small-128k-instruct": { + "deprecation_date": "2025-08-30", "input_cost_per_token": 1.5e-07, "litellm_provider": "azure_ai", "max_input_tokens": 128000, @@ -11390,11 +12045,12 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 6e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true, "supports_vision": false }, "azure_ai/Phi-3-small-8k-instruct": { + "deprecation_date": "2025-08-30", "input_cost_per_token": 1.5e-07, "litellm_provider": "azure_ai", "max_input_tokens": 8192, @@ -11402,11 +12058,12 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 6e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true, "supports_vision": false }, "azure_ai/Phi-3.5-MoE-instruct": { + "deprecation_date": "2025-08-30", "input_cost_per_token": 1.6e-07, "litellm_provider": "azure_ai", "max_input_tokens": 128000, @@ -11414,11 +12071,12 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 6.4e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true, "supports_vision": false }, "azure_ai/Phi-3.5-mini-instruct": { + "deprecation_date": "2025-08-30", "input_cost_per_token": 1.3e-07, "litellm_provider": "azure_ai", "max_input_tokens": 128000, @@ -11426,11 +12084,12 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 5.2e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true, "supports_vision": false }, "azure_ai/Phi-3.5-vision-instruct": { + "deprecation_date": "2025-08-30", "input_cost_per_token": 1.3e-07, "litellm_provider": "azure_ai", "max_input_tokens": 128000, @@ -11438,7 +12097,7 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 5.2e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true, "supports_vision": true }, @@ -11504,16 +12163,6 @@ "supports_tool_choice": true, "supports_reasoning": true }, - "azure_ai/mistral-document-ai-2505": { - "deprecation_date": "2026-07-20", - "litellm_provider": "azure_ai", - "ocr_cost_per_page": 0.003, - "mode": "ocr", - "supported_endpoints": [ - "/v1/ocr" - ], - "source": "https://devblogs.microsoft.com/foundry/whats-new-in-azure-ai-foundry-august-2025/#mistral-document-ai-(ocr)-%E2%80%94-serverless-in-foundry" - }, "azure_ai/mistral-document-ai-2512": { "litellm_provider": "azure_ai", "ocr_cost_per_page": 0.003, @@ -11583,6 +12232,7 @@ "source": "https://azure.microsoft.com/en-us/pricing/details/ai-document-intelligence/" }, "azure_ai/MAI-DS-R1": { + "deprecation_date": "2026-02-27", "input_cost_per_token": 1.35e-06, "litellm_provider": "azure_ai", "max_input_tokens": 128000, @@ -11590,11 +12240,12 @@ "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 5.4e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_reasoning": true, "supports_tool_choice": true }, "azure_ai/cohere-rerank-v3-english": { + "deprecation_date": "2025-06-30", "input_cost_per_query": 0.002, "input_cost_per_token": 0.0, "litellm_provider": "azure_ai", @@ -11602,9 +12253,11 @@ "max_output_tokens": 4096, "max_tokens": 4096, "mode": "rerank", - "output_cost_per_token": 0.0 + "output_cost_per_token": 0.0, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models" }, "azure_ai/cohere-rerank-v3-multilingual": { + "deprecation_date": "2025-06-30", "input_cost_per_query": 0.002, "input_cost_per_token": 0.0, "litellm_provider": "azure_ai", @@ -11612,18 +12265,8 @@ "max_output_tokens": 4096, "max_tokens": 4096, "mode": "rerank", - "output_cost_per_token": 0.0 - }, - "azure_ai/cohere-rerank-v3.5": { - "deprecation_date": "2026-05-14", - "input_cost_per_query": 0.002, - "input_cost_per_token": 0.0, - "litellm_provider": "azure_ai", - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "rerank", - "output_cost_per_token": 0.0 + "output_cost_per_token": 0.0, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models" }, "azure_ai/cohere-rerank-v4.0-pro": { "input_cost_per_query": 0.0025, @@ -11650,12 +12293,12 @@ "azure_ai/deepseek-v3.2": { "input_cost_per_token": 5.8e-07, "litellm_provider": "azure_ai", - "max_input_tokens": 163840, - "max_output_tokens": 163840, - "max_tokens": 163840, + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 1.68e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure", "supports_assistant_prefill": true, "supports_function_calling": true, "supports_prompt_caching": true, @@ -11665,32 +12308,20 @@ "azure_ai/deepseek-v3.2-speciale": { "input_cost_per_token": 5.8e-07, "litellm_provider": "azure_ai", - "max_input_tokens": 163840, - "max_output_tokens": 163840, - "max_tokens": 163840, + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 1.68e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure", "supports_assistant_prefill": true, "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_tool_choice": true }, - "azure_ai/deepseek-r1": { - "deprecation_date": "2026-08-13", - "input_cost_per_token": 1.35e-06, - "litellm_provider": "azure_ai", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 5.4e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_reasoning": true, - "supports_tool_choice": true - }, "azure_ai/deepseek-v3": { + "deprecation_date": "2025-08-31", "input_cost_per_token": 1.14e-06, "litellm_provider": "azure_ai", "max_input_tokens": 128000, @@ -11698,34 +12329,7 @@ "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 4.56e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_tool_choice": true - }, - "azure_ai/deepseek-v3-0324": { - "deprecation_date": "2026-07-13", - "input_cost_per_token": 1.14e-06, - "litellm_provider": "azure_ai", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 4.56e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_tool_choice": true - }, - "azure_ai/deepseek-v3.1": { - "deprecation_date": "2026-07-13", - "input_cost_per_token": 1.23e-06, - "litellm_provider": "azure_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 4.94e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_reasoning": true, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_tool_choice": true }, "azure_ai/deepseek-v4-pro": { @@ -11766,11 +12370,11 @@ "input_cost_per_token": 4.4e-07, "litellm_provider": "azure_ai", "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", "output_cost_per_token": 1.32e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, @@ -11792,79 +12396,18 @@ "text", "image" ], - "supports_embedding_image_input": true - }, - "azure_ai/global/grok-3": { - "deprecation_date": "2026-05-01", - "input_cost_per_token": 3e-06, - "litellm_provider": "azure_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_response_schema": false, - "supports_tool_choice": true, - "supports_web_search": true - }, - "azure_ai/global/grok-3-mini": { - "deprecation_date": "2026-05-01", - "input_cost_per_token": 2.5e-07, - "litellm_provider": "azure_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 1.27e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_tool_choice": true, - "supports_web_search": true - }, - "azure_ai/grok-3": { - "deprecation_date": "2026-05-01", - "input_cost_per_token": 3e-06, - "litellm_provider": "azure_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_response_schema": false, - "supports_tool_choice": true, - "supports_web_search": true - }, - "azure_ai/grok-3-mini": { - "deprecation_date": "2026-05-01", - "input_cost_per_token": 2.5e-07, - "litellm_provider": "azure_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 1.27e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_tool_choice": true, - "supports_web_search": true + "supports_embedding_image_input": true, + "input_cost_per_image_token": 4.7e-07 }, "azure_ai/grok-4": { "input_cost_per_token": 3e-06, "litellm_provider": "azure_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 262000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 1.5e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure", "supports_function_calling": true, "supports_response_schema": true, "supports_tool_choice": true, @@ -11877,12 +12420,12 @@ "input_cost_per_token_above_200k_tokens": 2.5e-06, "litellm_provider": "azure_ai", "max_input_tokens": 200000, - "max_output_tokens": 200000, - "max_tokens": 200000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 2.5e-06, "output_cost_per_token_above_200k_tokens": 5e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, @@ -11894,7 +12437,7 @@ "azure_ai/grok-4.6": { "cache_read_input_token_cost": 5e-07, "cache_read_input_token_cost_above_200k_tokens": 1e-06, - "input_cost_per_token": 2e-06, + "input_cost_per_token": 1.25e-06, "input_cost_per_token_above_200k_tokens": 4e-06, "litellm_provider": "azure_ai", "max_input_tokens": 200000, @@ -11903,7 +12446,7 @@ "mode": "chat", "output_cost_per_token": 6e-06, "output_cost_per_token_above_200k_tokens": 1.2e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://azure.microsoft.com/en-us/pricing/details/ai-foundry-models/grok/", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, @@ -11949,43 +12492,13 @@ "supports_vision": true, "supports_web_search": true }, - "azure_ai/grok-4-fast-non-reasoning": { - "deprecation_date": "2026-05-01", - "input_cost_per_token": 2e-07, - "output_cost_per_token": 5e-07, - "litellm_provider": "azure_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_web_search": true - }, - "azure_ai/grok-4-fast-reasoning": { - "deprecation_date": "2026-05-01", - "input_cost_per_token": 2e-07, - "output_cost_per_token": 5e-07, - "litellm_provider": "azure_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_web_search": true - }, "azure_ai/grok-4-1-fast-non-reasoning": { "input_cost_per_token": 2e-07, "output_cost_per_token": 5e-07, "litellm_provider": "azure_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_function_calling": true, @@ -11997,9 +12510,9 @@ "input_cost_per_token": 2e-07, "output_cost_per_token": 5e-07, "litellm_provider": "azure_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_function_calling": true, @@ -12011,18 +12524,19 @@ "azure_ai/grok-code-fast-1": { "input_cost_per_token": 2e-07, "litellm_provider": "azure_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 256000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 1.5e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "source": "https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure", "supports_function_calling": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_web_search": true }, "azure_ai/jais-30b-chat": { + "deprecation_date": "2026-01-30", "input_cost_per_token": 0.0032, "litellm_provider": "azure_ai", "max_input_tokens": 8192, @@ -12030,7 +12544,7 @@ "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 0.00971, - "source": "https://ai.azure.com/catalog/models/jais-30b-chat" + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models" }, "azure_ai/jamba-instruct": { "input_cost_per_token": 5e-07, @@ -12096,6 +12610,7 @@ "supports_tool_choice": true }, "azure_ai/mistral-large": { + "deprecation_date": "2025-04-15", "input_cost_per_token": 4e-06, "litellm_provider": "azure_ai", "max_input_tokens": 32000, @@ -12103,10 +12618,12 @@ "max_tokens": 8191, "mode": "chat", "output_cost_per_token": 1.2e-05, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_function_calling": true, "supports_tool_choice": true }, "azure_ai/mistral-large-2407": { + "deprecation_date": "2025-05-13", "input_cost_per_token": 2e-06, "litellm_provider": "azure_ai", "max_input_tokens": 128000, @@ -12114,7 +12631,7 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 6e-06, - "source": "https://marketplace.microsoft.com/en/marketplace/apps/000-000.mistral-ai-large-2407-offer?tab=Overview", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_function_calling": true, "supports_tool_choice": true }, @@ -12156,6 +12673,7 @@ "supports_tool_choice": true }, "azure_ai/mistral-nemo": { + "deprecation_date": "2026-01-30", "input_cost_per_token": 1.5e-07, "litellm_provider": "azure_ai", "max_input_tokens": 131072, @@ -12163,10 +12681,11 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 1.5e-07, - "source": "https://marketplace.microsoft.com/en/marketplace/apps/000-000.mistral-nemo-12b-2407?tab=PlansAndPrice", + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_function_calling": true }, "azure_ai/mistral-small": { + "deprecation_date": "2025-07-31", "input_cost_per_token": 1e-06, "litellm_provider": "azure_ai", "max_input_tokens": 32000, @@ -12174,6 +12693,7 @@ "max_tokens": 8191, "mode": "chat", "output_cost_per_token": 3e-06, + "source": "https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/retired-models", "supports_function_calling": true, "supports_tool_choice": true }, @@ -12203,43 +12723,43 @@ "source": "https://developers.openai.com/api/docs/pricing" }, "bedrock/*/1-month-commitment/cohere.command-light-text-v14": { + "cost_per_second": 0.001902, "input_cost_per_second": 0.001902, "litellm_provider": "bedrock", "max_input_tokens": 4096, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_second": 0.001902, "supports_tool_choice": true }, "bedrock/*/1-month-commitment/cohere.command-text-v14": { + "cost_per_second": 0.011, "input_cost_per_second": 0.011, "litellm_provider": "bedrock", "max_input_tokens": 4096, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_second": 0.011, "supports_tool_choice": true }, "bedrock/*/6-month-commitment/cohere.command-light-text-v14": { + "cost_per_second": 0.0011416, "input_cost_per_second": 0.0011416, "litellm_provider": "bedrock", "max_input_tokens": 4096, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_second": 0.0011416, "supports_tool_choice": true }, "bedrock/*/6-month-commitment/cohere.command-text-v14": { + "cost_per_second": 0.0066027, "input_cost_per_second": 0.0066027, "litellm_provider": "bedrock", "max_input_tokens": 4096, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_second": 0.0066027, "supports_tool_choice": true }, "bedrock/guardrails": { @@ -12258,61 +12778,61 @@ "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ap-northeast-1/1-month-commitment/anthropic.claude-instant-v1": { + "cost_per_second": 0.01475, "input_cost_per_second": 0.01475, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.01475, "supports_tool_choice": true }, "bedrock/ap-northeast-1/1-month-commitment/anthropic.claude-v1": { + "cost_per_second": 0.0455, "input_cost_per_second": 0.0455, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, - "mode": "chat", - "output_cost_per_second": 0.0455 + "mode": "chat" }, "bedrock/ap-northeast-1/1-month-commitment/anthropic.claude-v2:1": { + "cost_per_second": 0.0455, "input_cost_per_second": 0.0455, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.0455, "supports_tool_choice": true }, "bedrock/ap-northeast-1/6-month-commitment/anthropic.claude-instant-v1": { + "cost_per_second": 0.008194, "input_cost_per_second": 0.008194, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.008194, "supports_tool_choice": true }, "bedrock/ap-northeast-1/6-month-commitment/anthropic.claude-v1": { + "cost_per_second": 0.02527, "input_cost_per_second": 0.02527, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, - "mode": "chat", - "output_cost_per_second": 0.02527 + "mode": "chat" }, "bedrock/ap-northeast-1/6-month-commitment/anthropic.claude-v2:1": { + "cost_per_second": 0.02527, "input_cost_per_second": 0.02527, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.02527, "supports_tool_choice": true }, "bedrock/ap-northeast-1/anthropic.claude-instant-v1": { @@ -12357,6 +12877,9 @@ "supports_reasoning": true, "supports_native_structured_output": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ap-northeast-1/minimax.minimax-m2.1": { @@ -12370,6 +12893,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ap-northeast-1/minimax.minimax-m2.5": { @@ -12384,6 +12910,9 @@ "supports_reasoning": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "output_cost_per_token": 1.44e-06 }, "bedrock/ap-northeast-1/moonshotai.kimi-k2-thinking": { @@ -12409,6 +12938,8 @@ "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, + "supports_audio_input": false, + "supports_response_schema": true, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ap-northeast-1/qwen.qwen3-coder-next": { @@ -12422,6 +12953,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/moonshotai.kimi-k2-thinking": { @@ -12449,7 +12983,9 @@ "supports_system_messages": true, "supports_tool_choice": true, "supports_video_input": true, - "supports_vision": true + "supports_vision": true, + "supports_audio_input": false, + "supports_response_schema": true }, "bedrock/ap-south-1/meta.llama3-70b-instruct-v1:0": { "input_cost_per_token": 3.18e-06, @@ -12481,6 +13017,9 @@ "supports_reasoning": true, "supports_native_structured_output": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ap-south-1/minimax.minimax-m2.1": { @@ -12494,6 +13033,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ap-south-1/minimax.minimax-m2.5": { @@ -12508,6 +13050,9 @@ "supports_reasoning": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "output_cost_per_token": 1.44e-06 }, "bedrock/ap-south-1/moonshotai.kimi-k2-thinking": { @@ -12533,6 +13078,8 @@ "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, + "supports_audio_input": false, + "supports_response_schema": true, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ap-south-1/qwen.qwen3-coder-next": { @@ -12546,21 +13093,27 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ap-southeast-2/minimax.minimax-m2.5": { - "input_cost_per_token": 3.09e-07, + "input_cost_per_token": 3.1e-07, "litellm_provider": "bedrock", "max_input_tokens": 1000000, "max_output_tokens": 8192, "max_tokens": 8192, "mode": "chat", - "source": "https://aws.amazon.com/bedrock/pricing/", + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, "supports_reasoning": true, "supports_system_messages": true, "supports_tool_choice": true, - "output_cost_per_token": 1.236e-06 + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, + "output_cost_per_token": 1.24e-06 }, "bedrock/ap-southeast-3/deepseek.v3.2": { "input_cost_per_token": 7.4e-07, @@ -12574,6 +13127,9 @@ "supports_reasoning": true, "supports_native_structured_output": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ap-southeast-3/minimax.minimax-m2.1": { @@ -12587,6 +13143,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ap-southeast-3/minimax.minimax-m2.5": { @@ -12601,6 +13160,9 @@ "supports_reasoning": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "output_cost_per_token": 1.44e-06 }, "bedrock/ap-southeast-3/moonshotai.kimi-k2.5": { @@ -12615,6 +13177,8 @@ "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, + "supports_audio_input": false, + "supports_response_schema": true, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ap-southeast-3/qwen.qwen3-coder-next": { @@ -12628,6 +13192,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/ca-central-1/meta.llama3-70b-instruct-v1:0": { @@ -12660,6 +13227,9 @@ "supports_reasoning": true, "supports_native_structured_output": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/eu-north-1/minimax.minimax-m2.1": { @@ -12673,6 +13243,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/eu-north-1/minimax.minimax-m2.5": { @@ -12687,6 +13260,9 @@ "supports_reasoning": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "output_cost_per_token": 1.44e-06 }, "bedrock/eu-north-1/moonshotai.kimi-k2.5": { @@ -12701,64 +13277,66 @@ "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, + "supports_audio_input": false, + "supports_response_schema": true, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/eu-central-1/1-month-commitment/anthropic.claude-instant-v1": { + "cost_per_second": 0.01635, "input_cost_per_second": 0.01635, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.01635, "supports_tool_choice": true }, "bedrock/eu-central-1/1-month-commitment/anthropic.claude-v1": { + "cost_per_second": 0.0415, "input_cost_per_second": 0.0415, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, - "mode": "chat", - "output_cost_per_second": 0.0415 + "mode": "chat" }, "bedrock/eu-central-1/1-month-commitment/anthropic.claude-v2:1": { + "cost_per_second": 0.0415, "input_cost_per_second": 0.0415, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.0415, "supports_tool_choice": true }, "bedrock/eu-central-1/6-month-commitment/anthropic.claude-instant-v1": { + "cost_per_second": 0.009083, "input_cost_per_second": 0.009083, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.009083, "supports_tool_choice": true }, "bedrock/eu-central-1/6-month-commitment/anthropic.claude-v1": { + "cost_per_second": 0.02305, "input_cost_per_second": 0.02305, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, - "mode": "chat", - "output_cost_per_second": 0.02305 + "mode": "chat" }, "bedrock/eu-central-1/6-month-commitment/anthropic.claude-v2:1": { + "cost_per_second": 0.02305, "input_cost_per_second": 0.02305, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.02305, "supports_tool_choice": true }, "bedrock/eu-central-1/anthropic.claude-instant-v1": { @@ -12801,6 +13379,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/eu-central-1/minimax.minimax-m2.5": { @@ -12815,6 +13396,9 @@ "supports_reasoning": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "output_cost_per_token": 1.44e-06 }, "bedrock/eu-central-1/qwen.qwen3-coder-next": { @@ -12828,6 +13412,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/eu-west-1/meta.llama3-70b-instruct-v1:0": { @@ -12859,6 +13446,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/eu-west-1/minimax.minimax-m2.5": { @@ -12873,6 +13463,9 @@ "supports_reasoning": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "output_cost_per_token": 1.44e-06 }, "bedrock/eu-west-1/qwen.qwen3-coder-next": { @@ -12886,6 +13479,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/eu-west-2/meta.llama3-70b-instruct-v1:0": { @@ -12917,6 +13513,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/eu-west-2/minimax.minimax-m2.5": { @@ -12931,8 +13530,28 @@ "supports_reasoning": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "output_cost_per_token": 1.86e-06 }, + "bedrock/eu-west-2/nvidia.nemotron-super-3-120b": { + "input_cost_per_token": 2.3e-07, + "litellm_provider": "bedrock", + "max_input_tokens": 256000, + "max_output_tokens": 32000, + "max_tokens": 32000, + "mode": "chat", + "output_cost_per_token": 1.01e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": false + }, "bedrock/eu-west-2/qwen.qwen3-coder-next": { "input_cost_per_token": 7.8e-07, "litellm_provider": "bedrock", @@ -12944,6 +13563,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/eu-west-3/mistral.mistral-7b-instruct-v0:2": { @@ -12957,13 +13579,14 @@ "supports_tool_choice": true }, "bedrock/eu-west-3/mistral.mistral-large-2402-v1:0": { - "input_cost_per_token": 1.04e-05, + "input_cost_per_token": 5.2e-06, "litellm_provider": "bedrock", "max_input_tokens": 32000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_token": 3.12e-05, + "output_cost_per_token": 1.56e-05, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true }, "bedrock/eu-west-3/mistral.mixtral-8x7b-instruct-v0:1": { @@ -12987,6 +13610,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/eu-south-1/minimax.minimax-m2.5": { @@ -13001,6 +13627,9 @@ "supports_reasoning": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "output_cost_per_token": 1.44e-06 }, "bedrock/eu-south-1/qwen.qwen3-coder-next": { @@ -13014,6 +13643,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/invoke/anthropic.claude-3-5-sonnet-20240620-v1:0": { @@ -13064,6 +13696,9 @@ "supports_reasoning": true, "supports_native_structured_output": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/sa-east-1/minimax.minimax-m2.1": { @@ -13077,6 +13712,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/sa-east-1/minimax.minimax-m2.5": { @@ -13091,6 +13729,9 @@ "supports_reasoning": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "output_cost_per_token": 1.44e-06 }, "bedrock/sa-east-1/moonshotai.kimi-k2-thinking": { @@ -13116,6 +13757,8 @@ "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, + "supports_audio_input": false, + "supports_response_schema": true, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/sa-east-1/qwen.qwen3-coder-next": { @@ -13129,64 +13772,67 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-east-1/1-month-commitment/anthropic.claude-instant-v1": { + "cost_per_second": 0.011, "input_cost_per_second": 0.011, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.011, "supports_tool_choice": true }, "bedrock/us-east-1/1-month-commitment/anthropic.claude-v1": { + "cost_per_second": 0.0175, "input_cost_per_second": 0.0175, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, - "mode": "chat", - "output_cost_per_second": 0.0175 + "mode": "chat" }, "bedrock/us-east-1/1-month-commitment/anthropic.claude-v2:1": { + "cost_per_second": 0.0175, "input_cost_per_second": 0.0175, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.0175, "supports_tool_choice": true }, "bedrock/us-east-1/6-month-commitment/anthropic.claude-instant-v1": { + "cost_per_second": 0.00611, "input_cost_per_second": 0.00611, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.00611, "supports_tool_choice": true }, "bedrock/us-east-1/6-month-commitment/anthropic.claude-v1": { + "cost_per_second": 0.00972, "input_cost_per_second": 0.00972, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, - "mode": "chat", - "output_cost_per_second": 0.00972 + "mode": "chat" }, "bedrock/us-east-1/6-month-commitment/anthropic.claude-v2:1": { + "cost_per_second": 0.00972, "input_cost_per_second": 0.00972, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.00972, "supports_tool_choice": true }, "bedrock/us-east-1/anthropic.claude-instant-v1": { @@ -13248,13 +13894,14 @@ "supports_tool_choice": true }, "bedrock/us-east-1/mistral.mistral-large-2402-v1:0": { - "input_cost_per_token": 8e-06, + "input_cost_per_token": 4e-06, "litellm_provider": "bedrock", "max_input_tokens": 32000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_token": 2.4e-05, + "output_cost_per_token": 1.2e-05, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true }, "bedrock/us-east-1/mistral.mixtral-8x7b-instruct-v0:1": { @@ -13279,6 +13926,9 @@ "supports_reasoning": true, "supports_native_structured_output": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-east-1/minimax.minimax-m2.1": { @@ -13292,6 +13942,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-east-1/minimax.minimax-m2.5": { @@ -13305,6 +13958,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-east-1/moonshotai.kimi-k2-thinking": { @@ -13330,6 +13986,8 @@ "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, + "supports_audio_input": false, + "supports_response_schema": true, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-east-1/qwen.qwen3-coder-next": { @@ -13343,6 +14001,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-east-2/deepseek.v3.2": { @@ -13357,6 +14018,9 @@ "supports_reasoning": true, "supports_native_structured_output": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-east-2/minimax.minimax-m2.1": { @@ -13370,6 +14034,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-east-2/minimax.minimax-m2.5": { @@ -13384,6 +14051,9 @@ "supports_reasoning": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "output_cost_per_token": 1.2e-06 }, "bedrock/us-east-2/moonshotai.kimi-k2-thinking": { @@ -13409,6 +14079,8 @@ "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, + "supports_audio_input": false, + "supports_response_schema": true, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-east-2/qwen.qwen3-coder-next": { @@ -13422,6 +14094,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-gov-east-1/amazon.nova-pro-v1:0": { @@ -13485,40 +14160,6 @@ "mode": "chat", "output_cost_per_token": 1.5e-06 }, - "bedrock/us-gov-east-1/anthropic.claude-3-5-sonnet-20240620-v1:0": { - "deprecation_date": "2026-07-30", - "input_cost_per_token": 3.6e-06, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 1.8e-05, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 3.6e-07, - "cache_creation_input_token_cost": 4.5e-06 - }, - "bedrock/us-gov-east-1/anthropic.claude-3-haiku-20240307-v1:0": { - "deprecation_date": "2026-09-10", - "input_cost_per_token": 3e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-06, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 3e-08, - "cache_creation_input_token_cost": 3.75e-07 - }, "bedrock/us-gov-east-1/anthropic.claude-sonnet-4-5-20250929-v1:0": { "cache_creation_input_token_cost": 4.5e-06, "cache_creation_input_token_cost_above_1hr": 7.2e-06, @@ -13696,12 +14337,13 @@ "mode": "chat", "output_cost_per_token": 1.5e-06 }, - "bedrock/us-gov-west-1/anthropic.claude-3-7-sonnet-20250219-v1:0": { + "bedrock/us-gov-west-1/anthropic.claude-sonnet-4-5-20250929-v1:0": { "cache_creation_input_token_cost": 4.5e-06, + "cache_creation_input_token_cost_above_1hr": 7.2e-06, "cache_read_input_token_cost": 3.6e-07, - "deprecation_date": "2026-07-30", "input_cost_per_token": 3.6e-06, "litellm_provider": "bedrock", + "supports_tool_search": true, "max_input_tokens": 200000, "max_output_tokens": 8192, "max_tokens": 8192, @@ -13715,68 +14357,12 @@ "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true - }, - "bedrock/us-gov-west-1/anthropic.claude-3-5-sonnet-20240620-v1:0": { - "deprecation_date": "2026-07-30", - "input_cost_per_token": 3.6e-06, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 1.8e-05, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, "supports_vision": true, - "cache_read_input_token_cost": 3.6e-07, - "cache_creation_input_token_cost": 4.5e-06 - }, - "bedrock/us-gov-west-1/anthropic.claude-3-haiku-20240307-v1:0": { - "deprecation_date": "2026-09-10", - "input_cost_per_token": 3e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-06, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 3e-08, - "cache_creation_input_token_cost": 3.75e-07 + "supports_native_structured_output": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 1024 }, - "bedrock/us-gov-west-1/anthropic.claude-sonnet-4-5-20250929-v1:0": { - "cache_creation_input_token_cost": 4.5e-06, - "cache_creation_input_token_cost_above_1hr": 7.2e-06, - "cache_read_input_token_cost": 3.6e-07, - "input_cost_per_token": 3.6e-06, - "litellm_provider": "bedrock", - "supports_tool_search": true, - "max_input_tokens": 200000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 1.8e-05, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_native_structured_output": true, - "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024 - }, - "bedrock/us-gov-west-1/claude-sonnet-4-5-20250929-v1:0": { + "bedrock/us-gov-west-1/claude-sonnet-4-5-20250929-v1:0": { "cache_creation_input_token_cost": 4.5e-06, "cache_creation_input_token_cost_above_1hr": 7.2e-06, "cache_read_input_token_cost": 3.6e-07, @@ -13840,61 +14426,61 @@ "output_cost_per_token": 6e-07 }, "bedrock/us-west-2/1-month-commitment/anthropic.claude-instant-v1": { + "cost_per_second": 0.011, "input_cost_per_second": 0.011, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.011, "supports_tool_choice": true }, "bedrock/us-west-2/1-month-commitment/anthropic.claude-v1": { + "cost_per_second": 0.0175, "input_cost_per_second": 0.0175, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, - "mode": "chat", - "output_cost_per_second": 0.0175 + "mode": "chat" }, "bedrock/us-west-2/1-month-commitment/anthropic.claude-v2:1": { + "cost_per_second": 0.0175, "input_cost_per_second": 0.0175, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.0175, "supports_tool_choice": true }, "bedrock/us-west-2/6-month-commitment/anthropic.claude-instant-v1": { + "cost_per_second": 0.00611, "input_cost_per_second": 0.00611, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.00611, "supports_tool_choice": true }, "bedrock/us-west-2/6-month-commitment/anthropic.claude-v1": { + "cost_per_second": 0.00972, "input_cost_per_second": 0.00972, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, - "mode": "chat", - "output_cost_per_second": 0.00972 + "mode": "chat" }, "bedrock/us-west-2/6-month-commitment/anthropic.claude-v2:1": { + "cost_per_second": 0.00972, "input_cost_per_second": 0.00972, "litellm_provider": "bedrock", "max_input_tokens": 100000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_second": 0.00972, "supports_tool_choice": true }, "bedrock/us-west-2/anthropic.claude-instant-v1": { @@ -13938,13 +14524,14 @@ "supports_tool_choice": true }, "bedrock/us-west-2/mistral.mistral-large-2402-v1:0": { - "input_cost_per_token": 8e-06, + "input_cost_per_token": 4e-06, "litellm_provider": "bedrock", "max_input_tokens": 32000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_token": 2.4e-05, + "output_cost_per_token": 1.2e-05, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true }, "bedrock/us-west-2/mistral.mixtral-8x7b-instruct-v0:1": { @@ -13969,6 +14556,9 @@ "supports_reasoning": true, "supports_native_structured_output": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-west-2/minimax.minimax-m2.1": { @@ -13982,6 +14572,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-west-2/minimax.minimax-m2.5": { @@ -13995,6 +14588,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-west-2/moonshotai.kimi-k2-thinking": { @@ -14020,6 +14616,8 @@ "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, + "supports_audio_input": false, + "supports_response_schema": true, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us-west-2/qwen.qwen3-coder-next": { @@ -14033,6 +14631,9 @@ "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false, "source": "https://aws.amazon.com/bedrock/pricing/" }, "bedrock/us.anthropic.claude-3-5-haiku-20241022-v1:0": { @@ -14188,34 +14789,6 @@ "supports_reasoning": true, "supports_tool_choice": true }, - "cerebras/zai-glm-4.6": { - "deprecation_date": "2026-01-20", - "input_cost_per_token": 2.25e-06, - "litellm_provider": "cerebras", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 2.75e-06, - "source": "https://www.cerebras.ai/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_tool_choice": true - }, - "cerebras/zai-glm-4.7": { - "deprecation_date": "2026-08-17", - "input_cost_per_token": 2.25e-06, - "litellm_provider": "cerebras", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 2.75e-06, - "source": "https://www.cerebras.ai/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_tool_choice": true - }, "cerebras/qwen-3.8-27b": { "input_cost_per_token": 9.9e-07, "litellm_provider": "cerebras", @@ -14241,23 +14814,6 @@ "mode": "chat", "output_cost_per_token": 5e-07 }, - "chatgpt-4o-latest": { - "deprecation_date": "2026-02-17", - "input_cost_per_token": 5e-06, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true - }, "gpt-4o-transcribe-diarize": { "input_cost_per_audio_token": 2.5e-06, "input_cost_per_token": 2.5e-06, @@ -14276,14 +14832,18 @@ "claude-haiku-4-5-20251001": { "cache_creation_input_token_cost": 1.25e-06, "cache_creation_input_token_cost_above_1hr": 2e-06, + "cache_creation_input_token_cost_batches": 6.25e-07, "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_batches": 5e-08, "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 5e-07, "litellm_provider": "anthropic", "max_input_tokens": 200000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 5e-06, + "output_cost_per_token_batches": 2.5e-06, "supports_assistant_prefill": true, "supports_function_calling": true, "supports_native_structured_output": true, @@ -14299,14 +14859,18 @@ "claude-haiku-4-5": { "cache_creation_input_token_cost": 1.25e-06, "cache_creation_input_token_cost_above_1hr": 2e-06, + "cache_creation_input_token_cost_batches": 6.25e-07, "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_batches": 5e-08, "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 5e-07, "litellm_provider": "anthropic", "max_input_tokens": 200000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 5e-06, + "output_cost_per_token_batches": 2.5e-06, "supports_assistant_prefill": true, "supports_function_calling": true, "supports_native_structured_output": true, @@ -14320,114 +14884,31 @@ "prompt_cache_min_tokens": 4096, "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, - "claude-3-7-sonnet-20250219": { + "claude-sonnet-4-5": { "cache_creation_input_token_cost": 3.75e-06, "cache_creation_input_token_cost_above_1hr": 6e-06, + "cache_creation_input_token_cost_above_1hr_above_200k_tokens": 1.2e-05, "cache_read_input_token_cost": 3e-07, - "deprecation_date": "2026-02-19", "input_cost_per_token": 3e-06, - "litellm_provider": "anthropic", - "max_input_tokens": 200000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true - }, - "claude-3-haiku-20240307": { - "cache_creation_input_token_cost": 3e-07, - "cache_creation_input_token_cost_above_1hr": 5e-07, - "cache_read_input_token_cost": 3e-08, - "deprecation_date": "2026-04-20", - "input_cost_per_token": 2.5e-07, - "litellm_provider": "anthropic", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.25e-06, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "claude-3-opus-20240229": { - "cache_creation_input_token_cost": 1.875e-05, - "cache_creation_input_token_cost_above_1hr": 3e-05, - "cache_read_input_token_cost": 1.5e-06, - "deprecation_date": "2026-01-05", - "input_cost_per_token": 1.5e-05, - "litellm_provider": "anthropic", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 7.5e-05, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "claude-4-opus-20250514": { - "cache_creation_input_token_cost": 1.875e-05, - "cache_read_input_token_cost": 1.5e-06, - "deprecation_date": "2026-06-15", - "input_cost_per_token": 1.5e-05, - "litellm_provider": "anthropic", - "max_input_tokens": 200000, - "max_output_tokens": 32000, - "max_tokens": 32000, - "mode": "chat", - "output_cost_per_token": 7.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "prompt_cache_min_tokens": 1024 - }, - "claude-4-sonnet-20250514": { - "cache_creation_input_token_cost": 3.75e-06, + "input_cost_per_token_above_200k_tokens": 6e-06, + "output_cost_per_token_above_200k_tokens": 2.25e-05, "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, - "cache_read_input_token_cost": 3e-07, + "cache_creation_input_token_cost_above_200k_tokens_batches": 3.75e-06, + "cache_creation_input_token_cost_batches": 1.875e-06, "cache_read_input_token_cost_above_200k_tokens": 6e-07, - "deprecation_date": "2026-06-15", - "input_cost_per_token": 3e-06, - "input_cost_per_token_above_200k_tokens": 6e-06, + "cache_read_input_token_cost_above_200k_tokens_batches": 3e-07, + "cache_read_input_token_cost_batches": 1.5e-07, + "deprecation_date": "2026-11-30", + "input_cost_per_token_above_200k_tokens_batches": 3e-06, + "input_cost_per_token_batches": 1.5e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 1.5e-05, - "output_cost_per_token_above_200k_tokens": 2.25e-05, + "output_cost_per_token_above_200k_tokens_batches": 1.125e-05, + "output_cost_per_token_batches": 7.5e-06, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14440,12 +14921,13 @@ "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_native_structured_output": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, - "claude-sonnet-4-5": { + "claude-sonnet-4-5-20250929": { "cache_creation_input_token_cost": 3.75e-06, "cache_creation_input_token_cost_above_1hr": 6e-06, "cache_creation_input_token_cost_above_1hr_above_200k_tokens": 1.2e-05, @@ -14454,13 +14936,22 @@ "input_cost_per_token_above_200k_tokens": 6e-06, "output_cost_per_token_above_200k_tokens": 2.25e-05, "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, + "cache_creation_input_token_cost_above_200k_tokens_batches": 3.75e-06, + "cache_creation_input_token_cost_batches": 1.875e-06, "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3e-07, + "cache_read_input_token_cost_batches": 1.5e-07, + "deprecation_date": "2026-11-30", + "input_cost_per_token_above_200k_tokens_batches": 3e-06, + "input_cost_per_token_batches": 1.5e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 1.5e-05, + "output_cost_per_token_above_200k_tokens_batches": 1.125e-05, + "output_cost_per_token_batches": 7.5e-06, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14476,55 +14967,70 @@ "supports_native_structured_output": true, "supports_tool_choice": true, "supports_vision": true, + "supports_web_search": true, "prompt_cache_min_tokens": 1024, - "source": "https://platform.claude.com/docs/en/about-claude/pricing" + "source": "https://docs.anthropic.com/en/docs/about-claude/pricing" }, - "claude-sonnet-4-5-20250929": { - "cache_creation_input_token_cost": 3.75e-06, - "cache_creation_input_token_cost_above_1hr": 6e-06, - "cache_creation_input_token_cost_above_1hr_above_200k_tokens": 1.2e-05, - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 3e-06, - "input_cost_per_token_above_200k_tokens": 6e-06, - "output_cost_per_token_above_200k_tokens": 2.25e-05, - "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, - "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "claude-sonnet-5": { + "supports_anthropic_compaction": true, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_1hr": 4e-06, + "cache_creation_input_token_cost_batches": 1.25e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.5e-05, + "output_cost_per_token": 1e-05, + "output_cost_per_token_batches": 5e-06, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, - "supports_assistant_prefill": true, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, "supports_computer_use": true, "supports_function_calling": true, + "supports_native_structured_output": true, "supports_pdf_input": true, "supports_prompt_caching": true, + "supports_thinking_cache_preservation": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_native_structured_output": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true, + "supports_xhigh_reasoning_effort": true, + "supports_max_reasoning_effort": true, + "provider_specific_entry": { + "us": 1.1 + }, + "supports_output_config": true, "prompt_cache_min_tokens": 1024, - "source": "https://docs.anthropic.com/en/docs/about-claude/pricing" + "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, - "claude-sonnet-5": { + "claude-sonnet-5-5": { + "supports_anthropic_compaction": true, "cache_creation_input_token_cost": 2.5e-06, "cache_creation_input_token_cost_above_1hr": 4e-06, + "cache_creation_input_token_cost_batches": 1.25e-06, "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1e-07, "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 1e-05, + "output_cost_per_token_batches": 5e-06, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14538,7 +15044,6 @@ "supports_native_structured_output": true, "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_thinking_cache_preservation": true, "supports_reasoning": true, "supports_response_schema": true, "supports_sampling_params": false, @@ -14550,20 +15055,28 @@ "us": 1.1 }, "supports_output_config": true, - "prompt_cache_min_tokens": 1024, - "source": "https://platform.claude.com/docs/en/about-claude/pricing" + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "source": "https://platform.claude.com/docs/en/models/sonnet-5-5/overview", + "supports_web_search": true }, "claude-sonnet-4-6": { + "supports_anthropic_compaction": true, "cache_creation_input_token_cost": 3.75e-06, "cache_creation_input_token_cost_above_1hr": 6e-06, + "cache_creation_input_token_cost_batches": 1.875e-06, "cache_read_input_token_cost": 3e-07, + "cache_read_input_token_cost_batches": 1.5e-07, "input_cost_per_token": 3e-06, + "input_cost_per_token_batches": 1.5e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 1.5e-05, + "output_cost_per_token_batches": 7.5e-06, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14621,103 +15134,21 @@ "input_cost_per_token_batches": 1.5e-06, "output_cost_per_token_batches": 7.5e-06 }, - "claude-opus-4-1": { - "cache_creation_input_token_cost": 1.875e-05, - "cache_creation_input_token_cost_above_1hr": 3e-05, - "cache_read_input_token_cost": 1.5e-06, - "input_cost_per_token": 1.5e-05, - "litellm_provider": "anthropic", - "max_input_tokens": 200000, - "max_output_tokens": 32000, - "max_tokens": 32000, - "mode": "chat", - "output_cost_per_token": 7.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_native_structured_output": true, - "supports_tool_choice": true, - "supports_vision": true, - "prompt_cache_min_tokens": 1024, - "deprecation_date": "2026-08-05" - }, - "claude-opus-4-1-20250805": { - "cache_creation_input_token_cost": 1.875e-05, - "cache_creation_input_token_cost_above_1hr": 3e-05, - "cache_read_input_token_cost": 1.5e-06, - "input_cost_per_token": 1.5e-05, - "deprecation_date": "2026-08-05", - "litellm_provider": "anthropic", - "max_input_tokens": 200000, - "max_output_tokens": 32000, - "max_tokens": 32000, - "mode": "chat", - "output_cost_per_token": 7.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_native_structured_output": true, - "supports_tool_choice": true, - "supports_vision": true, - "prompt_cache_min_tokens": 1024 - }, - "claude-opus-4-20250514": { - "cache_creation_input_token_cost": 1.875e-05, - "cache_creation_input_token_cost_above_1hr": 3e-05, - "cache_read_input_token_cost": 1.5e-06, - "input_cost_per_token": 1.5e-05, - "deprecation_date": "2026-06-15", - "litellm_provider": "anthropic", - "max_input_tokens": 200000, - "max_output_tokens": 32000, - "max_tokens": 32000, - "mode": "chat", - "output_cost_per_token": 7.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "prompt_cache_min_tokens": 1024 - }, "claude-opus-4-5-20251101": { "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "anthropic", "max_input_tokens": 200000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14740,14 +15171,18 @@ "claude-opus-4-5": { "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "anthropic", "max_input_tokens": 200000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14769,16 +15204,21 @@ "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, "claude-opus-4-6": { + "supports_anthropic_compaction": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14807,16 +15247,21 @@ "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, "claude-opus-4-6-20260205": { + "supports_anthropic_compaction": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14844,16 +15289,21 @@ "prompt_cache_min_tokens": 4096 }, "claude-opus-4-7": { + "supports_anthropic_compaction": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14883,16 +15333,21 @@ "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, "claude-opus-4-7-20260416": { + "supports_anthropic_compaction": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14921,16 +15376,21 @@ "prompt_cache_min_tokens": 2048 }, "claude-fable-5": { + "supports_anthropic_compaction": true, "cache_creation_input_token_cost": 1.25e-05, "cache_creation_input_token_cost_above_1hr": 2e-05, + "cache_creation_input_token_cost_batches": 6.25e-06, "cache_read_input_token_cost": 1e-06, + "cache_read_input_token_cost_batches": 5e-07, "input_cost_per_token": 1e-05, + "input_cost_per_token_batches": 5e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 5e-05, + "output_cost_per_token_batches": 2.5e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14960,16 +15420,21 @@ "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, "claude-fable-5-1": { + "supports_anthropic_compaction": true, "cache_creation_input_token_cost": 1.25e-05, "cache_creation_input_token_cost_above_1hr": 2e-05, + "cache_creation_input_token_cost_batches": 6.25e-06, "cache_read_input_token_cost": 2.5e-07, + "cache_read_input_token_cost_batches": 1.25e-07, "input_cost_per_token": 1e-05, + "input_cost_per_token_batches": 5e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 5e-05, + "output_cost_per_token_batches": 2.5e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -14999,30 +15464,36 @@ "supports_native_structured_output": true, "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, - "claude-opus-5": { - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_1hr": 1e-05, - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 5e-06, + "claude-opus-5-5": { + "supports_anthropic_compaction": true, + "cache_creation_input_token_cost": 5e-06, + "cache_creation_input_token_cost_above_1hr": 8e-06, + "cache_creation_input_token_cost_batches": 2.5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1e-07, + "input_cost_per_token": 4e-06, + "input_cost_per_token_batches": 2e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-05, + "output_cost_per_token": 2e-05, + "output_cost_per_token_batches": 1e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, "supports_adaptive_thinking": true, + "thinking_always_on": true, "supports_mid_conversation_system": true, "supports_assistant_prefill": false, "supports_computer_use": true, + "supports_forced_tool_use": false, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_thinking_cache_preservation": true, "supports_reasoning": true, "supports_response_schema": true, "supports_native_structured_output": true, @@ -15032,7 +15503,6 @@ "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, "provider_specific_entry": { - "us": 1.1, "fast": 2.0 }, "supports_output_config": true, @@ -15041,17 +15511,22 @@ "prompt_cache_min_tokens": 512, "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, - "claude-opus-4-8": { + "claude-opus-5": { + "supports_anthropic_compaction": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -15080,40 +15555,55 @@ "supports_output_config": true, "supports_speed": true, "supports_fast_mode": true, - "prompt_cache_min_tokens": 1024, + "prompt_cache_min_tokens": 512, "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, - "claude-sonnet-4-20250514": { - "deprecation_date": "2026-06-15", - "cache_creation_input_token_cost": 3.75e-06, - "cache_creation_input_token_cost_above_1hr": 6e-06, - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 3e-06, - "input_cost_per_token_above_200k_tokens": 6e-06, - "output_cost_per_token_above_200k_tokens": 2.25e-05, - "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, - "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "claude-opus-4-8": { + "supports_anthropic_compaction": true, + "cache_creation_input_token_cost": 6.25e-06, + "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, + "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "anthropic", "max_input_tokens": 1000000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.5e-05, + "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, - "supports_assistant_prefill": true, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, + "supports_thinking_cache_preservation": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_native_structured_output": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "prompt_cache_min_tokens": 1024 + "supports_xhigh_reasoning_effort": true, + "supports_max_reasoning_effort": true, + "provider_specific_entry": { + "us": 1.1, + "fast": 2.0 + }, + "supports_output_config": true, + "supports_speed": true, + "supports_fast_mode": true, + "prompt_cache_min_tokens": 1024, + "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, "cloudflare/@cf/meta/llama-2-7b-chat-fp16": { "input_cost_per_token": 1.923e-06, @@ -15467,36 +15957,6 @@ "supports_assistant_prefill": true, "supports_tool_choice": true }, - "codex-mini-latest": { - "cache_read_input_token_cost": 3.75e-07, - "deprecation_date": "2026-02-12", - "input_cost_per_token": 1.5e-06, - "litellm_provider": "openai", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, - "mode": "responses", - "output_cost_per_token": 6e-06, - "supported_endpoints": [ - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true - }, "cohere.command-light-text-v14": { "input_cost_per_token": 3e-07, "litellm_provider": "bedrock", @@ -15505,38 +15965,18 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 6e-07, - "supports_tool_choice": true - }, - "cohere.command-r-plus-v1:0": { - "deprecation_date": "2026-08-19", - "input_cost_per_token": 3e-06, - "litellm_provider": "bedrock", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "supports_tool_choice": true - }, - "cohere.command-r-v1:0": { - "deprecation_date": "2026-08-19", - "input_cost_per_token": 5e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_tool_choice": true }, "cohere.command-text-v14": { - "input_cost_per_token": 1.5e-06, + "input_cost_per_token": 1e-06, "litellm_provider": "bedrock", "max_input_tokens": 4096, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 2e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_tool_choice": true }, "cohere.embed-english-v3": { @@ -15546,6 +15986,7 @@ "max_tokens": 512, "mode": "embedding", "output_cost_per_token": 0.0, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_embedding_image_input": true }, "cohere.embed-multilingual-v3": { @@ -15555,6 +15996,7 @@ "max_tokens": 512, "mode": "embedding", "output_cost_per_token": 0.0, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_embedding_image_input": true }, "cohere.embed-v4:0": { @@ -15565,6 +16007,7 @@ "mode": "embedding", "output_cost_per_token": 0.0, "output_vector_size": 1536, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_embedding_image_input": true }, "us.cohere.embed-v4:0": { @@ -15597,7 +16040,9 @@ "mode": "embedding", "output_cost_per_token": 0.0, "output_vector_size": 1536, - "supports_embedding_image_input": true + "supports_embedding_image_input": true, + "input_cost_per_image_token": 4.7e-07, + "source": "https://cohere.com/pricing" }, "cohere/parse-v5.0": { "litellm_provider": "cohere", @@ -15618,16 +16063,6 @@ "mode": "rerank", "output_cost_per_token": 0.0 }, - "command": { - "input_cost_per_token": 1e-06, - "litellm_provider": "cohere", - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "completion", - "output_cost_per_token": 2e-06, - "deprecation_date": "2025-09-15" - }, "command-a-03-2025": { "input_cost_per_token": 2.5e-06, "litellm_provider": "cohere_chat", @@ -15639,6 +16074,16 @@ "supports_function_calling": true, "supports_tool_choice": true }, + "c4ai-aya-expanse-32b": { + "input_cost_per_token": 5e-07, + "output_cost_per_token": 1.5e-06, + "litellm_provider": "cohere_chat", + "max_input_tokens": 128000, + "max_output_tokens": 4000, + "max_tokens": 4000, + "mode": "chat", + "source": "https://docs.cohere.com/docs/models" + }, "command-a-plus-05-2026": { "input_cost_per_token": 0.0, "litellm_provider": "cohere_chat", @@ -15654,17 +16099,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "command-light": { - "input_cost_per_token": 3e-07, - "litellm_provider": "cohere_chat", - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 6e-07, - "supports_tool_choice": true, - "deprecation_date": "2025-09-15" - }, "command-nightly": { "input_cost_per_token": 1e-06, "litellm_provider": "cohere", @@ -15674,18 +16108,6 @@ "mode": "completion", "output_cost_per_token": 2e-06 }, - "command-r": { - "input_cost_per_token": 1.5e-07, - "litellm_provider": "cohere_chat", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 6e-07, - "supports_function_calling": true, - "supports_tool_choice": true, - "deprecation_date": "2025-09-15" - }, "command-r-08-2024": { "input_cost_per_token": 1.5e-07, "litellm_provider": "cohere_chat", @@ -15697,18 +16119,6 @@ "supports_function_calling": true, "supports_tool_choice": true }, - "command-r-plus": { - "input_cost_per_token": 2.5e-06, - "litellm_provider": "cohere_chat", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1e-05, - "supports_function_calling": true, - "supports_tool_choice": true, - "deprecation_date": "2025-09-15" - }, "command-r-plus-08-2024": { "input_cost_per_token": 2.5e-06, "litellm_provider": "cohere_chat", @@ -15733,6 +16143,7 @@ "supports_tool_choice": true }, "computer-use-preview": { + "deprecation_date": "2026-07-23", "input_cost_per_token": 3e-06, "litellm_provider": "openai", "max_input_tokens": 8192, @@ -15761,28 +16172,9 @@ "supports_vision": true, "source": "https://platform.openai.com/docs/models/computer-use-preview" }, - "dall-e-2": { - "deprecation_date": "2026-05-12", - "input_cost_per_image": 0.02, - "litellm_provider": "openai", - "mode": "image_generation", - "supported_endpoints": [ - "/v1/images/generations", - "/v1/images/edits", - "/v1/images/variations" - ] - }, - "dall-e-3": { - "deprecation_date": "2026-05-12", - "input_cost_per_image": 0.04, - "litellm_provider": "openai", - "mode": "image_generation", - "supported_endpoints": [ - "/v1/images/generations" - ] - }, "deepseek-chat": { "cache_read_input_token_cost": 2.8e-08, + "deprecation_date": "2026-07-24", "input_cost_per_token": 2.8e-07, "litellm_provider": "deepseek", "max_input_tokens": 131072, @@ -15804,6 +16196,7 @@ }, "deepseek-reasoner": { "cache_read_input_token_cost": 2.8e-08, + "deprecation_date": "2026-07-24", "input_cost_per_token": 2.8e-07, "litellm_provider": "deepseek", "max_input_tokens": 131072, @@ -18777,30 +19170,6 @@ "output_vector_size": 1024, "source": "https://www.databricks.com/product/pricing/foundation-model-serving" }, - "databricks/databricks-claude-3-7-sonnet": { - "cache_creation_input_token_cost": 3.74997e-06, - "cache_read_input_token_cost": 3.0002e-07, - "deprecation_date": "2026-04-12", - "input_cost_per_token": 2.9999900000000002e-06, - "input_dbu_cost_per_token": 4.2857e-05, - "litellm_provider": "databricks", - "max_input_tokens": 200000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "metadata": { - "notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation." - }, - "mode": "chat", - "output_cost_per_token": 1.5000020000000002e-05, - "output_dbu_cost_per_token": 0.000214286, - "source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_anthropic_thinking_payload": true, - "supports_tool_choice": true - }, "databricks/databricks-claude-fable-5": { "cache_creation_input_token_cost": 1.250004e-05, "cache_read_input_token_cost": 1.00002e-06, @@ -19065,6 +19434,41 @@ "supports_tool_choice": true, "supports_vision": true }, + "databricks/databricks-claude-opus-5-5": { + "cache_creation_input_token_cost": 5.00003e-06, + "cache_creation_input_token_cost_above_1hr": 8.00002e-06, + "cache_read_input_token_cost": 1.9999e-07, + "input_cost_per_token": 4.00001e-06, + "input_dbu_cost_per_token": 5.7143e-05, + "litellm_provider": "databricks", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "metadata": { + "notes": "Costs per token are the published Global DBU rates times $0.070 per DBU. The '*_dbu_cost_per_token' fields are provided for reference; cost calculation reads the dollar '*_cost_per_token' fields." + }, + "mode": "chat", + "output_cost_per_token": 1.999998e-05, + "output_dbu_cost_per_token": 0.000285714, + "prompt_cache_min_tokens": 512, + "source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving", + "supports_adaptive_thinking": true, + "supports_anthropic_thinking_payload": true, + "supports_assistant_prefill": false, + "supports_forced_tool_use": false, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_output_config": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "thinking_always_on": true + }, "databricks/databricks-claude-sonnet-4": { "cache_creation_input_token_cost": 3.74997e-06, "cache_read_input_token_cost": 3.0002e-07, @@ -19763,44 +20167,6 @@ "supports_prompt_caching": true, "supports_tool_choice": true }, - "databricks/databricks-gpt-5-1-codex-max": { - "cache_creation_input_token_cost": 1.24999e-06, - "cache_read_input_token_cost": 1.2502e-07, - "deprecation_date": "2026-07-16", - "input_cost_per_token": 1.24999e-06, - "input_dbu_cost_per_token": 1.7857e-05, - "litellm_provider": "databricks", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "metadata": { - "notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation." - }, - "mode": "chat", - "output_cost_per_token": 9.999990000000002e-06, - "output_dbu_cost_per_token": 0.000142857, - "source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving", - "supports_prompt_caching": true - }, - "databricks/databricks-gpt-5-1-codex-mini": { - "cache_creation_input_token_cost": 2.4997e-07, - "cache_read_input_token_cost": 2.499e-08, - "deprecation_date": "2026-07-16", - "input_cost_per_token": 2.4997e-07, - "input_dbu_cost_per_token": 3.571e-06, - "litellm_provider": "databricks", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "metadata": { - "notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation." - }, - "mode": "chat", - "output_cost_per_token": 1.99997e-06, - "output_dbu_cost_per_token": 2.8571e-05, - "source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving", - "supports_prompt_caching": true - }, "databricks/databricks-gpt-5-2": { "cache_creation_input_token_cost": 1.75e-06, "cache_read_input_token_cost": 1.75e-07, @@ -19821,25 +20187,6 @@ "supports_prompt_caching": true, "supports_tool_choice": true }, - "databricks/databricks-gpt-5-2-codex": { - "cache_creation_input_token_cost": 1.75e-06, - "cache_read_input_token_cost": 1.75e-07, - "deprecation_date": "2026-07-16", - "input_cost_per_token": 1.75e-06, - "input_dbu_cost_per_token": 2.5e-05, - "litellm_provider": "databricks", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "metadata": { - "notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation." - }, - "mode": "chat", - "output_cost_per_token": 1.4e-05, - "output_dbu_cost_per_token": 0.0002, - "source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving", - "supports_prompt_caching": true - }, "databricks/databricks-gpt-5-3-codex": { "cache_creation_input_token_cost": 1.75e-06, "cache_read_input_token_cost": 1.75e-07, @@ -20266,25 +20613,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "databricks/databricks-llama-2-70b-chat": { - "cache_creation_input_token_cost": 5.0001e-07, - "cache_read_input_token_cost": 5.0001e-07, - "deprecation_date": "2024-10-30", - "input_cost_per_token": 5.0001e-07, - "input_dbu_cost_per_token": 7.143e-06, - "litellm_provider": "databricks", - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "max_tokens": 4096, - "metadata": { - "notes": "Input/output cost per token is dbu cost * $0.070, based on databricks Llama 3.1 70B conversion. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation." - }, - "mode": "chat", - "output_cost_per_token": 1.5000300000000002e-06, - "output_dbu_cost_per_token": 2.1429e-05, - "source": "https://www.databricks.com/product/pricing/foundation-model-serving", - "supports_tool_choice": true - }, "databricks/databricks-llama-4-maverick": { "cache_creation_input_token_cost": 5.0001e-07, "cache_read_input_token_cost": 5.0001e-07, @@ -20303,25 +20631,6 @@ "source": "https://www.databricks.com/product/pricing/foundation-model-serving", "supports_tool_choice": true }, - "databricks/databricks-meta-llama-3-1-405b-instruct": { - "cache_creation_input_token_cost": 5.00003e-06, - "cache_read_input_token_cost": 5.00003e-06, - "deprecation_date": "2026-02-15", - "input_cost_per_token": 5.00003e-06, - "input_dbu_cost_per_token": 7.1429e-05, - "litellm_provider": "databricks", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "metadata": { - "notes": "Input/output cost per token is dbu cost * $0.070, based on databricks Llama 3.1 70B conversion. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation." - }, - "mode": "chat", - "output_cost_per_token": 1.5000020000000002e-05, - "output_dbu_cost_per_token": 0.000214286, - "source": "https://www.databricks.com/product/pricing/foundation-model-serving", - "supports_tool_choice": true - }, "databricks/databricks-meta-llama-3-1-8b-instruct": { "cache_creation_input_token_cost": 1.5001e-07, "cache_read_input_token_cost": 1.5001e-07, @@ -20357,82 +20666,6 @@ "source": "https://www.databricks.com/product/pricing/foundation-model-serving", "supports_tool_choice": true }, - "databricks/databricks-meta-llama-3-70b-instruct": { - "cache_creation_input_token_cost": 1.00002e-06, - "cache_read_input_token_cost": 1.00002e-06, - "deprecation_date": "2024-07-23", - "input_cost_per_token": 1.00002e-06, - "input_dbu_cost_per_token": 1.4286e-05, - "litellm_provider": "databricks", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "metadata": { - "notes": "Input/output cost per token is dbu cost * $0.070, based on databricks Llama 3.1 70B conversion. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation." - }, - "mode": "chat", - "output_cost_per_token": 2.9999900000000002e-06, - "output_dbu_cost_per_token": 4.2857e-05, - "source": "https://www.databricks.com/product/pricing/foundation-model-serving", - "supports_tool_choice": true - }, - "databricks/databricks-mixtral-8x7b-instruct": { - "cache_creation_input_token_cost": 5.0001e-07, - "cache_read_input_token_cost": 5.0001e-07, - "deprecation_date": "2025-04-30", - "input_cost_per_token": 5.0001e-07, - "input_dbu_cost_per_token": 7.143e-06, - "litellm_provider": "databricks", - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "max_tokens": 4096, - "metadata": { - "notes": "Input/output cost per token is dbu cost * $0.070, based on databricks Llama 3.1 70B conversion. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation." - }, - "mode": "chat", - "output_cost_per_token": 1.00002e-06, - "output_dbu_cost_per_token": 1.4286e-05, - "source": "https://www.databricks.com/product/pricing/foundation-model-serving", - "supports_tool_choice": true - }, - "databricks/databricks-mpt-30b-instruct": { - "cache_creation_input_token_cost": 1.00002e-06, - "cache_read_input_token_cost": 1.00002e-06, - "deprecation_date": "2024-08-30", - "input_cost_per_token": 1.00002e-06, - "input_dbu_cost_per_token": 1.4286e-05, - "litellm_provider": "databricks", - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "metadata": { - "notes": "Input/output cost per token is dbu cost * $0.070, based on databricks Llama 3.1 70B conversion. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation." - }, - "mode": "chat", - "output_cost_per_token": 1.00002e-06, - "output_dbu_cost_per_token": 1.4286e-05, - "source": "https://www.databricks.com/product/pricing/foundation-model-serving", - "supports_tool_choice": true - }, - "databricks/databricks-mpt-7b-instruct": { - "cache_creation_input_token_cost": 5.0001e-07, - "cache_read_input_token_cost": 5.0001e-07, - "deprecation_date": "2024-08-30", - "input_cost_per_token": 5.0001e-07, - "input_dbu_cost_per_token": 7.143e-06, - "litellm_provider": "databricks", - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "metadata": { - "notes": "Input/output cost per token is dbu cost * $0.070, based on databricks Llama 3.1 70B conversion. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation." - }, - "mode": "chat", - "output_cost_per_token": 0.0, - "output_dbu_cost_per_token": 0.0, - "source": "https://www.databricks.com/product/pricing/foundation-model-serving", - "supports_tool_choice": true - }, "databricks/databricks-qwen35-122b-a10b": { "cache_creation_input_token_cost": 2.2001e-07, "cache_read_input_token_cost": 2.2001e-07, @@ -21497,18 +21730,6 @@ "supports_tool_choice": true, "supports_function_calling": true }, - "deepinfra/google/gemini-2.0-flash-001": { - "deprecation_date": "2026-06-01", - "max_tokens": 1000000, - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 4e-07, - "litellm_provider": "deepinfra", - "mode": "chat", - "supports_tool_choice": true, - "supports_function_calling": true - }, "deepinfra/google/gemini-2.5-flash": { "max_tokens": 1000000, "max_input_tokens": 1000000, @@ -21894,6 +22115,7 @@ "deepseek/deepseek-chat": { "cache_creation_input_token_cost": 0.0, "cache_read_input_token_cost": 2.8e-08, + "deprecation_date": "2026-07-24", "input_cost_per_token": 2.8e-07, "input_cost_per_token_cache_hit": 2.8e-08, "litellm_provider": "deepseek", @@ -21948,6 +22170,7 @@ }, "deepseek/deepseek-reasoner": { "cache_read_input_token_cost": 2.8e-08, + "deprecation_date": "2026-07-24", "input_cost_per_token": 2.8e-07, "input_cost_per_token_cache_hit": 2.8e-08, "litellm_provider": "deepseek", @@ -22010,6 +22233,7 @@ "max_tokens": 81920, "mode": "chat", "output_cost_per_token": 1.68e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_reasoning": true, "supports_tool_choice": true, @@ -22018,16 +22242,19 @@ "deepseek.v3.2": { "input_cost_per_token": 6.2e-07, "litellm_provider": "bedrock_converse", - "max_input_tokens": 163840, - "max_output_tokens": 163840, - "max_tokens": 163840, + "max_input_tokens": 164000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "output_cost_per_token": 1.85e-06, "supports_function_calling": true, "supports_reasoning": true, "supports_native_structured_output": true, "supports_tool_choice": true, - "source": "https://aws.amazon.com/bedrock/pricing/" + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "dolphin": { "input_cost_per_token": 5e-07, @@ -22244,6 +22471,265 @@ "litellm_provider": "perplexity", "mode": "search" }, + "sail/moonshotai/Kimi-K3": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "max_output_tokens": 1048576, + "input_cost_per_token": 2.5e-06, + "output_cost_per_token": 1.25e-05, + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token_balanced": 2e-06, + "output_cost_per_token_balanced": 1e-05, + "cache_read_input_token_cost_balanced": 2e-07, + "input_cost_per_token_flex": 1.25e-06, + "output_cost_per_token_flex": 6.25e-06, + "cache_read_input_token_cost_flex": 1.5e-07, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "source": "https://docs.sailresearch.com/models" + }, + "sail/zai-org/GLM-5.3": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "max_output_tokens": 1048576, + "input_cost_per_token": 9.8e-07, + "output_cost_per_token": 3.08e-06, + "cache_read_input_token_cost": 1.8e-07, + "input_cost_per_token_balanced": 5e-07, + "output_cost_per_token_balanced": 2.5e-06, + "cache_read_input_token_cost_balanced": 1.2e-07, + "input_cost_per_token_flex": 4e-07, + "output_cost_per_token_flex": 1.8e-06, + "cache_read_input_token_cost_flex": 8e-08, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "source": "https://docs.sailresearch.com/models" + }, + "sail/zai-org/GLM-5.3-Flash": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "max_output_tokens": 1048576, + "input_cost_per_token": 1.1e-07, + "output_cost_per_token": 3.5e-07, + "cache_read_input_token_cost": 2e-08, + "input_cost_per_token_balanced": 8e-08, + "output_cost_per_token_balanced": 2.8e-07, + "cache_read_input_token_cost_balanced": 2e-08, + "input_cost_per_token_flex": 5e-08, + "output_cost_per_token_flex": 1.8e-07, + "cache_read_input_token_cost_flex": 1e-08, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "source": "https://docs.sailresearch.com/models" + }, + "sail/deepseek-ai/DeepSeek-V4-Pro-0813": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "max_output_tokens": 1048576, + "input_cost_per_token": 9.2e-07, + "output_cost_per_token": 2.77e-06, + "cache_read_input_token_cost": 4e-08, + "input_cost_per_token_balanced": 7.4e-07, + "output_cost_per_token_balanced": 2.22e-06, + "cache_read_input_token_cost_balanced": 3e-08, + "input_cost_per_token_flex": 4.6e-07, + "output_cost_per_token_flex": 1.39e-06, + "cache_read_input_token_cost_flex": 2e-08, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "source": "https://docs.sailresearch.com/models" + }, + "sail/deepseek-ai/DeepSeek-V4-Flash-0731": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "max_output_tokens": 1048576, + "input_cost_per_token": 9e-08, + "output_cost_per_token": 1.8e-07, + "cache_read_input_token_cost": 2e-08, + "input_cost_per_token_balanced": 7e-08, + "output_cost_per_token_balanced": 1.4e-07, + "cache_read_input_token_cost_balanced": 2e-08, + "input_cost_per_token_flex": 5e-08, + "output_cost_per_token_flex": 9e-08, + "cache_read_input_token_cost_flex": 1e-08, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "source": "https://docs.sailresearch.com/models" + }, + "sail/deepseek-ai/DeepSeek-V4.1-Flash": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "max_output_tokens": 1048576, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "cache_read_input_token_cost": 6e-09, + "input_cost_per_token_balanced": 1.2e-07, + "output_cost_per_token_balanced": 4.8e-07, + "cache_read_input_token_cost_balanced": 5e-09, + "input_cost_per_token_flex": 8e-08, + "output_cost_per_token_flex": 3e-07, + "cache_read_input_token_cost_flex": 4e-09, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "source": "https://docs.sailresearch.com/models" + }, + "sail/moonshotai/Kimi-K2.6": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "input_cost_per_token": 1e-06, + "output_cost_per_token": 4e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token_balanced": 4.5e-07, + "output_cost_per_token_balanced": 3e-06, + "cache_read_input_token_cost_balanced": 2e-07, + "input_cost_per_token_flex": 3.5e-07, + "output_cost_per_token_flex": 2e-06, + "cache_read_input_token_cost_flex": 1e-07, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://docs.sailresearch.com/models" + }, + "sail/google/gemma-4-31B-it": { + "max_tokens": 256000, + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "input_cost_per_token": 4e-07, + "output_cost_per_token": 6e-07, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token_balanced": 1.2e-07, + "output_cost_per_token_balanced": 6e-07, + "cache_read_input_token_cost_balanced": 8e-08, + "input_cost_per_token_flex": 6e-08, + "output_cost_per_token_flex": 3e-07, + "cache_read_input_token_cost_flex": 2e-08, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://docs.sailresearch.com/models" + }, + "sail/nvidia/Gemma-4-31B-IT-NVFP4": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "input_cost_per_token": 1.4e-07, + "output_cost_per_token": 4e-07, + "cache_read_input_token_cost": 7e-08, + "input_cost_per_token_balanced": 1.1e-07, + "output_cost_per_token_balanced": 3.2e-07, + "cache_read_input_token_cost_balanced": 6e-08, + "input_cost_per_token_flex": 7e-08, + "output_cost_per_token_flex": 2e-07, + "cache_read_input_token_cost_flex": 4e-08, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://docs.sailresearch.com/models" + }, + "sail/google/gemma-4-12B-it": { + "max_tokens": 16384, + "max_input_tokens": 16384, + "max_output_tokens": 16384, + "input_cost_per_token": 3e-07, + "output_cost_per_token": 2e-06, + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token_balanced": 1e-07, + "output_cost_per_token_balanced": 2e-06, + "cache_read_input_token_cost_balanced": 7e-08, + "input_cost_per_token_flex": 5e-08, + "output_cost_per_token_flex": 1e-06, + "cache_read_input_token_cost_flex": 2e-08, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "source": "https://docs.sailresearch.com/models" + }, + "sail/openai/gpt-oss-120b": { + "max_tokens": 131072, + "max_input_tokens": 131072, + "max_output_tokens": 131072, + "input_cost_per_token": 6e-08, + "output_cost_per_token": 4e-07, + "cache_read_input_token_cost": 3e-08, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "source": "https://docs.sailresearch.com/models" + }, + "sail/Qwen/Qwen3.6-35B-A3B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "input_cost_per_token": 5e-08, + "output_cost_per_token": 4e-07, + "cache_read_input_token_cost": 2e-08, + "input_cost_per_token_flex": 5e-08, + "output_cost_per_token_flex": 4e-07, + "cache_read_input_token_cost_flex": 2e-08, + "litellm_provider": "sail", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://docs.sailresearch.com/models" + }, "searxng/search": { "litellm_provider": "searxng", "mode": "search", @@ -22285,11 +22771,11 @@ } }, "bing_grounding/search": { - "input_cost_per_query": 0.035, + "input_cost_per_query": 0.014, "litellm_provider": "bing_grounding", "mode": "search", "metadata": { - "notes": "Grounding with Bing Search (G1 SKU): $35 per 1,000 transactions. Tokens for the Foundry model deployment that runs the grounded search are billed separately on that deployment." + "notes": "Grounding with Bing Search (G1 SKU): $14 per 1,000 transactions. Tokens for the Foundry model deployment that runs the grounded search are billed separately on that deployment." } }, "tinyfish/search": { @@ -22364,15 +22850,6 @@ "/v1/audio/speech" ] }, - "embed-english-light-v2.0": { - "deprecation_date": "2026-04-04", - "input_cost_per_token": 1e-07, - "litellm_provider": "cohere", - "max_input_tokens": 1024, - "max_tokens": 1024, - "mode": "embedding", - "output_cost_per_token": 0.0 - }, "embed-english-light-v3.0": { "input_cost_per_token": 1e-07, "litellm_provider": "cohere", @@ -22381,15 +22858,6 @@ "mode": "embedding", "output_cost_per_token": 0.0 }, - "embed-english-v2.0": { - "deprecation_date": "2026-04-04", - "input_cost_per_token": 1e-07, - "litellm_provider": "cohere", - "max_input_tokens": 4096, - "max_tokens": 4096, - "mode": "embedding", - "output_cost_per_token": 0.0 - }, "embed-english-v3.0": { "input_cost_per_image": 0.0001, "input_cost_per_token": 1e-07, @@ -22404,15 +22872,6 @@ "supports_embedding_image_input": true, "supports_image_input": true }, - "embed-multilingual-v2.0": { - "deprecation_date": "2026-04-04", - "input_cost_per_token": 1e-07, - "litellm_provider": "cohere", - "max_input_tokens": 768, - "max_tokens": 768, - "mode": "embedding", - "output_cost_per_token": 0.0 - }, "embed-multilingual-v3.0": { "input_cost_per_token": 1e-07, "litellm_provider": "cohere", @@ -22509,7 +22968,7 @@ "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 5.5e-06, - "source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock", + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_assistant_prefill": true, "supports_computer_use": true, "supports_function_calling": true, @@ -22580,23 +23039,6 @@ "cache_read_input_token_cost": 3e-07, "cache_creation_input_token_cost": 3.75e-06 }, - "eu.anthropic.claude-3-haiku-20240307-v1:0": { - "deprecation_date": "2026-09-10", - "input_cost_per_token": 2.5e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.25e-06, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 2.5e-08, - "cache_creation_input_token_cost": 3.125e-07 - }, "eu.anthropic.claude-3-opus-20240229-v1:0": { "input_cost_per_token": 1.5e-05, "litellm_provider": "bedrock", @@ -22612,23 +23054,6 @@ "cache_read_input_token_cost": 1.5e-06, "cache_creation_input_token_cost": 1.875e-05 }, - "eu.anthropic.claude-3-sonnet-20240229-v1:0": { - "deprecation_date": "2026-07-30", - "input_cost_per_token": 3e-06, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 3e-07, - "cache_creation_input_token_cost": 3.75e-06 - }, "eu.anthropic.claude-opus-4-1-20250805-v1:0": { "cache_creation_input_token_cost": 1.875e-05, "cache_read_input_token_cost": 1.5e-06, @@ -22712,7 +23137,8 @@ "supports_tool_choice": true, "supports_vision": true, "bedrock_converse_supports_strict_tools": false, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "eu.anthropic.claude-sonnet-4-5-20250929-v1:0": { "cache_creation_input_token_cost": 4.125e-06, @@ -22749,7 +23175,8 @@ "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 1024, "input_cost_per_token_batches": 1.65e-06, - "output_cost_per_token_batches": 8.25e-06 + "output_cost_per_token_batches": 8.25e-06, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "eu.meta.llama3-2-1b-instruct-v1:0": { "input_cost_per_token": 1.3e-07, @@ -22885,6 +23312,45 @@ "video" ] }, + "fal_ai/minimax/h3/text-to-video": { + "litellm_provider": "fal_ai", + "mode": "video_generation", + "output_cost_per_second": 0.13, + "output_cost_per_second_480p": 0.05, + "output_cost_per_second_768p": 0.06, + "output_cost_per_second_2k": 0.13, + "output_cost_per_second_4k": 0.16, + "source": "https://fal.ai/models/minimax/h3/text-to-video", + "supported_endpoints": [ + "/v1/videos" + ], + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "video" + ] + }, + "fal_ai/minimax/h3/reference-to-video": { + "litellm_provider": "fal_ai", + "mode": "video_generation", + "output_cost_per_second": 0.13, + "output_cost_per_second_480p": 0.05, + "output_cost_per_second_768p": 0.06, + "output_cost_per_second_2k": 0.13, + "output_cost_per_second_4k": 0.16, + "source": "https://fal.ai/models/minimax/h3/reference-to-video", + "supported_endpoints": [ + "/v1/videos" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "video" + ] + }, "fal_ai/bytedance/seedance-2.0/text-to-video": { "litellm_provider": "fal_ai", "mode": "video_generation", @@ -23017,6 +23483,37 @@ "/v1/images/generations" ] }, + "fal_ai/fal-ai/nano-banana-2": { + "litellm_provider": "fal_ai", + "metadata": { + "comment": "priced by the request's resolution field (0.5K, 1K default, 2K, 4K); the web search and high thinking surcharges are not modeled" + }, + "mode": "image_generation", + "output_cost_per_image": 0.08, + "output_cost_per_image_0.5K": 0.06, + "output_cost_per_image_1K": 0.08, + "output_cost_per_image_2K": 0.12, + "output_cost_per_image_4K": 0.16, + "source": "https://fal.ai/models/fal-ai/nano-banana-2", + "supported_endpoints": [ + "/v1/images/generations" + ] + }, + "fal_ai/fal-ai/nano-banana-pro": { + "litellm_provider": "fal_ai", + "metadata": { + "comment": "priced by the request's resolution field (1K default, 2K, 4K); the web search surcharge is not modeled" + }, + "mode": "image_generation", + "output_cost_per_image": 0.15, + "output_cost_per_image_1K": 0.15, + "output_cost_per_image_2K": 0.15, + "output_cost_per_image_4K": 0.3, + "source": "https://fal.ai/models/fal-ai/nano-banana-pro", + "supported_endpoints": [ + "/v1/images/generations" + ] + }, "fal_ai/openai/gpt-image-2": { "litellm_provider": "fal_ai", "metadata": { @@ -23596,3721 +24093,2779 @@ ], "supports_vision": true }, - "featherless_ai/featherless-ai/Qwerky-72B": { - "litellm_provider": "featherless_ai", - "max_input_tokens": 32768, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat" + "fal_ai/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "metadata": { + "notes": "OpenAI gpt-image-2.5 (flare) served through fal.ai. fal publishes deterministic per-image prices per size and quality, mirrored as keyed entries fal_ai/{quality}/{width}-x-{height}/openai/gpt-image-2.5/flare/text-to-image that the fal_ai cost calculator picks from the request params. This flat entry is the fallback for the default request (quality=high, image_size=landscape_4_3 at 1024x768). quality=auto is priced as high" + }, + "mode": "image_generation", + "output_cost_per_image": 0.03612, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "featherless_ai/featherless-ai/Qwerky-QwQ-32B": { - "litellm_provider": "featherless_ai", - "max_input_tokens": 32768, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat" + "fal_ai/low/1024-x-768/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00402, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks-ai-4.1b-to-16b": { - "input_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "output_cost_per_token": 2e-07 + "fal_ai/low/1024-x-1024/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00588, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks-ai-56b-to-176b": { - "input_cost_per_token": 1.2e-06, - "litellm_provider": "fireworks_ai", - "output_cost_per_token": 1.2e-06 + "fal_ai/low/1024-x-1536/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00474, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks-ai-above-16b": { - "input_cost_per_token": 9e-07, - "litellm_provider": "fireworks_ai", - "output_cost_per_token": 9e-07 + "fal_ai/low/1920-x-1080/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00441, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks-ai-default": { - "input_cost_per_token": 0.0, - "litellm_provider": "fireworks_ai", - "output_cost_per_token": 0.0 + "fal_ai/low/2560-x-1440/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00615, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks-ai-embedding-150m-to-350m": { - "input_cost_per_token": 1.6e-08, - "litellm_provider": "fireworks_ai-embedding-models", - "output_cost_per_token": 0.0 + "fal_ai/low/3840-x-2160/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01113, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks-ai-embedding-up-to-150m": { - "input_cost_per_token": 8e-09, - "litellm_provider": "fireworks_ai-embedding-models", - "output_cost_per_token": 0.0 + "fal_ai/medium/1024-x-768/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00903, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks-ai-moe-up-to-56b": { - "input_cost_per_token": 5e-07, - "litellm_provider": "fireworks_ai", - "output_cost_per_token": 5e-07 + "fal_ai/medium/1024-x-1024/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01317, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks-ai-up-to-4b": { - "input_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "output_cost_per_token": 2e-07 + "fal_ai/medium/1024-x-1536/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01029, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/WhereIsAI/UAE-Large-V1": { - "input_cost_per_token": 1.6e-08, - "litellm_provider": "fireworks_ai-embedding-models", - "max_input_tokens": 512, - "max_tokens": 512, - "mode": "embedding", - "output_cost_per_token": 0.0, - "source": "https://fireworks.ai/pricing" + "fal_ai/medium/1920-x-1080/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01029, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-coder-v2-instruct": { - "input_cost_per_token": 1.2e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 65536, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": false, - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/medium/2560-x-1440/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01434, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-r1": { - "input_cost_per_token": 3e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 128000, - "max_output_tokens": 20480, - "max_tokens": 20480, - "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://fireworks.ai/pricing", - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/medium/3840-x-2160/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.02595, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-r1-0528": { - "input_cost_per_token": 3e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 160000, - "max_output_tokens": 160000, - "max_tokens": 160000, - "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://fireworks.ai/pricing", - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/high/1024-x-768/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.03612, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-r1-basic": { - "input_cost_per_token": 5.5e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 128000, - "max_output_tokens": 20480, - "max_tokens": 20480, - "mode": "chat", - "output_cost_per_token": 2.19e-06, - "source": "https://fireworks.ai/pricing", - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/high/1024-x-1024/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.05268, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-v3": { - "input_cost_per_token": 9e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 9e-07, - "source": "https://fireworks.ai/pricing", - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/high/1024-x-1536/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.04116, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-v3-0324": { - "input_cost_per_token": 9e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 163840, - "max_output_tokens": 163840, - "max_tokens": 163840, - "mode": "chat", - "output_cost_per_token": 9e-07, - "source": "https://fireworks.ai/models/fireworks/deepseek-v3-0324", - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/high/1920-x-1080/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.0396, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-v3p1": { - "input_cost_per_token": 5.6e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 1.68e-06, - "source": "https://fireworks.ai/pricing", - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/high/2560-x-1440/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.05529, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-v3p1-terminus": { - "input_cost_per_token": 5.6e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 1.68e-06, - "source": "https://fireworks.ai/pricing", - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/high/3840-x-2160/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.10008, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-v3p2": { - "input_cost_per_token": 5.6e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 163840, - "max_output_tokens": 163840, - "max_tokens": 163840, - "mode": "chat", - "output_cost_per_token": 1.68e-06, - "source": "https://fireworks.ai/models/fireworks/deepseek-v3p2", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/xhigh/1024-x-768/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.0642, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-v4-flash": { - "cache_read_input_token_cost": 2.8e-08, - "input_cost_per_token": 1.4e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 384000, - "max_tokens": 384000, - "mode": "chat", - "output_cost_per_token": 2.8e-07, - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/xhigh/1024-x-1024/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.09366, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-v4-pro": { - "cache_read_input_token_cost": 6e-07, - "cache_read_input_token_cost_priority": 6e-07, - "deprecation_date": "2026-08-27", - "input_cost_per_token": 1.2e-06, - "input_cost_per_token_priority": 1.2e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 384000, - "max_tokens": 384000, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "output_cost_per_token_priority": 1.2e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/xhigh/1024-x-1536/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.07377, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/deepseek-v4-pro-0813": { - "cache_read_input_token_cost": 4.4e-08, - "cache_read_input_token_cost_priority": 5.5e-08, - "input_cost_per_token": 1.32e-06, - "input_cost_per_token_priority": 1.65e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 3.96e-06, - "output_cost_per_token_priority": 4.95e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/xhigh/1920-x-1080/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.07041, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/deepseek-v4-pro-0813": { - "cache_read_input_token_cost": 4.4e-08, - "cache_read_input_token_cost_priority": 5.5e-08, - "input_cost_per_token": 1.32e-06, - "input_cost_per_token_priority": 1.65e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 3.96e-06, - "output_cost_per_token_priority": 4.95e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/xhigh/2560-x-1440/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.09828, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/firefunction-v2": { - "input_cost_per_token": 9e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 9e-07, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/xhigh/3840-x-2160/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.1779, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/glm-4p5": { - "input_cost_per_token": 5.5e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 128000, - "max_output_tokens": 96000, - "max_tokens": 96000, - "mode": "chat", - "output_cost_per_token": 2.19e-06, - "source": "https://fireworks.ai/models/fireworks/glm-4p5", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/max/1024-x-768/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.14445, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/glm-4p5-air": { - "input_cost_per_token": 2.2e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 128000, - "max_output_tokens": 96000, - "max_tokens": 96000, - "mode": "chat", - "output_cost_per_token": 8.8e-07, - "source": "https://artificialanalysis.ai/models/glm-4-5-air", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/max/1024-x-1024/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.21072, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/glm-4p6": { - "input_cost_per_token": 5.5e-07, - "output_cost_per_token": 2.19e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 202800, - "max_output_tokens": 202800, - "max_tokens": 202800, - "mode": "chat", - "source": "https://fireworks.ai/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/max/1024-x-1536/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.16464, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/glm-4p7": { - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 6e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 202800, - "max_output_tokens": 202800, - "max_tokens": 202800, - "mode": "chat", - "output_cost_per_token": 2.2e-06, - "source": "https://fireworks.ai/models/fireworks/glm-4p7", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/max/1920-x-1080/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.1584, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/glm-5p1": { - "cache_read_input_token_cost": 2.6e-07, - "input_cost_per_token": 1.4e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 202800, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 4.4e-06, - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/max/2560-x-1440/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.2211, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/glm-5p2": { - "cache_read_input_token_cost": 1.4e-07, - "cache_read_input_token_cost_priority": 1.75e-07, - "input_cost_per_token": 1.4e-06, - "input_cost_per_token_priority": 1.75e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 4.4e-06, - "output_cost_per_token_priority": 5.5e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/max/3840-x-2160/openai/gpt-image-2.5/flare/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.40026, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/gpt-oss-120b": { - "cache_read_input_token_cost": 1.5e-08, - "cache_read_input_token_cost_priority": 1.8e-08, - "input_cost_per_token": 1.5e-07, - "input_cost_per_token_priority": 1.8e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 6e-07, - "output_cost_per_token_priority": 7.2e-07, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "metadata": { + "notes": "Editing endpoint of gpt-image-2.5 (flare) on fal.ai, reachable through /v1/images/edits or the image generation path with fal's image_urls param. Prices include one input image and live in keyed entries fal_ai/{quality}/{width}-x-{height}/openai/gpt-image-2.5/flare/edit. This flat entry is the fallback for the default edit request (quality=high, image_size=auto, inferred from the input image, priced as 1024x768 high)" + }, + "mode": "image_generation", + "output_cost_per_image": 0.03612, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/gpt-oss-20b": { - "cache_read_input_token_cost": 3.5e-08, - "input_cost_per_token": 7e-08, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 3e-07, - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/low/1024-x-768/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00402, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/kimi-k2-instruct": { - "input_cost_per_token": 6e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://fireworks.ai/models/fireworks/kimi-k2-instruct", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/low/1024-x-1024/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00588, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/kimi-k2-instruct-0905": { - "input_cost_per_token": 6e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://app.fireworks.ai/models/fireworks/kimi-k2-instruct-0905", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/low/1024-x-1536/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00474, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/kimi-k2-thinking": { - "input_cost_per_token": 6e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_web_search": true + "fal_ai/low/1920-x-1080/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00441, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/kimi-k2p5": { - "cache_read_input_token_cost": 1e-07, - "input_cost_per_token": 6e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/low/2560-x-1440/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00615, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/kimi-k2p6": { - "cache_read_input_token_cost": 1.6e-07, - "cache_read_input_token_cost_priority": 2.2e-07, - "input_cost_per_token": 9.5e-07, - "input_cost_per_token_priority": 1.5e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 4e-06, - "output_cost_per_token_priority": 6e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "fal_ai/low/3840-x-2160/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01113, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/kimi-k2p7-code": { - "cache_read_input_token_cost": 1.9e-07, - "cache_read_input_token_cost_priority": 2.85e-07, - "input_cost_per_token": 9.5e-07, - "input_cost_per_token_priority": 1.425e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 4e-06, - "output_cost_per_token_priority": 6e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "fal_ai/medium/1024-x-768/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00903, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/llama-v3p1-405b-instruct": { - "input_cost_per_token": 3e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/medium/1024-x-1024/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01317, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/llama-v3p1-8b-instruct": { - "input_cost_per_token": 1e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1e-07, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": false, - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/medium/1024-x-1536/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01029, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/llama-v3p2-11b-vision-instruct": { - "input_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 2e-07, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": false, - "supports_response_schema": true, - "supports_tool_choice": false, + "fal_ai/medium/1920-x-1080/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01029, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/llama-v3p2-1b-instruct": { - "input_cost_per_token": 1e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1e-07, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": false, - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/medium/2560-x-1440/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01434, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/llama-v3p2-3b-instruct": { - "input_cost_per_token": 1e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1e-07, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": false, - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/medium/3840-x-2160/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.02595, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/llama-v3p2-90b-vision-instruct": { - "input_cost_per_token": 9e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 9e-07, - "source": "https://fireworks.ai/pricing", - "supports_response_schema": true, - "supports_tool_choice": false, + "fal_ai/high/1024-x-768/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.03612, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/llama4-maverick-instruct-basic": { - "input_cost_per_token": 2.2e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 8.8e-07, - "source": "https://fireworks.ai/pricing", - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/high/1024-x-1024/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.05268, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/llama4-scout-instruct-basic": { - "input_cost_per_token": 1.5e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 6e-07, - "source": "https://fireworks.ai/pricing", - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/high/1024-x-1536/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.04116, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/minimax-m2p1": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 204800, - "max_output_tokens": 204800, - "max_tokens": 204800, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://fireworks.ai/models/fireworks/minimax-m2p1", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/high/1920-x-1080/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.0396, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/minimax-m2p7": { - "cache_read_input_token_cost": 6e-08, - "cache_read_input_token_cost_priority": 6e-07, - "deprecation_date": "2026-08-27", - "input_cost_per_token": 3e-07, - "input_cost_per_token_priority": 1.2e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 196608, - "max_output_tokens": 196608, - "max_tokens": 196608, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "output_cost_per_token_priority": 1.2e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/high/2560-x-1440/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.05529, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/minimax-m3": { - "cache_read_input_token_cost": 6e-08, - "cache_read_input_token_cost_priority": 9e-08, - "input_cost_per_token": 3e-07, - "input_cost_per_token_priority": 4.5e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 512000, - "max_output_tokens": 512000, - "max_tokens": 512000, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "output_cost_per_token_priority": 1.8e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/high/3840-x-2160/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.10008, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/mixtral-8x22b-instruct-hf": { - "input_cost_per_token": 1.2e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 65536, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/xhigh/1024-x-768/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.0642, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/qwen2-72b-instruct": { - "input_cost_per_token": 9e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 9e-07, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": false, - "supports_response_schema": true, - "supports_tool_choice": false - }, - "fireworks_ai/accounts/fireworks/models/qwen2p5-coder-32b-instruct": { - "input_cost_per_token": 9e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 9e-07, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": false, - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/xhigh/1024-x-1024/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.09366, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/yi-large": { - "input_cost_per_token": 3e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": false, - "supports_response_schema": true, - "supports_tool_choice": false + "fal_ai/xhigh/1024-x-1536/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.07377, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/deepseek-v4-flash": { - "cache_read_input_token_cost": 2.8e-08, - "input_cost_per_token": 1.4e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 384000, - "max_tokens": 384000, - "mode": "chat", - "output_cost_per_token": 2.8e-07, - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/xhigh/1920-x-1080/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.07041, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/deepseek-v4-pro": { - "cache_read_input_token_cost": 6e-07, - "cache_read_input_token_cost_priority": 6e-07, - "deprecation_date": "2026-08-27", - "input_cost_per_token": 1.2e-06, - "input_cost_per_token_priority": 1.2e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 384000, - "max_tokens": 384000, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "output_cost_per_token_priority": 1.2e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/xhigh/2560-x-1440/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.09828, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/glm-4p7": { - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 6e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 202800, - "max_output_tokens": 202800, - "max_tokens": 202800, - "mode": "chat", - "output_cost_per_token": 2.2e-06, - "source": "https://fireworks.ai/models/fireworks/glm-4p7", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/xhigh/3840-x-2160/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.1779, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/glm-5p1": { - "cache_read_input_token_cost": 2.6e-07, - "input_cost_per_token": 1.4e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 202800, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 4.4e-06, - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/max/1024-x-768/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.14445, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/glm-5p1-fast": { - "cache_read_input_token_cost": 5.2e-07, - "input_cost_per_token": 2.8e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 202800, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 8.8e-06, - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/max/1024-x-1024/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.21072, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/glm-5p2": { - "cache_read_input_token_cost": 1.4e-07, - "cache_read_input_token_cost_priority": 1.75e-07, - "input_cost_per_token": 1.4e-06, - "input_cost_per_token_priority": 1.75e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 4.4e-06, - "output_cost_per_token_priority": 5.5e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/max/1024-x-1536/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.16464, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/gpt-oss-120b": { - "cache_read_input_token_cost": 1.5e-08, - "cache_read_input_token_cost_priority": 1.8e-08, - "input_cost_per_token": 1.5e-07, - "input_cost_per_token_priority": 1.8e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 6e-07, - "output_cost_per_token_priority": 7.2e-07, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/max/1920-x-1080/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.1584, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/gpt-oss-20b": { - "cache_read_input_token_cost": 3.5e-08, - "input_cost_per_token": 7e-08, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 3e-07, - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/max/2560-x-1440/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.2211, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/kimi-k2p5": { - "cache_read_input_token_cost": 1e-07, - "input_cost_per_token": 6e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://fireworks.ai/pricing", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/max/3840-x-2160/openai/gpt-image-2.5/flare/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.40026, + "source": "https://fal.ai/models/openai/gpt-image-2.5/flare/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/kimi-k2p6": { - "cache_read_input_token_cost": 1.6e-07, - "cache_read_input_token_cost_priority": 2.2e-07, - "input_cost_per_token": 9.5e-07, - "input_cost_per_token_priority": 1.5e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 4e-06, - "output_cost_per_token_priority": 6e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "fal_ai/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "metadata": { + "notes": "OpenAI gpt-image-2.5 (sunburst) served through fal.ai. fal publishes deterministic per-image prices per size and quality, mirrored as keyed entries fal_ai/{quality}/{width}-x-{height}/openai/gpt-image-2.5/sunburst/text-to-image that the fal_ai cost calculator picks from the request params. This flat entry is the fallback for the default request (quality=high, image_size=landscape_4_3 at 1024x768). quality=auto is priced as high" + }, + "mode": "image_generation", + "output_cost_per_image": 0.03612, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], "supports_vision": true }, - "fireworks_ai/kimi-k2p6-fast": { - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 2e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "fal_ai/low/1024-x-768/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00402, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], "supports_vision": true }, - "fireworks_ai/kimi-k2p7-code": { - "cache_read_input_token_cost": 1.9e-07, - "cache_read_input_token_cost_priority": 2.85e-07, - "input_cost_per_token": 9.5e-07, - "input_cost_per_token_priority": 1.425e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 4e-06, - "output_cost_per_token_priority": 6e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "fal_ai/low/1024-x-1024/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00588, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], "supports_vision": true }, - "fireworks_ai/kimi-k2p7-code-fast": { - "cache_read_input_token_cost": 3.8e-07, - "input_cost_per_token": 1.9e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "fal_ai/low/1024-x-1536/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00474, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], "supports_vision": true }, - "fireworks_ai/minimax-m2p1": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 204800, - "max_output_tokens": 204800, - "max_tokens": 204800, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://fireworks.ai/models/fireworks/minimax-m2p1", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/low/1920-x-1080/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00441, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/minimax-m2p7": { - "cache_read_input_token_cost": 6e-08, - "cache_read_input_token_cost_priority": 6e-07, - "deprecation_date": "2026-08-27", - "input_cost_per_token": 3e-07, - "input_cost_per_token_priority": 1.2e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 196608, - "max_output_tokens": 196608, - "max_tokens": 196608, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "output_cost_per_token_priority": 1.2e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/low/2560-x-1440/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00615, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/minimax-m3": { - "cache_read_input_token_cost": 6e-08, - "cache_read_input_token_cost_priority": 9e-08, - "input_cost_per_token": 3e-07, - "input_cost_per_token_priority": 4.5e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 512000, - "max_output_tokens": 512000, - "max_tokens": 512000, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "output_cost_per_token_priority": 1.8e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fal_ai/low/3840-x-2160/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01113, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/qwen3p7-plus": { - "cache_read_input_token_cost": 8e-08, - "input_cost_per_token": 4e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "chat", - "output_cost_per_token": 1.6e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "fal_ai/medium/1024-x-768/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00903, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], "supports_vision": true }, - "fireworks_ai/nomic-ai/nomic-embed-text-v1": { - "input_cost_per_token": 8e-09, - "litellm_provider": "fireworks_ai-embedding-models", - "max_input_tokens": 8192, - "max_tokens": 8192, - "mode": "embedding", - "output_cost_per_token": 0.0, - "source": "https://fireworks.ai/pricing" + "fal_ai/medium/1024-x-1024/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01317, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/nomic-ai/nomic-embed-text-v1.5": { - "input_cost_per_token": 8e-09, - "litellm_provider": "fireworks_ai-embedding-models", - "max_input_tokens": 8192, - "max_tokens": 8192, - "mode": "embedding", - "output_cost_per_token": 0.0, - "source": "https://fireworks.ai/pricing" + "fal_ai/medium/1024-x-1536/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01029, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/thenlper/gte-base": { - "input_cost_per_token": 8e-09, - "litellm_provider": "fireworks_ai-embedding-models", - "max_input_tokens": 512, - "max_tokens": 512, - "mode": "embedding", - "output_cost_per_token": 0.0, - "source": "https://fireworks.ai/pricing" + "fal_ai/medium/1920-x-1080/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01029, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "fireworks_ai/thenlper/gte-large": { - "input_cost_per_token": 1.6e-08, - "litellm_provider": "fireworks_ai-embedding-models", - "max_input_tokens": 512, - "max_tokens": 512, - "mode": "embedding", - "output_cost_per_token": 0.0, - "source": "https://fireworks.ai/pricing" + "fal_ai/medium/2560-x-1440/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01434, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "friendliai/zai-org/GLM-5.3-Flash": { - "litellm_provider": "friendliai", - "max_input_tokens": 1048576, - "max_output_tokens": 1048576, - "max_tokens": 1048576, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 5e-07, - "cache_read_input_token_cost": 3e-08, - "supports_prompt_caching": true, - "supports_reasoning": true, - "reasoning_effort_levels": [ - "low", - "high", - "max" + "fal_ai/medium/3840-x-2160/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.02595, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_native_structured_output": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_image_input": true, - "supports_video_input": true, - "mode": "chat", - "comment": "Native multimodal GLM model for efficient coding and long-horizon agent tasks", - "source": "https://api.friendli.ai/serverless/v1/models" + "supports_vision": true }, - "friendliai/zai-org/GLM-5.3": { - "litellm_provider": "friendliai", - "max_input_tokens": 1048576, - "max_output_tokens": 1048576, - "max_tokens": 1048576, - "input_cost_per_token": 1.26e-06, - "output_cost_per_token": 3.96e-06, - "cache_read_input_token_cost": 2.34e-07, - "supports_prompt_caching": true, - "supports_reasoning": true, - "reasoning_effort_levels": [ - "low", - "high", - "max" + "fal_ai/high/1024-x-768/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.03612, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_native_structured_output": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": false, - "supports_image_input": false, - "supports_video_input": false, - "mode": "chat", - "comment": "Flagship GLM model for long-horizon coding, agents, and complex project delivery", - "source": "https://api.friendli.ai/serverless/v1/models" + "supports_vision": true }, - "friendliai/google/gemma-4-31B-it": { - "litellm_provider": "friendliai", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, - "input_cost_per_token": 1.4e-07, - "output_cost_per_token": 4e-07, - "supports_prompt_caching": false, - "supports_reasoning": true, - "reasoning_effort_levels": [], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_native_structured_output": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_image_input": true, - "supports_video_input": false, - "mode": "chat", - "comment": "Largest Gemma 4 instruction model for open, self-hosted chat and reasoning", - "source": "https://api.friendli.ai/serverless/v1/models" + "fal_ai/high/1024-x-1024/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.05268, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "friendliai/zai-org/GLM-5.2": { - "litellm_provider": "friendliai", - "max_input_tokens": 1048576, - "max_output_tokens": 1048576, - "max_tokens": 1048576, - "input_cost_per_token": 1.4e-06, - "output_cost_per_token": 4.4e-06, - "cache_read_input_token_cost": 2.6e-07, - "supports_prompt_caching": true, - "supports_reasoning": true, - "reasoning_effort_levels": [ - "high", - "max" + "fal_ai/high/1024-x-1536/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.04116, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_native_structured_output": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": false, - "supports_image_input": false, - "supports_video_input": false, - "mode": "chat", - "comment": "Open flagship GLM for long-horizon coding agents and million-token context work", - "source": "https://api.friendli.ai/serverless/v1/models" + "supports_vision": true }, - "friendliai/LGAI-EXAONE/K-EXAONE-2.0-750B-A37B": { - "litellm_provider": "friendliai", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, - "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.4e-06, - "cache_read_input_token_cost": 1.2e-07, - "supports_prompt_caching": true, - "supports_reasoning": true, - "reasoning_effort_levels": [], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_native_structured_output": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": false, - "supports_image_input": false, - "supports_video_input": false, - "mode": "chat", - "comment": "Frontier-scale multilingual language model developed by LG AI Research", - "deprecation_date": "2026-09-06", - "source": "https://api.friendli.ai/serverless/v1/models" + "fal_ai/high/1920-x-1080/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.0396, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "friendliai/deepseek-ai/DeepSeek-V3.2": { - "litellm_provider": "friendliai", - "max_input_tokens": 163840, - "max_output_tokens": 163840, - "max_tokens": 163840, - "input_cost_per_token": 5e-07, - "output_cost_per_token": 1.5e-06, - "cache_read_input_token_cost": 2.5e-07, - "supports_prompt_caching": true, - "supports_reasoning": true, - "reasoning_effort_levels": [], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_native_structured_output": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": false, - "supports_image_input": false, - "supports_video_input": false, - "mode": "chat", - "comment": "DeepSeek chat model for instruction following, coding, and analysis", - "source": "https://api.friendli.ai/serverless/v1/models" + "fal_ai/high/2560-x-1440/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.05529, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "friendliai/MiniMaxAI/MiniMax-M2.5": { - "litellm_provider": "friendliai", - "max_input_tokens": 196608, - "max_output_tokens": 196608, - "max_tokens": 196608, - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, - "cache_read_input_token_cost": 6e-08, - "supports_prompt_caching": true, - "supports_reasoning": true, - "reasoning_effort_levels": [], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_native_structured_output": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": false, - "supports_image_input": false, - "supports_video_input": false, - "mode": "chat", - "comment": "Prior MiniMax coding model for agent workflows, office edits, and automation", - "source": "https://api.friendli.ai/serverless/v1/models" + "fal_ai/high/3840-x-2160/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.10008, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "friendliai/zai-org/GLM-5.1": { - "litellm_provider": "friendliai", - "max_input_tokens": 202752, - "max_output_tokens": 202752, - "max_tokens": 202752, - "input_cost_per_token": 1.4e-06, - "output_cost_per_token": 4.4e-06, - "cache_read_input_token_cost": 2.6e-07, - "supports_prompt_caching": true, - "supports_reasoning": true, - "reasoning_effort_levels": [], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_native_structured_output": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": false, - "supports_image_input": false, - "supports_video_input": false, - "mode": "chat", - "comment": "Strong GLM coding model for agentic engineering, terminals, and repository generation", - "source": "https://api.friendli.ai/serverless/v1/models" + "fal_ai/xhigh/1024-x-768/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.0642, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:babbage-002": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 1.6e-06, - "input_cost_per_token_batches": 8e-07, - "litellm_provider": "text-completion-openai", - "max_input_tokens": 16384, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "completion", - "output_cost_per_token": 1.6e-06, - "output_cost_per_token_batches": 9e-07, - "source": "https://developers.openai.com/api/docs/pricing" + "fal_ai/xhigh/1024-x-1024/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.09366, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:davinci-002": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 1.2e-05, - "input_cost_per_token_batches": 6e-06, - "litellm_provider": "text-completion-openai", - "max_input_tokens": 16384, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "completion", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_batches": 6e-06, - "source": "https://developers.openai.com/api/docs/pricing" + "fal_ai/xhigh/1024-x-1536/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.07377, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:gpt-3.5-turbo": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 3e-06, - "input_cost_per_token_batches": 1.5e-06, - "litellm_provider": "openai", - "max_input_tokens": 16385, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 6e-06, - "output_cost_per_token_batches": 3e-06, - "source": "https://developers.openai.com/api/docs/pricing", - "supports_system_messages": true, - "supports_tool_choice": true + "fal_ai/xhigh/1920-x-1080/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.07041, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:gpt-3.5-turbo-0125": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 3e-06, - "litellm_provider": "openai", - "max_input_tokens": 16385, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 6e-06, - "supports_system_messages": true, - "supports_tool_choice": true + "fal_ai/xhigh/2560-x-1440/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.09828, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:gpt-3.5-turbo-0613": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 3e-06, - "litellm_provider": "openai", - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 6e-06, - "supports_system_messages": true, - "supports_tool_choice": true + "fal_ai/xhigh/3840-x-2160/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.1779, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:gpt-3.5-turbo-1106": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 3e-06, - "litellm_provider": "openai", - "max_input_tokens": 16385, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 6e-06, - "supports_system_messages": true, - "supports_tool_choice": true + "fal_ai/max/1024-x-768/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.14445, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:gpt-4-0613": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 3e-05, - "litellm_provider": "openai", - "max_input_tokens": 8192, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 6e-05, - "source": "OpenAI needs to add pricing for this ft model, will be updated when added by OpenAI. Defaulting to base model pricing", - "supports_function_calling": true, - "supports_system_messages": true, - "supports_tool_choice": true + "fal_ai/max/1024-x-1024/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.21072, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:gpt-4o-2024-08-06": { - "cache_read_input_token_cost": 1.875e-06, - "input_cost_per_token": 3.75e-06, - "input_cost_per_token_batches": 2.225e-06, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "output_cost_per_token_batches": 1.25e-05, - "source": "https://developers.openai.com/api/docs/pricing", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, + "fal_ai/max/1024-x-1536/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.16464, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], "supports_vision": true }, - "ft:gpt-4o-2024-11-20": { - "cache_creation_input_token_cost": 1.875e-06, - "input_cost_per_token": 3.75e-06, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true + "fal_ai/max/1920-x-1080/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.1584, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:gpt-4o-mini-2024-07-18": { - "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_token": 3e-07, - "input_cost_per_token_batches": 1.5e-07, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "output_cost_per_token_batches": 6e-07, - "source": "https://developers.openai.com/api/docs/pricing", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true + "fal_ai/max/2560-x-1440/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.2211, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:gpt-4.1-2025-04-14": { - "cache_read_input_token_cost": 7.5e-07, - "input_cost_per_token": 3e-06, - "input_cost_per_token_batches": 1.5e-06, - "litellm_provider": "openai", - "max_input_tokens": 1047576, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_batches": 6e-06, - "source": "https://developers.openai.com/api/docs/pricing", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true + "fal_ai/max/3840-x-2160/openai/gpt-image-2.5/sunburst/text-to-image": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.40026, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/text-to-image", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:gpt-4.1-mini-2025-04-14": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 8e-07, - "input_cost_per_token_batches": 4e-07, - "litellm_provider": "openai", - "max_input_tokens": 1047576, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 3.2e-06, - "output_cost_per_token_batches": 1.6e-06, - "source": "https://developers.openai.com/api/docs/pricing", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true + "fal_ai/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "metadata": { + "notes": "Editing endpoint of gpt-image-2.5 (sunburst) on fal.ai, reachable through /v1/images/edits or the image generation path with fal's image_urls param. Prices include one input image and live in keyed entries fal_ai/{quality}/{width}-x-{height}/openai/gpt-image-2.5/sunburst/edit. This flat entry is the fallback for the default edit request (quality=high, image_size=auto, inferred from the input image, priced as 1024x768 high)" + }, + "mode": "image_generation", + "output_cost_per_image": 0.03612, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:gpt-4.1-nano-2025-04-14": { - "cache_read_input_token_cost": 5e-08, - "deprecation_date": "2026-10-23", - "input_cost_per_token": 2e-07, - "input_cost_per_token_batches": 1e-07, - "litellm_provider": "openai", - "max_input_tokens": 1047576, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 8e-07, - "output_cost_per_token_batches": 4e-07, - "source": "https://developers.openai.com/api/docs/pricing", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true + "fal_ai/low/1024-x-768/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00402, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "ft:o4-mini-2025-04-16": { - "cache_read_input_token_cost": 1e-06, - "deprecation_date": "2026-10-23", - "input_cost_per_token": 4e-06, - "input_cost_per_token_batches": 2e-06, - "litellm_provider": "openai", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, - "mode": "chat", - "output_cost_per_token": 1.6e-05, - "output_cost_per_token_batches": 8e-06, - "source": "https://developers.openai.com/api/docs/pricing", - "supports_function_calling": true, - "supports_parallel_function_calling": false, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true + "fal_ai/low/1024-x-1024/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00588, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" + ], + "supports_vision": true }, - "gemini-2.0-flash": { - "cache_read_input_token_cost": 2.5e-08, - "deprecation_date": "2026-06-01", - "input_cost_per_audio_token": 1e-06, - "input_cost_per_audio_token_batches": 5e-07, - "input_cost_per_character": 3.75e-08, - "input_cost_per_token": 1.5e-07, - "input_cost_per_token_batches": 7.5e-08, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 6e-07, - "output_cost_per_token_batches": 3e-07, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_modalities": [ - "text", - "image", - "audio", - "video" + "fal_ai/low/1024-x-1536/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00474, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supported_output_modalities": [ - "text", - "image" + "supports_vision": true + }, + "fal_ai/low/1920-x-1080/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00441, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supports_audio_input": true, - "supports_audio_output": true, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } + "supports_vision": true }, - "gemini-2.0-flash-001": { - "cache_read_input_token_cost": 3.75e-08, - "deprecation_date": "2026-06-01", - "input_cost_per_audio_token": 1e-06, - "input_cost_per_token": 1.5e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 6e-07, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", - "supported_modalities": [ - "text", - "image", - "audio", - "video" + "fal_ai/low/2560-x-1440/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00615, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supported_output_modalities": [ - "text", - "image" + "supports_vision": true + }, + "fal_ai/low/3840-x-2160/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01113, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supports_audio_output": true, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } + "supports_vision": true }, - "gemini-2.0-flash-lite": { - "cache_read_input_token_cost": 1.875e-08, - "deprecation_date": "2026-06-01", - "input_cost_per_audio_token": 7.5e-08, - "input_cost_per_audio_token_batches": 3.75e-08, - "input_cost_per_character": 1.875e-08, - "input_cost_per_token": 7.5e-08, - "input_cost_per_token_batches": 3.75e-08, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 3e-07, - "output_cost_per_token_batches": 1.5e-07, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_modalities": [ - "text", - "image", - "audio", - "video" + "fal_ai/medium/1024-x-768/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.00903, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supported_output_modalities": [ - "text" + "supports_vision": true + }, + "fal_ai/medium/1024-x-1024/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01317, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supports_audio_output": true, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } + "supports_vision": true }, - "gemini-2.0-flash-lite-001": { - "cache_read_input_token_cost": 1.875e-08, - "deprecation_date": "2026-06-01", - "input_cost_per_audio_token": 7.5e-08, - "input_cost_per_token": 7.5e-08, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 3e-07, - "source": "https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models#gemini-2.0-flash", - "supported_modalities": [ - "text", - "image", - "audio", - "video" + "fal_ai/medium/1024-x-1536/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01029, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supported_output_modalities": [ - "text" + "supports_vision": true + }, + "fal_ai/medium/1920-x-1080/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01029, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supports_audio_output": true, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } + "supports_vision": true }, - "gemini-2.5-flash": { - "cache_read_input_audio_token_cost": 1e-07, - "deprecation_date": "2026-10-20", - "cache_read_input_token_cost": 3e-08, - "cache_read_input_token_cost_flex": 3e-08, - "cache_read_input_token_cost_priority": 5.4e-08, - "input_cost_per_audio_token": 1e-06, - "input_cost_per_token": 3e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, - "mode": "chat", - "output_cost_per_reasoning_token": 2.5e-06, - "output_cost_per_token": 2.5e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "fal_ai/medium/2560-x-1440/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.01434, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" + "/v1/images/edits", + "/v1/images/generations" ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" + "supports_vision": true + }, + "fal_ai/medium/3840-x-2160/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.02595, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supported_output_modalities": [ - "text" + "supports_vision": true + }, + "fal_ai/high/1024-x-768/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.03612, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supports_audio_output": false, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - }, - "google_maps_grounding_cost_per_query": 0.025, - "input_cost_per_audio_token_batches": 5e-07, - "input_cost_per_token_batches": 1.5e-07, - "input_cost_per_token_flex": 1.5e-07, - "input_cost_per_token_priority": 5.4e-07, - "output_cost_per_token_batches": 1.25e-06, - "output_cost_per_token_flex": 1.25e-06, - "output_cost_per_token_priority": 4.5e-06, - "supports_image_size": false + "supports_vision": true }, - "gemini-2.5-flash-image": { - "deprecation_date": "2026-10-02", - "cache_read_input_token_cost": 3e-08, - "input_cost_per_audio_token": 1e-06, - "input_cost_per_token": 3e-07, - "input_cost_per_token_batches": 1.5e-07, - "input_cost_per_token_flex": 1.5e-07, - "input_cost_per_token_priority": 5.4e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "max_tokens": 32768, + "fal_ai/high/1024-x-1024/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", "mode": "image_generation", - "output_cost_per_image": 0.039, - "output_cost_per_image_token": 3e-05, - "output_cost_per_reasoning_token": 2.5e-06, - "output_cost_per_token": 2.5e-06, - "output_cost_per_token_batches": 1.25e-06, - "output_cost_per_token_flex": 1.25e-06, - "rpm": 100000, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "output_cost_per_image": 0.05268, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" + "/v1/images/edits", + "/v1/images/generations" ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" + "supports_vision": true + }, + "fal_ai/high/1024-x-1536/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.04116, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supported_output_modalities": [ - "text", - "image" + "supports_vision": true + }, + "fal_ai/high/1920-x-1080/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.0396, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supports_audio_output": false, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": false, - "tpm": 8000000, - "supports_image_size": false + "supports_vision": true }, - "gemini-3-pro-image": { - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, - "cache_read_input_token_cost_flex": 1e-07, - "cache_read_input_token_cost_priority": 3.6e-07, - "deprecation_date": "2027-05-28", - "input_cost_per_image": 0.0011, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, - "input_cost_per_token_batches": 1e-06, - "input_cost_per_token_flex": 1e-06, - "input_cost_per_token_priority": 3.6e-06, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 65536, - "max_output_tokens": 32768, - "max_tokens": 32768, + "fal_ai/high/2560-x-1440/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", "mode": "image_generation", - "output_cost_per_image": 0.134, - "output_cost_per_image_token": 0.00012, - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_200k_tokens": 1.8e-05, - "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, - "output_cost_per_token_batches": 6e-06, - "output_cost_per_token_flex": 6e-06, - "output_cost_per_token_priority": 2.16e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "output_cost_per_image": 0.05529, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" + "/v1/images/edits", + "/v1/images/generations" ], - "supported_modalities": [ - "text", - "image" + "supports_vision": true + }, + "fal_ai/high/3840-x-2160/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.10008, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supported_output_modalities": [ - "text", - "image" + "supports_vision": true + }, + "fal_ai/xhigh/1024-x-768/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.0642, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supports_function_calling": false, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query" + "supports_vision": true }, - "gemini-3-pro-image-preview": { - "input_cost_per_image": 0.0011, - "input_cost_per_token": 2e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 65536, - "max_output_tokens": 32768, - "max_tokens": 32768, + "fal_ai/xhigh/1024-x-1024/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", "mode": "image_generation", - "output_cost_per_image": 0.134, - "output_cost_per_image_token": 0.00012, - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_batches": 6e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "output_cost_per_image": 0.09366, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" + "/v1/images/edits", + "/v1/images/generations" ], - "supported_modalities": [ - "text", - "image" + "supports_vision": true + }, + "fal_ai/xhigh/1024-x-1536/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.07377, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supported_output_modalities": [ - "text", - "image" + "supports_vision": true + }, + "fal_ai/xhigh/1920-x-1080/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.07041, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supports_function_calling": false, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query" + "supports_vision": true }, - "gemini-3.1-flash-image": { - "cache_read_input_token_cost": 5e-08, - "cache_read_input_token_cost_flex": 2.5e-08, - "deprecation_date": "2027-05-28", - "input_cost_per_image": 0.00056, - "input_cost_per_token": 5e-07, - "input_cost_per_token_batches": 2.5e-07, - "input_cost_per_token_flex": 2.5e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 65536, - "max_output_tokens": 32768, - "max_tokens": 32768, + "fal_ai/xhigh/2560-x-1440/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", "mode": "image_generation", - "output_cost_per_image": 0.0672, - "output_cost_per_image_token": 6e-05, - "output_cost_per_token": 3e-06, - "output_cost_per_token_batches": 1.5e-06, - "output_cost_per_token_flex": 1.5e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "output_cost_per_image": 0.09828, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" + "/v1/images/edits", + "/v1/images/generations" ], - "supported_modalities": [ - "text", - "image" + "supports_vision": true + }, + "fal_ai/xhigh/3840-x-2160/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.1779, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supported_output_modalities": [ - "text", - "image" + "supports_vision": true + }, + "fal_ai/max/1024-x-768/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.14445, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supports_function_calling": false, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query" + "supports_vision": true }, - "gemini-3.1-flash-image-preview": { - "input_cost_per_image": 0.00056, - "input_cost_per_token": 5e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 65536, - "max_output_tokens": 32768, - "max_tokens": 32768, + "fal_ai/max/1024-x-1024/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", "mode": "image_generation", - "output_cost_per_image": 0.0672, - "output_cost_per_image_token": 6e-05, - "output_cost_per_token": 3e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#gemini-models", + "output_cost_per_image": 0.21072, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" + "/v1/images/edits", + "/v1/images/generations" ], - "supported_modalities": [ - "text", - "image" + "supports_vision": true + }, + "fal_ai/max/1024-x-1536/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.16464, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supported_output_modalities": [ - "text", - "image" - ], - "supports_function_calling": false, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query" + "supports_vision": true }, - "gemini-3.1-flash-lite-image": { - "cache_read_input_token_cost": 2.5e-08, - "cache_read_input_token_cost_flex": 1.25e-08, - "input_cost_per_image": 0.00028, - "input_cost_per_token": 2.5e-07, - "input_cost_per_token_batches": 1.25e-07, - "input_cost_per_token_flex": 1.25e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 65536, - "max_output_tokens": 4096, - "max_tokens": 4096, + "fal_ai/max/1920-x-1080/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", "mode": "image_generation", - "output_cost_per_image": 0.0336, - "output_cost_per_image_token": 3e-05, - "output_cost_per_token": 1.5e-06, - "output_cost_per_token_batches": 7.5e-07, - "output_cost_per_token_flex": 7.5e-07, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "output_cost_per_image": 0.1584, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" + "/v1/images/edits", + "/v1/images/generations" ], - "supported_modalities": [ - "text", - "image", - "video" + "supports_vision": true + }, + "fal_ai/max/2560-x-1440/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.2211, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supported_output_modalities": [ - "text", - "image" + "supports_vision": true + }, + "fal_ai/max/3840-x-2160/openai/gpt-image-2.5/sunburst/edit": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.40026, + "source": "https://fal.ai/models/openai/gpt-image-2.5/sunburst/edit", + "supported_endpoints": [ + "/v1/images/edits", + "/v1/images/generations" ], - "supports_function_calling": false, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_system_messages": true, - "supports_video_input": true, "supports_vision": true }, - "gemini-3.1-flash-lite-preview": { - "cache_read_input_token_cost": 2.5e-08, - "input_cost_per_audio_token": 5e-07, - "input_cost_per_token": 2.5e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "fal_ai/fal-ai/flux/dev": { + "litellm_provider": "fal_ai", + "metadata": { + "notes": "fal bills FLUX.1 [dev] at $0.025 per megapixel, rounding each image up to the nearest megapixel. The per-pixel rate is used when Fal reports the output size, and the flat per-image price is the fallback when dimensions are unavailable" + }, + "mode": "image_generation", + "output_cost_per_image": 0.025, + "output_cost_per_pixel": 2.384185791015625e-08, + "source": "https://fal.ai/models/fal-ai/flux/dev", + "supported_endpoints": [ + "/v1/images/generations" + ] + }, + "fal_ai/fal-ai/trellis": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.02, + "source": "https://fal.ai/models/fal-ai/trellis", + "metadata": { + "comment": "image-to-3D, returns a GLB mesh; served through the /fal_ai pass-through route" + } + }, + "fal_ai/fal-ai/trellis-2": { + "litellm_provider": "fal_ai", + "mode": "image_generation", + "output_cost_per_image": 0.3, + "output_cost_per_image_512": 0.25, + "output_cost_per_image_1024": 0.3, + "output_cost_per_image_1536": 0.35, + "source": "https://fal.ai/models/fal-ai/trellis-2", + "metadata": { + "comment": "image-to-3D, returns a GLB mesh; priced by the request's resolution field (default 1024); served through the /fal_ai pass-through route" + } + }, + "fal_ai/fal-ai/flux-lora-depth": { + "litellm_provider": "fal_ai", + "metadata": { + "notes": "fal bills fal-ai/flux-lora-depth at $0.035 per megapixel, rounding each image up to the nearest megapixel. The per-pixel rate is used when Fal reports the output size, and the flat per-image price prices the default 1 MP output like the sibling flux entries" + }, + "mode": "image_generation", + "output_cost_per_image": 0.035, + "output_cost_per_pixel": 3.337860107421875e-08, + "source": "https://fal.ai/models/fal-ai/flux-lora-depth", + "supported_endpoints": [ + "/v1/images/edits" + ] + }, + "fal_ai/fal-ai/moondream3-preview/query": { + "input_cost_per_token": 4e-07, + "litellm_provider": "fal_ai", "mode": "chat", - "output_cost_per_reasoning_token": 1.5e-06, - "output_cost_per_token": 1.5e-06, - "source": "https://ai.google.dev/gemini-api/docs/models", + "output_cost_per_token": 3.5e-06, + "source": "https://fal.ai/models/fal-ai/moondream3-preview/query", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" + "/v1/chat/completions" ], - "supports_audio_input": true, - "supports_audio_output": false, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014 + "supports_vision": true }, - "gemini-3.1-flash-lite": { - "cache_read_input_audio_token_cost": 5e-08, - "deprecation_date": "2027-05-07", - "cache_read_input_token_cost": 2.5e-08, - "cache_read_input_token_cost_flex": 1.25e-08, - "cache_read_input_token_cost_priority": 4.5e-08, - "input_cost_per_audio_token": 5e-07, - "input_cost_per_token": 2.5e-07, - "input_cost_per_token_batches": 1.25e-07, - "input_cost_per_token_flex": 1.25e-07, - "input_cost_per_token_priority": 4.5e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, + "featherless_ai/featherless-ai/Qwerky-72B": { + "litellm_provider": "featherless_ai", + "max_input_tokens": 32768, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat" + }, + "featherless_ai/featherless-ai/Qwerky-QwQ-32B": { + "litellm_provider": "featherless_ai", + "max_input_tokens": 32768, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat" + }, + "fireworks-ai-4.1b-to-16b": { + "input_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "output_cost_per_token": 2e-07 + }, + "fireworks-ai-56b-to-176b": { + "input_cost_per_token": 1.2e-06, + "litellm_provider": "fireworks_ai", + "output_cost_per_token": 1.2e-06 + }, + "fireworks-ai-above-16b": { + "input_cost_per_token": 9e-07, + "litellm_provider": "fireworks_ai", + "output_cost_per_token": 9e-07 + }, + "fireworks-ai-default": { + "input_cost_per_token": 0.0, + "litellm_provider": "fireworks_ai", + "output_cost_per_token": 0.0 + }, + "fireworks-ai-embedding-150m-to-350m": { + "input_cost_per_token": 1.6e-08, + "litellm_provider": "fireworks_ai-embedding-models", + "output_cost_per_token": 0.0 + }, + "fireworks-ai-embedding-up-to-150m": { + "input_cost_per_token": 8e-09, + "litellm_provider": "fireworks_ai-embedding-models", + "output_cost_per_token": 0.0 + }, + "fireworks-ai-moe-up-to-56b": { + "input_cost_per_token": 5e-07, + "litellm_provider": "fireworks_ai", + "output_cost_per_token": 5e-07 + }, + "fireworks-ai-up-to-4b": { + "input_cost_per_token": 1e-07, + "litellm_provider": "fireworks_ai", + "output_cost_per_token": 1e-07, + "source": "https://docs.fireworks.ai/serverless/pricing" + }, + "fireworks_ai/WhereIsAI/UAE-Large-V1": { + "input_cost_per_token": 1.6e-08, + "litellm_provider": "fireworks_ai-embedding-models", + "max_input_tokens": 512, + "max_tokens": 512, + "mode": "embedding", + "output_cost_per_token": 0.0, + "source": "https://fireworks.ai/pricing" + }, + "fireworks_ai/accounts/fireworks/models/deepseek-coder-v2-instruct": { + "input_cost_per_token": 1.2e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 65536, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_reasoning_token": 1.5e-06, - "output_cost_per_token": 1.5e-06, - "output_cost_per_token_batches": 7.5e-07, - "output_cost_per_token_flex": 7.5e-07, - "output_cost_per_token_priority": 2.7e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, - "supports_audio_output": false, + "output_cost_per_token": 1.2e-06, + "source": "https://fireworks.ai/pricing", + "supports_function_calling": false, + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/deepseek-r1": { + "input_cost_per_token": 3e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 128000, + "max_output_tokens": 20480, + "max_tokens": 20480, + "mode": "chat", + "output_cost_per_token": 8e-06, + "source": "https://fireworks.ai/pricing", + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/deepseek-r1-0528": { + "input_cost_per_token": 3e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 160000, + "max_output_tokens": 160000, + "max_tokens": 160000, + "mode": "chat", + "output_cost_per_token": 8e-06, + "source": "https://fireworks.ai/pricing", + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/deepseek-r1-basic": { + "input_cost_per_token": 5.5e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 128000, + "max_output_tokens": 20480, + "max_tokens": 20480, + "mode": "chat", + "output_cost_per_token": 2.19e-06, + "source": "https://fireworks.ai/pricing", + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/deepseek-v3": { + "input_cost_per_token": 9e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 9e-07, + "source": "https://fireworks.ai/pricing", + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/deepseek-v3-0324": { + "input_cost_per_token": 9e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 163840, + "max_output_tokens": 163840, + "max_tokens": 163840, + "mode": "chat", + "output_cost_per_token": 9e-07, + "source": "https://fireworks.ai/models/fireworks/deepseek-v3-0324", + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/deepseek-v3p1": { + "input_cost_per_token": 5.6e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 1.68e-06, + "source": "https://fireworks.ai/pricing", + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "fireworks_ai/accounts/fireworks/models/deepseek-v3p1-terminus": { + "input_cost_per_token": 5.6e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 1.68e-06, + "source": "https://fireworks.ai/pricing", + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "fireworks_ai/accounts/fireworks/models/deepseek-v3p2": { + "input_cost_per_token": 5.6e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 163840, + "max_output_tokens": 163840, + "max_tokens": 163840, + "mode": "chat", + "output_cost_per_token": 1.68e-06, + "source": "https://fireworks.ai/models/fireworks/deepseek-v3p2", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014, - "input_cost_per_audio_token_batches": 2.5e-07 + "supports_tool_choice": true }, - "gemini-3.5-flash-lite": { - "deprecation_date": "2027-07-21", - "cache_read_input_token_cost": 3e-08, - "cache_read_input_token_cost_flex": 1.5e-08, - "cache_read_input_token_cost_priority": 5.4e-08, - "input_cost_per_token": 3e-07, - "input_cost_per_token_batches": 1.5e-07, - "input_cost_per_token_flex": 1.5e-07, - "input_cost_per_token_priority": 5.4e-07, - "litellm_provider": "vertex_ai-language-models", + "fireworks_ai/accounts/fireworks/models/deepseek-v4-flash": { + "cache_read_input_token_cost": 2.8e-08, + "input_cost_per_token": 1.4e-07, + "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", - "output_cost_per_reasoning_token": 2.5e-06, - "output_cost_per_token": 2.5e-06, - "output_cost_per_token_batches": 1.25e-06, - "output_cost_per_token_flex": 1.25e-06, - "output_cost_per_token_priority": 4.5e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, - "supports_audio_output": false, + "output_cost_per_token": 2.8e-07, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014 - }, - "deep-research-pro-preview-12-2025": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_image": 0.0011, - "input_cost_per_token": 2e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 65536, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "image_generation", - "output_cost_per_image": 0.134, - "output_cost_per_image_token": 0.00012, - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_batches": 6e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text", - "image" - ], - "supports_function_calling": false, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_vision": true, - "supports_web_search": true + "supports_vision": false }, - "gemini-2.5-flash-lite": { - "cache_read_input_audio_token_cost": 3e-08, - "deprecation_date": "2026-10-20", - "cache_read_input_token_cost": 1e-08, - "cache_read_input_token_cost_flex": 1e-08, - "cache_read_input_token_cost_priority": 1.8e-08, - "input_cost_per_audio_token": 3e-07, - "input_cost_per_token": 1e-07, - "litellm_provider": "vertex_ai-language-models", + "fireworks_ai/accounts/fireworks/models/deepseek-v4-pro-0813": { + "cache_read_input_token_cost": 4.4e-08, + "cache_read_input_token_cost_priority": 5.5e-08, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 1.32e-06, + "input_cost_per_token_priority": 1.65e-06, + "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_reasoning_token": 4e-07, - "output_cost_per_token": 4e-07, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": false, + "output_cost_per_token": 3.96e-06, + "output_cost_per_token_priority": 4.95e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - }, - "google_maps_grounding_cost_per_query": 0.025, - "input_cost_per_audio_token_batches": 5e-08, - "input_cost_per_token_batches": 5e-08, - "input_cost_per_token_flex": 5e-08, - "input_cost_per_token_priority": 1.8e-07, - "output_cost_per_token_batches": 2e-07, - "output_cost_per_token_flex": 2e-07, - "output_cost_per_token_priority": 7.2e-07, - "supports_image_size": false + "supports_vision": false }, - "gemini-2.5-flash-lite-preview-09-2025": { - "cache_read_input_token_cost": 1e-08, - "input_cost_per_audio_token": 3e-07, - "input_cost_per_token": 1e-07, - "litellm_provider": "vertex_ai-language-models", + "fireworks_ai/deepseek-v4-pro-0813": { + "cache_read_input_token_cost": 4.4e-08, + "cache_read_input_token_cost_priority": 5.5e-08, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 1.32e-06, + "input_cost_per_token_priority": 1.65e-06, + "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_reasoning_token": 4e-07, - "output_cost_per_token": 4e-07, - "source": "https://developers.googleblog.com/en/continuing-to-bring-you-our-latest-models-with-an-improved-gemini-2-5-flash-and-flash-lite-release/", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": false, + "output_cost_per_token": 3.96e-06, + "output_cost_per_token_priority": 4.95e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - }, - "google_maps_grounding_cost_per_query": 0.025, - "supports_image_size": false + "supports_vision": false }, - "gemini-2.5-flash-preview-09-2025": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_audio_token": 1e-06, - "input_cost_per_token": 3e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "fireworks_ai/accounts/fireworks/models/firefunction-v2": { + "input_cost_per_token": 9e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 8192, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_reasoning_token": 2.5e-06, - "output_cost_per_token": 2.5e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": false, + "output_cost_per_token": 9e-07, + "source": "https://fireworks.ai/pricing", + "supports_function_calling": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "fireworks_ai/accounts/fireworks/models/glm-4p5": { + "input_cost_per_token": 5.5e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 128000, + "max_output_tokens": 96000, + "max_tokens": 96000, + "mode": "chat", + "output_cost_per_token": 2.19e-06, + "source": "https://fireworks.ai/models/fireworks/glm-4p5", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - }, - "google_maps_grounding_cost_per_query": 0.025, - "supports_image_size": false + "supports_tool_choice": true }, - "gemini-live-2.5-flash-native-audio": { - "deprecation_date": "2026-12-13", - "input_cost_per_audio_token": 3e-06, - "input_cost_per_token": 5e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 2e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", - "supported_endpoints": [ - "/vertex_ai/live", - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, + "fireworks_ai/accounts/fireworks/models/glm-4p5-air": { + "input_cost_per_token": 2.2e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 128000, + "max_output_tokens": 96000, + "max_tokens": 96000, + "mode": "chat", + "output_cost_per_token": 8.8e-07, + "source": "https://artificialanalysis.ai/models/glm-4-5-air", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_response_schema": false, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": false, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - }, - "gemini_native_audio": true, - "input_cost_per_image_token": 3e-06 + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true }, - "gemini-live-2.5-flash-preview-native-audio-09-2025": { - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_audio_token": 3e-06, - "input_cost_per_token": 5e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 2e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/vertex_ai/live" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, + "fireworks_ai/accounts/fireworks/models/glm-4p6": { + "input_cost_per_token": 5.5e-07, + "output_cost_per_token": 2.19e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 202800, + "max_output_tokens": 202800, + "max_tokens": 202800, + "mode": "chat", + "source": "https://fireworks.ai/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - }, - "gemini_native_audio": true, - "input_cost_per_image_token": 3e-06 + "supports_tool_choice": true }, - "gemini/gemini-live-2.5-flash-preview-native-audio-09-2025": { - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_audio_token": 3e-06, - "input_cost_per_token": 5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 2e-06, - "rpm": 100000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, + "fireworks_ai/accounts/fireworks/models/glm-4p7": { + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 6e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 202800, + "max_output_tokens": 202800, + "max_tokens": 202800, + "mode": "chat", + "output_cost_per_token": 2.2e-06, + "source": "https://fireworks.ai/models/fireworks/glm-4p7", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "tpm": 8000000, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - }, - "gemini_native_audio": true + "supports_tool_choice": true }, - "gemini-2.5-flash-lite-preview-06-17": { - "deprecation_date": "2025-11-18", - "cache_read_input_token_cost": 1e-08, - "input_cost_per_audio_token": 5e-07, - "input_cost_per_token": 1e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "fireworks_ai/accounts/fireworks/models/glm-5p1": { + "cache_read_input_token_cost": 2.6e-07, + "input_cost_per_token": 1.4e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 202800, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_reasoning_token": 4e-07, - "output_cost_per_token": 4e-07, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": false, + "output_cost_per_token": 4.4e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - }, - "google_maps_grounding_cost_per_query": 0.025, - "supports_image_size": false + "supports_vision": false }, - "gemini-2.5-pro": { - "deprecation_date": "2026-10-20", - "cache_read_input_token_cost": 1.25e-07, - "cache_read_input_token_cost_above_200k_tokens": 2.5e-07, - "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, - "cache_read_input_token_cost_above_200k_tokens_priority": 4.5e-07, - "cache_read_input_token_cost_flex": 1.25e-07, - "cache_read_input_token_cost_priority": 2.25e-07, - "input_cost_per_token": 1.25e-06, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "litellm_provider": "vertex_ai-language-models", + "fireworks_ai/accounts/fireworks/models/glm-5p2": { + "cache_read_input_token_cost": 1.4e-07, + "cache_read_input_token_cost_priority": 1.75e-07, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 1.4e-06, + "input_cost_per_token_priority": 1.75e-06, + "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1e-05, - "output_cost_per_token_above_200k_tokens": 1.5e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 4.4e-06, + "output_cost_per_token_priority": 5.5e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "prompt_cache_min_tokens": 2048, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - }, - "google_maps_grounding_cost_per_query": 0.025, - "input_cost_per_token_above_200k_tokens_priority": 4.5e-06, - "input_cost_per_token_batches": 6.25e-07, - "input_cost_per_token_flex": 6.25e-07, - "input_cost_per_token_priority": 2.25e-06, - "output_cost_per_token_above_200k_tokens_priority": 2.7e-05, - "output_cost_per_token_batches": 5e-06, - "output_cost_per_token_flex": 5e-06, - "output_cost_per_token_priority": 1.8e-05 + "supports_vision": false }, - "gemini-3-pro-preview": { - "deprecation_date": "2026-03-26", - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "fireworks_ai/accounts/fireworks/models/gpt-oss-120b": { + "cache_read_input_token_cost": 1.5e-08, + "cache_read_input_token_cost_priority": 1.8e-08, + "input_cost_per_token": 1.5e-07, + "input_cost_per_token_priority": 1.8e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_200k_tokens": 1.8e-05, - "output_cost_per_token_batches": 6e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 6e-07, + "output_cost_per_token_priority": 7.2e-07, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 3.6e-06, - "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, - "output_cost_per_token_priority": 2.16e-05, - "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, - "cache_read_input_token_cost_priority": 3.6e-07, - "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query" + "supports_vision": false }, - "gemini-3.1-pro-preview": { - "prompt_cache_min_tokens": 4096, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "fireworks_ai/accounts/fireworks/models/gpt-oss-20b": { + "cache_read_input_token_cost": 3.5e-08, + "input_cost_per_token": 7e-08, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_200k_tokens": 1.8e-05, - "output_cost_per_token_batches": 6e-06, - "output_cost_per_image": 0.00012, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 3e-07, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_url_context": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 3.6e-06, - "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, - "output_cost_per_token_priority": 2.16e-05, - "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, - "cache_read_input_token_cost_priority": 3.6e-07, - "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, - "cache_read_input_token_cost_flex": 2e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014, - "input_cost_per_token_flex": 1e-06, - "output_cost_per_token_flex": 6e-06 + "supports_vision": false }, - "gemini-3.1-pro-preview-customtools": { - "prompt_cache_min_tokens": 4096, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "fireworks_ai/accounts/fireworks/models/kimi-k2-instruct": { + "input_cost_per_token": 6e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_200k_tokens": 1.8e-05, - "output_cost_per_token_batches": 6e-06, - "output_cost_per_image": 0.00012, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#gemini-models", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 2.5e-06, + "source": "https://fireworks.ai/models/fireworks/kimi-k2-instruct", "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_url_context": true, - "supports_native_streaming": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014 + "supports_tool_choice": true }, - "vertex_ai/gemini-3-pro-preview": { - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "vertex_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "fireworks_ai/accounts/fireworks/models/kimi-k2-instruct-0905": { + "input_cost_per_token": 6e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_200k_tokens": 1.8e-05, - "output_cost_per_token_batches": 6e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 2.5e-06, + "source": "https://app.fireworks.ai/models/fireworks/kimi-k2-instruct-0905", "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 3.6e-06, - "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, - "output_cost_per_token_priority": 2.16e-05, - "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, - "cache_read_input_token_cost_priority": 3.6e-07, - "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query" + "supports_tool_choice": true }, - "vertex_ai/gemini-3-flash-preview": { - "cache_read_input_audio_token_cost": 1e-07, - "cache_read_input_token_cost": 5e-08, - "cache_read_input_token_cost_flex": 5e-08, - "input_cost_per_token": 5e-07, - "input_cost_per_audio_token": 1e-06, - "litellm_provider": "vertex_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "fireworks_ai/accounts/fireworks/models/kimi-k2-thinking": { + "input_cost_per_token": 6e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 2.5e-06, + "source": "https://fireworks.ai/pricing", "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 9e-07, - "input_cost_per_audio_token_priority": 1.8e-06, - "output_cost_per_token_priority": 5.4e-06, - "cache_read_input_token_cost_priority": 9e-08, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014, - "input_cost_per_audio_token_batches": 5e-07, - "input_cost_per_token_batches": 2.5e-07, - "input_cost_per_token_flex": 2.5e-07, - "output_cost_per_token_batches": 1.5e-06, - "output_cost_per_token_flex": 1.5e-06 + "supports_web_search": true }, - "vertex_ai/gemini-3.5-flash": { - "prompt_cache_min_tokens": 4096, - "deprecation_date": "2027-05-19", - "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_token": 1.5e-06, - "input_cost_per_audio_token": 1.5e-06, - "litellm_provider": "vertex_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "fireworks_ai/accounts/fireworks/models/kimi-k2p5": { + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 6e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_reasoning_token": 9e-06, - "output_cost_per_token": 9e-06, - "regional_endpoint_uplift_multiplier": 1.1, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 3e-06, + "source": "https://fireworks.ai/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 2.7e-06, - "input_cost_per_audio_token_priority": 2.7e-06, - "output_cost_per_token_priority": 1.62e-05, - "cache_read_input_token_cost_priority": 2.7e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014, - "input_cost_per_token_batches": 7.5e-07, - "output_cost_per_token_batches": 4.5e-06, - "input_cost_per_token_flex": 7.5e-07, - "output_cost_per_token_flex": 4.5e-06, - "cache_read_input_token_cost_flex": 7.5e-08 + "supports_tool_choice": true }, - "vertex_ai/gemini-3.6-flash": { - "prompt_cache_min_tokens": 4096, - "cache_read_input_token_cost": 7.5e-08, - "cache_read_input_token_cost_flex": 3.75e-08, - "input_cost_per_token": 7.5e-07, - "input_cost_per_token_batches": 3.75e-07, - "input_cost_per_token_flex": 3.75e-07, - "litellm_provider": "vertex_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "fireworks_ai/accounts/fireworks/models/kimi-k2p6": { + "cache_read_input_token_cost": 1.6e-07, + "cache_read_input_token_cost_priority": 2.2e-07, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 9.5e-07, + "input_cost_per_token_priority": 1.5e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_reasoning_token": 3.75e-06, - "output_cost_per_token": 3.75e-06, - "output_cost_per_token_batches": 1.875e-06, - "output_cost_per_token_flex": 1.875e-06, - "regional_endpoint_uplift_multiplier": 1.1, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 4e-06, + "output_cost_per_token_priority": 6e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 1.35e-06, - "output_cost_per_token_priority": 6.75e-06, - "cache_read_input_token_cost_priority": 1.35e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014 + "supports_vision": true }, - "vertex_ai/gemini-3.7-flash": { - "prompt_cache_min_tokens": 4096, - "cache_read_input_token_cost": 7.5e-08, - "cache_read_input_token_cost_flex": 3.75e-08, - "input_cost_per_token": 7.5e-07, - "input_cost_per_token_batches": 3.75e-07, - "input_cost_per_token_flex": 3.75e-07, - "litellm_provider": "vertex_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "fireworks_ai/accounts/fireworks/models/kimi-k2p7-code": { + "cache_read_input_token_cost": 1.9e-07, + "cache_read_input_token_cost_priority": 2.85e-07, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 9.5e-07, + "input_cost_per_token_priority": 1.425e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_reasoning_token": 3.75e-06, - "output_cost_per_token": 3.75e-06, - "output_cost_per_token_batches": 1.875e-06, - "output_cost_per_token_flex": 1.875e-06, - "regional_endpoint_uplift_multiplier": 1.1, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 4e-06, + "output_cost_per_token_priority": 6e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, - "supports_minimal_reasoning_effort": false, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 1.35e-06, - "output_cost_per_token_priority": 6.75e-06, - "cache_read_input_token_cost_priority": 1.35e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014 + "supports_vision": true }, - "vertex_ai/gemini-3.8-flash": { - "prompt_cache_min_tokens": 4096, - "cache_read_input_token_cost": 7.5e-08, - "cache_read_input_token_cost_flex": 3.75e-08, - "input_cost_per_token": 7.5e-07, - "input_cost_per_token_batches": 3.75e-07, - "input_cost_per_token_flex": 3.75e-07, - "litellm_provider": "vertex_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "fireworks_ai/accounts/fireworks/models/llama-v3p1-405b-instruct": { + "input_cost_per_token": 3e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_reasoning_token": 3.75e-06, - "output_cost_per_token": 3.75e-06, - "output_cost_per_token_batches": 1.875e-06, - "output_cost_per_token_flex": 1.875e-06, - "regional_endpoint_uplift_multiplier": 1.1, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 3e-06, + "source": "https://fireworks.ai/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_minimal_reasoning_effort": false, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 1.35e-06, - "output_cost_per_token_priority": 6.75e-06, - "cache_read_input_token_cost_priority": 1.35e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014 + "supports_tool_choice": true }, - "vertex_ai/gemini-3.1-pro-preview": { - "prompt_cache_min_tokens": 4096, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "vertex_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "fireworks_ai/accounts/fireworks/models/llama-v3p1-8b-instruct": { + "input_cost_per_token": 1e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 16384, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_200k_tokens": 1.8e-05, - "output_cost_per_token_batches": 6e-06, - "output_cost_per_image": 0.00012, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, + "output_cost_per_token": 1e-07, + "source": "https://fireworks.ai/pricing", + "supports_function_calling": false, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_url_context": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 3.6e-06, - "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, - "output_cost_per_token_priority": 2.16e-05, - "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, - "cache_read_input_token_cost_priority": 3.6e-07, - "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, - "cache_read_input_token_cost_flex": 2e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014, - "input_cost_per_token_flex": 1e-06, - "output_cost_per_token_flex": 6e-06 + "supports_tool_choice": false }, - "vertex_ai/gemini-3.1-pro-preview-customtools": { - "prompt_cache_min_tokens": 4096, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "vertex_ai", - "max_input_tokens": 1048576, + "fireworks_ai/accounts/fireworks/models/llama-v3p2-11b-vision-instruct": { + "input_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 16384, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 2e-07, + "source": "https://fireworks.ai/pricing", + "supports_function_calling": false, + "supports_response_schema": true, + "supports_tool_choice": false, + "supports_vision": true + }, + "fireworks_ai/accounts/fireworks/models/llama-v3p2-1b-instruct": { + "input_cost_per_token": 1e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 16384, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1e-07, + "source": "https://fireworks.ai/pricing", + "supports_function_calling": false, + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/llama-v3p2-3b-instruct": { + "input_cost_per_token": 1e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 16384, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1e-07, + "source": "https://fireworks.ai/pricing", + "supports_function_calling": false, + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/llama-v3p2-90b-vision-instruct": { + "input_cost_per_token": 9e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 16384, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 9e-07, + "source": "https://fireworks.ai/pricing", + "supports_response_schema": true, + "supports_tool_choice": false, + "supports_vision": true + }, + "fireworks_ai/accounts/fireworks/models/llama4-maverick-instruct-basic": { + "input_cost_per_token": 2.2e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 131072, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 8.8e-07, + "source": "https://fireworks.ai/pricing", + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/llama4-scout-instruct-basic": { + "input_cost_per_token": 1.5e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 131072, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 6e-07, + "source": "https://fireworks.ai/pricing", + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/minimax-m2p1": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 3e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 204800, + "max_output_tokens": 204800, + "max_tokens": 204800, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "source": "https://fireworks.ai/models/fireworks/minimax-m2p1", + "supports_function_calling": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "fireworks_ai/accounts/fireworks/models/minimax-m3": { + "cache_read_input_token_cost": 6e-08, + "cache_read_input_token_cost_priority": 9e-08, + "input_cost_per_token": 3e-07, + "input_cost_per_token_priority": 4.5e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 512000, + "max_output_tokens": 512000, + "max_tokens": 512000, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "output_cost_per_token_priority": 1.8e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false + }, + "fireworks_ai/accounts/fireworks/models/mixtral-8x22b-instruct-hf": { + "input_cost_per_token": 1.2e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 65536, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_200k_tokens": 1.8e-05, - "output_cost_per_token_batches": 6e-06, - "output_cost_per_image": 0.00012, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#gemini-models", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 1.2e-06, + "source": "https://fireworks.ai/pricing", + "supports_function_calling": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "fireworks_ai/accounts/fireworks/models/qwen2-72b-instruct": { + "input_cost_per_token": 9e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 32768, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 9e-07, + "source": "https://fireworks.ai/pricing", + "supports_function_calling": false, + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/qwen2p5-coder-32b-instruct": { + "input_cost_per_token": 9e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 4096, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 9e-07, + "source": "https://fireworks.ai/pricing", + "supports_function_calling": false, + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/accounts/fireworks/models/yi-large": { + "input_cost_per_token": 3e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 32768, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 3e-06, + "source": "https://fireworks.ai/pricing", + "supports_function_calling": false, + "supports_response_schema": true, + "supports_tool_choice": false + }, + "fireworks_ai/deepseek-v4-flash": { + "cache_read_input_token_cost": 2.8e-08, + "input_cost_per_token": 1.4e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 384000, + "max_tokens": 384000, + "mode": "chat", + "output_cost_per_token": 2.8e-07, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_url_context": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 3.6e-06, - "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, - "output_cost_per_token_priority": 2.16e-05, - "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, - "cache_read_input_token_cost_priority": 3.6e-07, - "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014 + "supports_vision": false }, - "gemini-2.5-pro-preview-tts": { - "cache_read_input_token_cost": 1.25e-07, - "input_cost_per_audio_token": 7e-07, - "input_cost_per_token": 1e-06, - "input_cost_per_token_batches": 5e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "fireworks_ai/glm-4p7": { + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 6e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 202800, + "max_output_tokens": 202800, + "max_tokens": 202800, "mode": "chat", - "output_cost_per_audio_token": 2e-05, - "output_cost_per_token": 2e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_modalities": [ - "text" - ], - "supported_output_modalities": [ - "audio" - ], - "supports_audio_output": false, + "output_cost_per_token": 2.2e-06, + "source": "https://fireworks.ai/models/fireworks/glm-4p7", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "fireworks_ai/glm-5p1": { + "cache_read_input_token_cost": 2.6e-07, + "input_cost_per_token": 1.4e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 202800, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 4.4e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", + "supports_function_calling": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } + "supports_vision": false }, - "gemini-robotics-er-1.5-preview": { - "cache_read_input_token_cost": 0, - "input_cost_per_token": 3e-07, - "input_cost_per_audio_token": 1e-06, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "fireworks_ai/glm-5p1-fast": { + "cache_read_input_token_cost": 5.2e-07, + "input_cost_per_token": 2.8e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 202800, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "output_cost_per_reasoning_token": 2.5e-06, - "source": "https://ai.google.dev/gemini-api/docs/models#gemini-robotics-er-1-5-preview", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions" - ], - "supported_modalities": [ - "text", - "image", - "video", - "audio" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": false, + "output_cost_per_token": 8.8e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true + "supports_vision": false }, - "gemini/gemini-robotics-er-1.5-preview": { - "cache_read_input_token_cost": 0, - "deprecation_date": "2026-04-30", - "input_cost_per_token": 3e-07, - "input_cost_per_audio_token": 1e-06, - "litellm_provider": "gemini", + "fireworks_ai/glm-5p2": { + "cache_read_input_token_cost": 1.4e-07, + "cache_read_input_token_cost_priority": 1.75e-07, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 1.4e-06, + "input_cost_per_token_priority": 1.75e-06, + "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "output_cost_per_reasoning_token": 2.5e-06, - "source": "https://ai.google.dev/gemini-api/docs/models#gemini-robotics-er-1-5-preview", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions" - ], - "supported_modalities": [ - "text", - "image", - "video", - "audio" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": false, + "output_cost_per_token": 4.4e-06, + "output_cost_per_token_priority": 5.5e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "tpm": 250000, - "rpm": 10, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } + "supports_vision": false }, - "gemini/gemini-robotics-er-2-preview": { - "cache_read_input_token_cost": 1e-07, - "input_cost_per_audio_token": 2e-06, - "input_cost_per_token": 1e-06, - "input_cost_per_token_batches": 5e-07, - "litellm_provider": "gemini", + "fireworks_ai/gpt-oss-120b": { + "cache_read_input_token_cost": 1.5e-08, + "cache_read_input_token_cost_priority": 1.8e-08, + "input_cost_per_token": 1.5e-07, + "input_cost_per_token_priority": 1.8e-07, + "litellm_provider": "fireworks_ai", "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_reasoning_token": 1e-05, - "output_cost_per_token": 5e-06, - "output_cost_per_token_batches": 2.5e-06, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, - "supports_audio_output": false, + "output_cost_per_token": 6e-07, + "output_cost_per_token_priority": 7.2e-07, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "web_search_billing_unit": "per_query" + "supports_vision": false }, - "gemini/gemini-robotics-er-1.6-preview": { - "deprecation_date": "2026-08-31", - "input_cost_per_audio_token": 2e-06, - "input_cost_per_token": 1e-06, - "litellm_provider": "gemini", + "fireworks_ai/gpt-oss-20b": { + "cache_read_input_token_cost": 3.5e-08, + "input_cost_per_token": 7e-08, + "litellm_provider": "fireworks_ai", "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_reasoning_token": 5e-06, - "output_cost_per_token": 5e-06, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "source": "https://ai.google.dev/gemini-api/docs/pricing#gemini-robotics-er", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, - "supports_audio_output": false, + "output_cost_per_token": 3e-07, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "web_search_billing_unit": "per_query" + "supports_vision": false }, - "gemini-2.5-computer-use-preview-10-2025": { - "input_cost_per_token": 1.25e-06, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 128000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "fireworks_ai/kimi-k2p5": { + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 6e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 1e-05, - "output_cost_per_token_above_200k_tokens": 1.5e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_computer_use": true, + "output_cost_per_token": 3e-06, + "source": "https://fireworks.ai/pricing", "supports_function_calling": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_tool_choice": true }, - "gemini-embedding-001": { - "deprecation_date": "2028-05-20", - "input_cost_per_token": 1.5e-07, - "litellm_provider": "vertex_ai-embedding-models", - "max_input_tokens": 2048, - "max_tokens": 2048, - "mode": "embedding", - "output_cost_per_token": 0, - "output_vector_size": 3072, - "source": "https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models" + "fireworks_ai/kimi-k2p6": { + "cache_read_input_token_cost": 1.6e-07, + "cache_read_input_token_cost_priority": 2.2e-07, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 9.5e-07, + "input_cost_per_token_priority": 1.5e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 4e-06, + "output_cost_per_token_priority": 6e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "gemini-embedding-2-preview": { - "input_cost_per_audio_token": 6.5e-06, - "input_cost_per_audio_token_batches": 3.25e-06, - "input_cost_per_image_token": 4.5e-07, - "input_cost_per_image_token_batches": 2.25e-07, - "input_cost_per_token": 2e-07, - "input_cost_per_token_batches": 1e-07, - "input_cost_per_video_token": 1.2e-05, - "input_cost_per_video_token_batches": 6e-06, - "litellm_provider": "vertex_ai-embedding-models", - "max_input_tokens": 8192, - "max_tokens": 8192, - "mode": "embedding", - "output_cost_per_token": 0, - "output_vector_size": 3072, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", - "uses_embed_content": true + "fireworks_ai/kimi-k2p6-fast": { + "cache_read_input_token_cost": 3e-07, + "deprecation_date": "2026-08-27", + "input_cost_per_token": 2e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 8e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "gemini-embedding-2": { - "input_cost_per_audio_token": 6.5e-06, - "input_cost_per_audio_token_batches": 3.25e-06, - "input_cost_per_image_token": 4.5e-07, - "input_cost_per_image_token_batches": 2.25e-07, - "input_cost_per_token": 2e-07, - "input_cost_per_token_batches": 1e-07, - "input_cost_per_video_token": 1.2e-05, - "input_cost_per_video_token_batches": 6e-06, - "litellm_provider": "vertex_ai-embedding-models", - "max_input_tokens": 8192, - "max_tokens": 8192, - "mode": "embedding", - "output_cost_per_token": 0, - "output_vector_size": 3072, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supports_multimodal": true, - "uses_embed_content": true + "fireworks_ai/kimi-k2p7-code": { + "cache_read_input_token_cost": 1.9e-07, + "cache_read_input_token_cost_priority": 2.85e-07, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 9.5e-07, + "input_cost_per_token_priority": 1.425e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 4e-06, + "output_cost_per_token_priority": 6e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "vertex_ai/gemini-embedding-2-preview": { - "input_cost_per_audio_token": 6.5e-06, - "input_cost_per_audio_token_batches": 3.25e-06, - "input_cost_per_image_token": 4.5e-07, - "input_cost_per_image_token_batches": 2.25e-07, - "input_cost_per_token": 2e-07, - "input_cost_per_token_batches": 1e-07, - "input_cost_per_video_token": 1.2e-05, - "input_cost_per_video_token_batches": 6e-06, - "litellm_provider": "vertex_ai", - "max_input_tokens": 8192, - "max_tokens": 8192, - "mode": "embedding", - "output_cost_per_token": 0, - "output_vector_size": 3072, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", - "supports_multimodal": true, - "uses_embed_content": true + "fireworks_ai/kimi-k2p7-code-fast": { + "cache_read_input_token_cost": 3.8e-07, + "deprecation_date": "2026-08-27", + "input_cost_per_token": 1.9e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 8e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "vertex_ai/gemini-embedding-2": { - "input_cost_per_audio_token": 6.5e-06, - "input_cost_per_audio_token_batches": 3.25e-06, - "input_cost_per_image_token": 4.5e-07, - "input_cost_per_image_token_batches": 2.25e-07, - "input_cost_per_token": 2e-07, - "input_cost_per_token_batches": 1e-07, - "input_cost_per_video_token": 1.2e-05, - "input_cost_per_video_token_batches": 6e-06, - "litellm_provider": "vertex_ai", - "max_input_tokens": 8192, - "max_tokens": 8192, - "mode": "embedding", - "output_cost_per_token": 0, - "output_vector_size": 3072, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supports_multimodal": true, - "uses_embed_content": true + "fireworks_ai/minimax-m2p1": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 3e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 204800, + "max_output_tokens": 204800, + "max_tokens": 204800, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "source": "https://fireworks.ai/models/fireworks/minimax-m2p1", + "supports_function_calling": true, + "supports_response_schema": true, + "supports_tool_choice": true }, - "gemini-flash-experimental": { - "input_cost_per_character": 0, - "input_cost_per_token": 0, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1000000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "embedding", - "output_cost_per_token": 0, - "output_vector_size": 3072, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", - "uses_embed_content": true + "fireworks_ai/minimax-m3": { + "cache_read_input_token_cost": 6e-08, + "cache_read_input_token_cost_priority": 9e-08, + "input_cost_per_token": 3e-07, + "input_cost_per_token_priority": 4.5e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 512000, + "max_output_tokens": 512000, + "max_tokens": 512000, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "output_cost_per_token_priority": 1.8e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "gemini/gemini-embedding-001": { - "deprecation_date": "2028-05-14", - "input_cost_per_token": 1.5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 2048, - "max_tokens": 2048, - "mode": "embedding", - "output_cost_per_token": 0, - "output_vector_size": 3072, - "rpm": 10000, - "source": "https://ai.google.dev/gemini-api/docs/embeddings#model-versions", - "tpm": 10000000 + "fireworks_ai/qwen3p7-plus": { + "cache_read_input_token_cost": 8e-08, + "input_cost_per_token": 4e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 1.6e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "gemini/gemini-embedding-2-preview": { - "deprecation_date": "2026-08-10", - "input_cost_per_audio_token": 6.5e-06, - "input_cost_per_audio_token_batches": 3.25e-06, - "input_cost_per_image_token": 4.5e-07, - "input_cost_per_image_token_batches": 2.25e-07, - "input_cost_per_token": 2e-07, - "input_cost_per_token_batches": 1e-07, - "input_cost_per_video_token": 1.2e-05, - "input_cost_per_video_token_batches": 6e-06, - "litellm_provider": "gemini", + "fireworks_ai/nomic-ai/nomic-embed-text-v1": { + "input_cost_per_token": 8e-09, + "litellm_provider": "fireworks_ai-embedding-models", "max_input_tokens": 8192, "max_tokens": 8192, "mode": "embedding", - "output_cost_per_token": 0, - "output_vector_size": 3072, - "rpm": 10000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supports_multimodal": true, - "tpm": 10000000 + "output_cost_per_token": 0.0, + "source": "https://fireworks.ai/pricing" }, - "gemini/gemini-embedding-2": { - "input_cost_per_audio_token": 6.5e-06, - "input_cost_per_audio_token_batches": 3.25e-06, - "input_cost_per_image_token": 4.5e-07, - "input_cost_per_image_token_batches": 2.25e-07, - "input_cost_per_token": 2e-07, - "input_cost_per_token_batches": 1e-07, - "input_cost_per_video_token": 1.2e-05, - "input_cost_per_video_token_batches": 6e-06, - "litellm_provider": "gemini", + "fireworks_ai/nomic-ai/nomic-embed-text-v1.5": { + "input_cost_per_token": 8e-09, + "litellm_provider": "fireworks_ai-embedding-models", "max_input_tokens": 8192, "max_tokens": 8192, "mode": "embedding", - "output_cost_per_token": 0, - "output_vector_size": 3072, - "rpm": 10000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supports_audio_input": true, - "supports_multimodal": true, - "supports_vision": true, - "tpm": 10000000 + "output_cost_per_token": 0.0, + "source": "https://fireworks.ai/pricing" }, - "gemini/gemini-1.5-flash": { - "deprecation_date": "2025-09-29", - "input_cost_per_token": 7.5e-08, - "input_cost_per_token_above_128k_tokens": 1.5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 8192, - "max_tokens": 8192, + "fireworks_ai/thenlper/gte-base": { + "input_cost_per_token": 8e-09, + "litellm_provider": "fireworks_ai-embedding-models", + "max_input_tokens": 512, + "max_tokens": 512, "mode": "embedding", - "output_cost_per_token": 0, - "output_vector_size": 3072, - "rpm": 10000, - "source": "https://ai.google.dev/gemini-api/docs/embeddings#multimodal", - "supports_multimodal": true, - "tpm": 10000000 + "output_cost_per_token": 0.0, + "source": "https://fireworks.ai/pricing" }, - "gemini/gemini-2.0-flash": { - "cache_read_input_token_cost": 2.5e-08, - "deprecation_date": "2026-06-01", - "input_cost_per_audio_token": 7e-07, - "input_cost_per_token": 1e-07, - "litellm_provider": "gemini", + "fireworks_ai/thenlper/gte-large": { + "input_cost_per_token": 1.6e-08, + "litellm_provider": "fireworks_ai-embedding-models", + "max_input_tokens": 512, + "max_tokens": 512, + "mode": "embedding", + "output_cost_per_token": 0.0, + "source": "https://fireworks.ai/pricing" + }, + "friendliai/zai-org/GLM-5.3-Flash": { + "litellm_provider": "friendliai", "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 4e-07, - "rpm": 10000, - "source": "https://ai.google.dev/pricing#2_0flash", - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text", - "image" + "max_output_tokens": 1048576, + "max_tokens": 1048576, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 5e-07, + "cache_read_input_token_cost": 3e-08, + "supports_prompt_caching": true, + "supports_reasoning": true, + "reasoning_effort_levels": [ + "low", + "high", + "max" ], - "supports_audio_input": true, - "supports_audio_output": true, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_parallel_function_calling": true, "supports_response_schema": true, + "supports_native_structured_output": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, "supports_vision": true, - "supports_web_search": true, - "tpm": 10000000, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } + "supports_image_input": true, + "supports_video_input": true, + "mode": "chat", + "comment": "Native multimodal GLM model for efficient coding and long-horizon agent tasks", + "source": "https://api.friendli.ai/serverless/v1/models" }, - "gemini/gemini-2.0-flash-001": { - "cache_read_input_token_cost": 2.5e-08, - "deprecation_date": "2026-06-01", - "input_cost_per_audio_token": 7e-07, - "input_cost_per_token": 1e-07, - "litellm_provider": "gemini", + "friendliai/zai-org/GLM-5.3": { + "litellm_provider": "friendliai", "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 1048576, + "max_tokens": 1048576, + "input_cost_per_token": 1.26e-06, + "output_cost_per_token": 3.96e-06, + "cache_read_input_token_cost": 2.34e-07, + "supports_prompt_caching": true, + "supports_reasoning": true, + "reasoning_effort_levels": [ + "low", + "high", + "max" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_native_structured_output": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_image_input": false, + "supports_video_input": false, "mode": "chat", + "comment": "Flagship GLM model for long-horizon coding, agents, and complex project delivery", + "source": "https://api.friendli.ai/serverless/v1/models" + }, + "friendliai/google/gemma-4-31B-it": { + "litellm_provider": "friendliai", + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "max_tokens": 262144, + "input_cost_per_token": 1.4e-07, "output_cost_per_token": 4e-07, - "rpm": 10000, - "source": "https://ai.google.dev/pricing#2_0flash", - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text", - "image" - ], - "supports_audio_output": false, + "supports_prompt_caching": false, + "supports_reasoning": true, + "reasoning_effort_levels": [], "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_parallel_function_calling": true, "supports_response_schema": true, + "supports_native_structured_output": true, "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true, - "tpm": 10000000, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } + "supports_image_input": true, + "supports_video_input": false, + "mode": "chat", + "comment": "Largest Gemma 4 instruction model for open, self-hosted chat and reasoning", + "source": "https://api.friendli.ai/serverless/v1/models" }, - "gemini/gemini-2.0-flash-lite": { - "cache_read_input_token_cost": 1.875e-08, - "deprecation_date": "2026-06-01", - "input_cost_per_audio_token": 7.5e-08, - "input_cost_per_token": 7.5e-08, - "litellm_provider": "gemini", + "friendliai/zai-org/GLM-5.2": { + "litellm_provider": "friendliai", "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 3e-07, - "rpm": 4000, - "source": "https://ai.google.dev/gemini-api/docs/pricing#gemini-2.0-flash-lite", - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" + "max_output_tokens": 1048576, + "max_tokens": 1048576, + "input_cost_per_token": 1.4e-06, + "output_cost_per_token": 4.4e-06, + "cache_read_input_token_cost": 2.6e-07, + "supports_prompt_caching": true, + "supports_reasoning": true, + "reasoning_effort_levels": [ + "high", + "max" ], - "supports_audio_output": true, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_parallel_function_calling": true, "supports_response_schema": true, + "supports_native_structured_output": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "tpm": 4000000, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } - }, - "gemini/gemini-2.5-flash": { - "cache_read_input_audio_token_cost": 1e-07, - "cache_read_input_token_cost": 3e-08, - "cache_read_input_token_cost_flex": 3e-08, - "cache_read_input_token_cost_priority": 5.4e-08, - "input_cost_per_audio_token": 1e-06, - "input_cost_per_token": 3e-07, - "litellm_provider": "gemini", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "supports_vision": false, + "supports_image_input": false, + "supports_video_input": false, "mode": "chat", - "output_cost_per_reasoning_token": 2.5e-06, - "output_cost_per_token": 2.5e-06, - "rpm": 100000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": false, + "comment": "Open flagship GLM for long-horizon coding agents and million-token context work", + "source": "https://api.friendli.ai/serverless/v1/models" + }, + "friendliai/deepseek-ai/DeepSeek-V3.2": { + "litellm_provider": "friendliai", + "max_input_tokens": 163840, + "max_output_tokens": 163840, + "max_tokens": 163840, + "input_cost_per_token": 5e-07, + "output_cost_per_token": 1.5e-06, + "cache_read_input_token_cost": 2.5e-07, + "supports_prompt_caching": true, + "supports_reasoning": true, + "reasoning_effort_levels": [], "supports_function_calling": true, "supports_parallel_function_calling": true, - "supports_pdf_input": true, + "supports_response_schema": true, + "supports_native_structured_output": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_image_input": false, + "supports_video_input": false, + "mode": "chat", + "comment": "DeepSeek chat model for instruction following, coding, and analysis", + "source": "https://api.friendli.ai/serverless/v1/models" + }, + "friendliai/MiniMaxAI/MiniMax-M2.5": { + "litellm_provider": "friendliai", + "max_input_tokens": 196608, + "max_output_tokens": 196608, + "max_tokens": 196608, + "input_cost_per_token": 3e-07, + "output_cost_per_token": 1.2e-06, + "cache_read_input_token_cost": 6e-08, "supports_prompt_caching": true, "supports_reasoning": true, + "reasoning_effort_levels": [], + "supports_function_calling": true, + "supports_parallel_function_calling": true, "supports_response_schema": true, + "supports_native_structured_output": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, + "supports_vision": false, + "supports_image_input": false, + "supports_video_input": false, + "mode": "chat", + "comment": "Prior MiniMax coding model for agent workflows, office edits, and automation", + "source": "https://api.friendli.ai/serverless/v1/models" + }, + "friendliai/zai-org/GLM-5.1": { + "litellm_provider": "friendliai", + "max_input_tokens": 202752, + "max_output_tokens": 202752, + "max_tokens": 202752, + "input_cost_per_token": 1.4e-06, + "output_cost_per_token": 4.4e-06, + "cache_read_input_token_cost": 2.6e-07, + "supports_prompt_caching": true, + "supports_reasoning": true, + "reasoning_effort_levels": [], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_native_structured_output": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_image_input": false, + "supports_video_input": false, + "mode": "chat", + "comment": "Strong GLM coding model for agentic engineering, terminals, and repository generation", + "source": "https://api.friendli.ai/serverless/v1/models" + }, + "ft:babbage-002": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 1.6e-06, + "input_cost_per_token_batches": 8e-07, + "litellm_provider": "text-completion-openai", + "max_input_tokens": 16384, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "completion", + "output_cost_per_token": 1.6e-06, + "output_cost_per_token_batches": 9e-07, + "source": "https://developers.openai.com/api/docs/pricing" + }, + "ft:davinci-002": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 1.2e-05, + "input_cost_per_token_batches": 6e-06, + "litellm_provider": "text-completion-openai", + "max_input_tokens": 16384, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "completion", + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_batches": 6e-06, + "source": "https://developers.openai.com/api/docs/pricing" + }, + "ft:gpt-3.5-turbo": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 3e-06, + "input_cost_per_token_batches": 1.5e-06, + "litellm_provider": "openai", + "max_input_tokens": 16385, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 6e-06, + "output_cost_per_token_batches": 3e-06, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_system_messages": true, + "supports_tool_choice": true + }, + "ft:gpt-3.5-turbo-0125": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 3e-06, + "litellm_provider": "openai", + "max_input_tokens": 16385, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 6e-06, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "ft:gpt-3.5-turbo-0613": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 3e-06, + "litellm_provider": "openai", + "max_input_tokens": 4096, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 6e-06, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "ft:gpt-3.5-turbo-1106": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 3e-06, + "litellm_provider": "openai", + "max_input_tokens": 16385, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 6e-06, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "ft:gpt-4-0613": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 3e-05, + "litellm_provider": "openai", + "max_input_tokens": 8192, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 6e-05, + "source": "OpenAI needs to add pricing for this ft model, will be updated when added by OpenAI. Defaulting to base model pricing", + "supports_function_calling": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "ft:gpt-4o-2024-08-06": { + "cache_read_input_token_cost": 1.875e-06, + "cache_read_input_token_cost_batches": 9e-07, + "input_cost_per_token": 3.75e-06, + "input_cost_per_token_batches": 2.225e-06, + "litellm_provider": "openai", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.5e-05, + "output_cost_per_token_batches": 1.25e-05, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "ft:gpt-4o-2024-11-20": { + "cache_creation_input_token_cost": 1.875e-06, + "input_cost_per_token": 3.75e-06, + "litellm_provider": "openai", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.5e-05, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "ft:gpt-4o-mini-2024-07-18": { + "cache_read_input_token_cost": 1.5e-07, + "cache_read_input_token_cost_batches": 7.5e-08, + "input_cost_per_token": 3e-07, + "input_cost_per_token_batches": 1.5e-07, + "litellm_provider": "openai", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "output_cost_per_token_batches": 6e-07, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "ft:gpt-4.1-2025-04-14": { + "cache_read_input_token_cost": 7.5e-07, + "cache_read_input_token_cost_batches": 5e-07, + "input_cost_per_token": 3e-06, + "input_cost_per_token_batches": 1.5e-06, + "litellm_provider": "openai", + "max_input_tokens": 1047576, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_batches": 6e-06, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "ft:gpt-4.1-mini-2025-04-14": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1e-07, + "input_cost_per_token": 8e-07, + "input_cost_per_token_batches": 4e-07, + "litellm_provider": "openai", + "max_input_tokens": 1047576, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 3.2e-06, + "output_cost_per_token_batches": 1.6e-06, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "ft:gpt-4.1-nano-2025-04-14": { + "cache_read_input_token_cost": 5e-08, + "cache_read_input_token_cost_batches": 2.5e-08, + "deprecation_date": "2026-10-23", + "input_cost_per_token": 2e-07, + "input_cost_per_token_batches": 1e-07, + "litellm_provider": "openai", + "max_input_tokens": 1047576, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 8e-07, + "output_cost_per_token_batches": 4e-07, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "ft:o4-mini-2025-04-16": { + "cache_read_input_token_cost": 1e-06, + "cache_read_input_token_cost_batches": 5e-07, + "deprecation_date": "2026-10-23", + "input_cost_per_token": 4e-06, + "input_cost_per_token_batches": 2e-06, + "litellm_provider": "openai", + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, + "mode": "chat", + "output_cost_per_token": 1.6e-05, + "output_cost_per_token_batches": 8e-06, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_parallel_function_calling": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "gemini-2.5-flash": { + "cache_read_input_audio_token_cost": 1e-07, + "deprecation_date": "2026-10-20", + "cache_read_input_token_cost": 3e-08, + "cache_read_input_token_cost_flex": 3e-08, + "cache_read_input_token_cost_priority": 5.4e-08, + "input_cost_per_audio_token": 1e-06, + "input_cost_per_token": 3e-07, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1048576, + "max_output_tokens": 65535, + "max_tokens": 65535, + "mode": "chat", + "output_cost_per_reasoning_token": 2.5e-06, + "output_cost_per_token": 2.5e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_output": false, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, "supports_vision": true, "supports_web_search": true, - "tpm": 8000000, "search_context_cost_per_query": { "search_context_size_low": 0.035, "search_context_size_medium": 0.035, @@ -27321,23 +26876,20 @@ "input_cost_per_token_batches": 1.5e-07, "input_cost_per_token_flex": 1.5e-07, "input_cost_per_token_priority": 5.4e-07, + "input_cost_per_audio_token_priority": 1.8e-06, "output_cost_per_token_batches": 1.25e-06, "output_cost_per_token_flex": 1.25e-06, "output_cost_per_token_priority": 4.5e-06, - "supports_audio_input": true, "supports_image_size": false }, - "gemini/gemini-2.5-flash-image": { - "cache_read_input_token_cost": 3e-08, - "deprecation_date": "2026-10-02", + "gemini-2.5-flash-image": { + "deprecation_date": "2027-03-15", "input_cost_per_audio_token": 1e-06, "input_cost_per_token": 3e-07, "input_cost_per_token_batches": 1.5e-07, "input_cost_per_token_flex": 1.5e-07, - "input_cost_per_token_priority": 5.4e-07, - "litellm_provider": "gemini", - "supports_reasoning": false, - "max_input_tokens": 65536, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 32768, "max_output_tokens": 32768, "max_tokens": 32768, "mode": "image_generation", @@ -27345,8 +26897,10 @@ "output_cost_per_image_token": 3e-05, "output_cost_per_reasoning_token": 2.5e-06, "output_cost_per_token": 2.5e-06, + "output_cost_per_token_batches": 1.25e-06, + "output_cost_per_token_flex": 1.25e-06, "rpm": 100000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -27363,32 +26917,35 @@ "image" ], "supports_audio_output": false, - "supports_function_calling": false, + "supports_function_calling": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, "supports_url_context": true, "supports_vision": true, "supports_web_search": false, "tpm": 8000000, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - }, - "supports_audio_input": false, "supports_image_size": false }, - "gemini/gemini-3-pro-image": { + "gemini-3-pro-image": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, + "cache_read_input_token_cost_batches": 1e-07, + "cache_read_input_token_cost_flex": 1e-07, + "cache_read_input_token_cost_priority": 3.6e-07, + "deprecation_date": "2027-05-28", "input_cost_per_image": 0.0011, "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, "input_cost_per_token_batches": 1e-06, "input_cost_per_token_flex": 1e-06, "input_cost_per_token_priority": 3.6e-06, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 65536, "max_output_tokens": 32768, "max_tokens": 32768, @@ -27396,56 +26953,12 @@ "output_cost_per_image": 0.134, "output_cost_per_image_token": 0.00012, "output_cost_per_token": 1.2e-05, - "rpm": 1000, - "tpm": 4000000, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, "output_cost_per_token_batches": 6e-06, "output_cost_per_token_flex": 6e-06, "output_cost_per_token_priority": 2.16e-05, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text", - "image" - ], - "supports_function_calling": false, - "supports_prompt_caching": true, - "supports_response_schema": false, - "supports_system_messages": true, - "supports_vision": true, - "supports_web_search": true, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "supports_reasoning": false - }, - "gemini/gemini-3-pro-image-preview": { - "deprecation_date": "2026-06-25", - "input_cost_per_image": 0.0011, - "input_cost_per_token": 2e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "gemini", - "max_input_tokens": 65536, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "image_generation", - "output_cost_per_image": 0.134, - "output_cost_per_image_token": 0.00012, - "output_cost_per_token": 1.2e-05, - "rpm": 1000, - "tpm": 4000000, - "output_cost_per_token_batches": 6e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -27461,7 +26974,6 @@ ], "supports_function_calling": false, "supports_prompt_caching": true, - "supports_reasoning": false, "supports_response_schema": true, "supports_system_messages": true, "supports_vision": true, @@ -27473,20 +26985,29 @@ }, "web_search_billing_unit": "per_query" }, - "gemini/nano-banana-pro-preview": { + "gemini-3-pro-image-preview": { "input_cost_per_image": 0.0011, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_priority": 3.6e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, + "cache_read_input_token_cost_batches": 1e-07, "input_cost_per_token": 2e-06, + "input_cost_per_token_priority": 3.6e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, "input_cost_per_token_batches": 1e-06, - "litellm_provider": "gemini", - "max_input_tokens": 131072, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 65536, "max_output_tokens": 32768, "max_tokens": 32768, "mode": "image_generation", "output_cost_per_image": 0.134, "output_cost_per_image_token": 0.00012, "output_cost_per_token": 1.2e-05, - "rpm": 1000, - "tpm": 4000000, + "output_cost_per_token_priority": 2.16e-05, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, "output_cost_per_token_batches": 6e-06, "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ @@ -27504,7 +27025,6 @@ ], "supports_function_calling": false, "supports_prompt_caching": true, - "supports_reasoning": false, "supports_response_schema": true, "supports_system_messages": true, "supports_vision": true, @@ -27516,21 +27036,26 @@ }, "web_search_billing_unit": "per_query" }, - "gemini/gemini-3.1-flash-image": { + "gemini-3.1-flash-image": { + "cache_read_input_token_cost": 5e-08, + "cache_read_input_token_cost_batches": 2.5e-08, + "cache_read_input_token_cost_flex": 2.5e-08, + "deprecation_date": "2027-05-28", + "input_cost_per_image": 0.00056, "input_cost_per_token": 5e-07, "input_cost_per_token_batches": 2.5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 131072, + "input_cost_per_token_flex": 2.5e-07, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 65536, "max_output_tokens": 32768, "max_tokens": 32768, "mode": "image_generation", - "output_cost_per_image": 0.045, + "output_cost_per_image": 0.0672, "output_cost_per_image_token": 6e-05, "output_cost_per_token": 3e-06, "output_cost_per_token_batches": 1.5e-06, - "rpm": 1000, - "tpm": 4000000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "output_cost_per_token_flex": 1.5e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -27546,8 +27071,7 @@ ], "supports_function_calling": false, "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_response_schema": false, + "supports_response_schema": true, "supports_system_messages": true, "supports_vision": true, "supports_web_search": true, @@ -27558,22 +27082,22 @@ }, "web_search_billing_unit": "per_query" }, - "gemini/gemini-3.1-flash-image-preview": { - "deprecation_date": "2026-06-25", + "gemini-3.1-flash-image-preview": { + "input_cost_per_image": 0.00056, + "cache_read_input_token_cost": 5e-08, + "cache_read_input_token_cost_batches": 2.5e-08, "input_cost_per_token": 5e-07, "input_cost_per_token_batches": 2.5e-07, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 65536, "max_output_tokens": 32768, "max_tokens": 32768, "mode": "image_generation", - "output_cost_per_image": 0.045, + "output_cost_per_image": 0.0672, "output_cost_per_image_token": 6e-05, "output_cost_per_token": 3e-06, "output_cost_per_token_batches": 1.5e-06, - "rpm": 1000, - "tpm": 4000000, - "source": "https://ai.google.dev/gemini-api/docs/pricing#gemini-3.1-flash-image-preview", + "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#gemini-models", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -27589,7 +27113,6 @@ ], "supports_function_calling": false, "supports_prompt_caching": true, - "supports_reasoning": false, "supports_response_schema": true, "supports_system_messages": true, "supports_vision": true, @@ -27601,11 +27124,15 @@ }, "web_search_billing_unit": "per_query" }, - "gemini/gemini-3.1-flash-lite-image": { + "gemini-3.1-flash-lite-image": { + "cache_read_input_token_cost": 2.5e-08, + "cache_read_input_token_cost_batches": 1.25e-08, + "cache_read_input_token_cost_flex": 1.25e-08, "input_cost_per_image": 0.00028, "input_cost_per_token": 2.5e-07, "input_cost_per_token_batches": 1.25e-07, - "litellm_provider": "gemini", + "input_cost_per_token_flex": 1.25e-07, + "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 65536, "max_output_tokens": 4096, "max_tokens": 4096, @@ -27614,8 +27141,8 @@ "output_cost_per_image_token": 3e-05, "output_cost_per_token": 1.5e-06, "output_cost_per_token_batches": 7.5e-07, - "rpm": 1000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "output_cost_per_token_flex": 7.5e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -27623,37 +27150,34 @@ ], "supported_modalities": [ "text", - "image" + "image", + "video" ], "supported_output_modalities": [ "text", "image" ], "supports_function_calling": false, - "supports_prompt_caching": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": false, "supports_response_schema": false, "supports_system_messages": true, - "supports_vision": true, - "supports_web_search": false, - "tpm": 4000000 + "supports_video_input": true, + "supports_vision": true }, - "gemini/deep-research-pro-preview-12-2025": { - "input_cost_per_image": 0.0011, - "input_cost_per_token": 2e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "gemini", - "max_input_tokens": 65536, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "image_generation", - "output_cost_per_image": 0.134, - "output_cost_per_image_token": 0.00012, - "output_cost_per_token": 1.2e-05, - "rpm": 1000, - "tpm": 4000000, - "output_cost_per_token_batches": 6e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "gemini-3.1-flash-lite-preview": { + "cache_read_input_token_cost": 2.5e-08, + "input_cost_per_audio_token": 5e-07, + "input_cost_per_token": 2.5e-07, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 1.5e-06, + "output_cost_per_token": 1.5e-06, + "source": "https://ai.google.dev/gemini-api/docs/models", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -27661,40 +27185,208 @@ ], "supported_modalities": [ "text", - "image" + "image", + "audio", + "video" ], "supported_output_modalities": [ - "text", - "image" + "text" ], - "supports_function_calling": false, + "supports_audio_input": true, + "supports_audio_output": false, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, "supports_vision": true, "supports_web_search": true, + "supports_native_streaming": true, "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014 }, - "gemini/gemini-2.5-flash-lite": { + "gemini-3.1-flash-lite": { + "cache_read_input_audio_token_cost": 5e-08, + "deprecation_date": "2027-05-07", + "cache_read_input_token_cost": 2.5e-08, + "cache_read_input_token_cost_batches": 1.25e-08, + "cache_read_input_token_cost_flex": 1.25e-08, + "cache_read_input_token_cost_priority": 4.5e-08, + "input_cost_per_audio_token": 5e-07, + "input_cost_per_token": 2.5e-07, + "input_cost_per_token_batches": 1.25e-07, + "input_cost_per_token_flex": 1.25e-07, + "input_cost_per_token_priority": 4.5e-07, + "input_cost_per_audio_token_priority": 9e-07, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 1.5e-06, + "output_cost_per_token": 1.5e-06, + "output_cost_per_token_batches": 7.5e-07, + "output_cost_per_token_flex": 7.5e-07, + "output_cost_per_token_priority": 2.7e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true, + "supports_audio_output": false, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014, + "input_cost_per_audio_token_batches": 2.5e-07 + }, + "gemini-3.5-flash-lite": { + "deprecation_date": "2027-07-21", + "cache_read_input_token_cost": 3e-08, + "cache_read_input_token_cost_batches": 1.5e-08, + "cache_read_input_token_cost_flex": 1.5e-08, + "cache_read_input_token_cost_priority": 5.4e-08, + "input_cost_per_token": 3e-07, + "input_cost_per_token_batches": 1.5e-07, + "input_cost_per_token_flex": 1.5e-07, + "input_cost_per_token_priority": 5.4e-07, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 2.5e-06, + "output_cost_per_token": 2.5e-06, + "output_cost_per_token_batches": 1.25e-06, + "output_cost_per_token_flex": 1.25e-06, + "output_cost_per_token_priority": 4.5e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true, + "supports_audio_output": false, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014 + }, + "deep-research-pro-preview-12-2025": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1e-07, + "input_cost_per_image": 0.0011, + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 65536, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "image_generation", + "output_cost_per_image": 0.134, + "output_cost_per_image_token": 0.00012, + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_batches": 6e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text", + "image" + ], + "supports_function_calling": false, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_vision": true, + "supports_web_search": true + }, + "gemini-2.5-flash-lite": { "cache_read_input_audio_token_cost": 3e-08, + "deprecation_date": "2026-10-20", "cache_read_input_token_cost": 1e-08, "cache_read_input_token_cost_flex": 1e-08, "cache_read_input_token_cost_priority": 1.8e-08, "input_cost_per_audio_token": 3e-07, "input_cost_per_token": 1e-07, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 65535, + "max_tokens": 65535, "mode": "chat", "output_cost_per_reasoning_token": 4e-07, "output_cost_per_token": 4e-07, - "rpm": 15, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -27721,36 +27413,33 @@ "supports_url_context": true, "supports_vision": true, "supports_web_search": true, - "tpm": 250000, "search_context_cost_per_query": { "search_context_size_low": 0.035, "search_context_size_medium": 0.035, "search_context_size_high": 0.035 }, "google_maps_grounding_cost_per_query": 0.025, - "input_cost_per_audio_token_batches": 1.5e-07, + "input_cost_per_audio_token_batches": 5e-08, "input_cost_per_token_batches": 5e-08, "input_cost_per_token_flex": 5e-08, "input_cost_per_token_priority": 1.8e-07, + "input_cost_per_audio_token_priority": 5.4e-07, "output_cost_per_token_batches": 2e-07, "output_cost_per_token_flex": 2e-07, "output_cost_per_token_priority": 7.2e-07, - "supports_audio_input": true, "supports_image_size": false }, - "gemini/gemini-2.5-flash-lite-preview-09-2025": { + "gemini-2.5-flash-lite-preview-09-2025": { "cache_read_input_token_cost": 1e-08, - "deprecation_date": "2026-03-31", "input_cost_per_audio_token": 3e-07, "input_cost_per_token": 1e-07, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 1048576, "max_output_tokens": 65535, "max_tokens": 65535, "mode": "chat", "output_cost_per_reasoning_token": 4e-07, "output_cost_per_token": 4e-07, - "rpm": 15, "source": "https://developers.googleblog.com/en/continuing-to-bring-you-our-latest-models-with-an-improved-gemini-2-5-flash-and-flash-lite-release/", "supported_endpoints": [ "/v1/chat/completions", @@ -27778,7 +27467,6 @@ "supports_url_context": true, "supports_vision": true, "supports_web_search": true, - "tpm": 250000, "search_context_cost_per_query": { "search_context_size_low": 0.035, "search_context_size_medium": 0.035, @@ -27787,20 +27475,18 @@ "google_maps_grounding_cost_per_query": 0.025, "supports_image_size": false }, - "gemini/gemini-2.5-flash-preview-09-2025": { + "gemini-2.5-flash-preview-09-2025": { "cache_read_input_token_cost": 3e-08, - "deprecation_date": "2026-02-17", "input_cost_per_audio_token": 1e-06, "input_cost_per_token": 3e-07, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 1048576, "max_output_tokens": 65535, "max_tokens": 65535, "mode": "chat", "output_cost_per_reasoning_token": 2.5e-06, "output_cost_per_token": 2.5e-06, - "rpm": 15, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -27827,7 +27513,6 @@ "supports_url_context": true, "supports_vision": true, "supports_web_search": true, - "tpm": 250000, "search_context_cost_per_query": { "search_context_size_low": 0.035, "search_context_size_medium": 0.035, @@ -27836,22 +27521,21 @@ "google_maps_grounding_cost_per_query": 0.025, "supports_image_size": false }, - "gemini/gemini-flash-latest": { - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_token": 7.5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 1048576, + "gemini-live-2.5-flash-native-audio": { + "deprecation_date": "2026-12-13", + "input_cost_per_audio_token": 3e-06, + "input_cost_per_token": 5e-07, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 131072, "max_output_tokens": 65536, "max_tokens": 65536, - "mode": "chat", - "output_cost_per_reasoning_token": 3.75e-06, - "output_cost_per_token": 3.75e-06, - "rpm": 15, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 2e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" + "/vertex_ai/live", + "/v1/realtime" ], "supported_modalities": [ "text", @@ -27860,57 +27544,43 @@ "video" ], "supported_output_modalities": [ - "text" + "text", + "audio" ], - "supports_audio_output": false, + "supports_audio_input": true, + "supports_audio_output": true, "supports_function_calling": true, "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_response_schema": false, "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, + "supports_url_context": false, "supports_vision": true, "supports_web_search": true, - "tpm": 250000, "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 }, - "google_maps_grounding_cost_per_query": 0.014, - "cache_read_input_token_cost_flex": 3.75e-08, - "cache_read_input_token_cost_priority": 1.35e-07, - "input_cost_per_token_batches": 3.75e-07, - "input_cost_per_token_flex": 3.75e-07, - "input_cost_per_token_priority": 1.35e-06, - "output_cost_per_token_batches": 1.875e-06, - "output_cost_per_token_flex": 1.875e-06, - "output_cost_per_token_priority": 6.75e-06, - "prompt_cache_min_tokens": 4096, - "supports_audio_input": true, - "supports_native_streaming": true, - "supports_video_input": true, - "web_search_billing_unit": "per_query" + "gemini_native_audio": true, + "input_cost_per_image_token": 3e-06, + "input_cost_per_video_token": 3e-06 }, - "gemini/gemini-flash-lite-latest": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "gemini", + "gemini-live-2.5-flash-preview-native-audio-09-2025": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_token": 5e-07, + "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "chat", - "output_cost_per_reasoning_token": 2.5e-06, - "output_cost_per_token": 2.5e-06, - "rpm": 15, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "max_output_tokens": 65535, + "max_tokens": 65535, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 2e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" + "/vertex_ai/live" ], "supported_modalities": [ "text", @@ -27919,58 +27589,43 @@ "video" ], "supported_output_modalities": [ - "text" + "text", + "audio" ], - "supports_audio_output": false, + "supports_audio_input": true, + "supports_audio_output": true, "supports_function_calling": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_prompt_caching": false, "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, "supports_url_context": true, "supports_vision": true, "supports_web_search": true, - "tpm": 250000, "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 }, - "google_maps_grounding_cost_per_query": 0.014, - "cache_read_input_token_cost_flex": 2e-08, - "cache_read_input_token_cost_priority": 5e-08, - "input_cost_per_token_batches": 1.5e-07, - "input_cost_per_token_flex": 1.5e-07, - "input_cost_per_token_priority": 5.4e-07, - "output_cost_per_token_batches": 1.25e-06, - "output_cost_per_token_flex": 1.25e-06, - "output_cost_per_token_priority": 4.5e-06, - "supports_audio_input": true, - "supports_native_streaming": true, - "supports_video_input": true, - "web_search_billing_unit": "per_query" + "gemini_native_audio": true, + "input_cost_per_image_token": 3e-06 }, - "gemini/gemini-2.5-flash-lite-preview-06-17": { - "deprecation_date": "2025-11-18", - "cache_read_input_token_cost": 1e-08, - "input_cost_per_audio_token": 5e-07, - "input_cost_per_token": 1e-07, + "gemini/gemini-live-2.5-flash-preview-native-audio-09-2025": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_token": 5e-07, "litellm_provider": "gemini", "max_input_tokens": 1048576, "max_output_tokens": 65535, "max_tokens": 65535, - "mode": "chat", - "output_cost_per_reasoning_token": 4e-07, - "output_cost_per_token": 4e-07, - "rpm": 15, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 2e-06, + "rpm": 100000, "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" + "/v1/realtime" ], "supported_modalities": [ "text", @@ -27979,71 +27634,47 @@ "video" ], "supported_output_modalities": [ - "text" + "text", + "audio" ], - "supports_audio_output": false, + "supports_audio_input": true, + "supports_audio_output": true, "supports_function_calling": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_prompt_caching": false, "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, "supports_url_context": true, "supports_vision": true, "supports_web_search": true, - "tpm": 250000, + "tpm": 8000000, "search_context_cost_per_query": { "search_context_size_low": 0.035, "search_context_size_medium": 0.035, "search_context_size_high": 0.035 }, - "google_maps_grounding_cost_per_query": 0.025, - "supports_image_size": false - }, - "gemini/gemini-2.5-flash-preview-tts": { - "input_cost_per_token": 5e-07, - "input_cost_per_token_batches": 2.5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 8192, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "audio_speech", - "output_cost_per_audio_token": 1e-05, - "output_cost_per_token": 1e-05, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/audio/speech" - ], - "tpm": 4000000, - "rpm": 10, - "supports_audio_input": false, - "supports_function_calling": false, - "supports_response_schema": false, - "supports_web_search": false + "gemini_native_audio": true }, - "gemini/gemini-2.5-pro": { + "gemini-2.5-pro": { + "deprecation_date": "2026-10-20", "cache_read_input_token_cost": 1.25e-07, "cache_read_input_token_cost_above_200k_tokens": 2.5e-07, + "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, "cache_read_input_token_cost_above_200k_tokens_priority": 4.5e-07, "cache_read_input_token_cost_flex": 1.25e-07, "cache_read_input_token_cost_priority": 2.25e-07, "input_cost_per_token": 1.25e-06, "input_cost_per_token_above_200k_tokens": 2.5e-06, - "input_cost_per_token_priority": 2.25e-06, - "input_cost_per_token_above_200k_tokens_priority": 4.5e-06, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 65535, + "max_tokens": 65535, "mode": "chat", "output_cost_per_token": 1e-05, "output_cost_per_token_above_200k_tokens": 1.5e-05, - "output_cost_per_token_priority": 1.8e-05, - "output_cost_per_token_above_200k_tokens_priority": 2.7e-05, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions" @@ -28069,65 +27700,39 @@ "supports_video_input": true, "supports_vision": true, "supports_web_search": true, - "tpm": 800000, "search_context_cost_per_query": { "search_context_size_low": 0.035, "search_context_size_medium": 0.035, "search_context_size_high": 0.035 }, "google_maps_grounding_cost_per_query": 0.025, + "input_cost_per_token_above_200k_tokens_priority": 4.5e-06, "input_cost_per_token_batches": 6.25e-07, "input_cost_per_token_flex": 6.25e-07, + "input_cost_per_token_priority": 2.25e-06, + "output_cost_per_token_above_200k_tokens_priority": 2.7e-05, "output_cost_per_token_batches": 5e-06, - "output_cost_per_token_flex": 5e-06 - }, - "gemini/gemini-2.5-computer-use-preview-10-2025": { - "input_cost_per_token": 1.25e-06, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "litellm_provider": "gemini", - "max_input_tokens": 128000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "mode": "chat", - "output_cost_per_token": 1e-05, - "output_cost_per_token_above_200k_tokens": 1.5e-05, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_computer_use": true, - "supports_function_calling": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "tpm": 800000 + "output_cost_per_token_flex": 5e-06, + "output_cost_per_token_priority": 1.8e-05 }, - "gemini/gemini-3-pro-preview": { - "deprecation_date": "2026-03-09", + "gemini-3.1-pro-preview": { + "prompt_cache_min_tokens": 4096, "cache_read_input_token_cost": 2e-07, "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, "input_cost_per_token": 2e-06, "input_cost_per_token_above_200k_tokens": 4e-06, "input_cost_per_token_batches": 1e-06, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", "output_cost_per_token": 1.2e-05, "output_cost_per_token_above_200k_tokens": 1.8e-05, "output_cost_per_token_batches": 6e-06, - "rpm": 2000, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", + "output_cost_per_image": 0.00012, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -28153,34 +27758,43 @@ "supports_video_input": true, "supports_vision": true, "supports_web_search": true, - "tpm": 800000, + "supports_url_context": true, + "supports_native_streaming": true, "input_cost_per_token_priority": 3.6e-06, "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, "output_cost_per_token_priority": 2.16e-05, "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, "cache_read_input_token_cost_priority": 3.6e-07, "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, + "cache_read_input_token_cost_flex": 2e-07, "search_context_cost_per_query": { "search_context_size_low": 0.014, "search_context_size_medium": 0.014, "search_context_size_high": 0.014 }, - "web_search_billing_unit": "per_query" + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014, + "input_cost_per_token_flex": 1e-06, + "output_cost_per_token_flex": 6e-06 }, - "gemini/gemini-3.1-flash-lite-preview": { - "cache_read_input_token_cost": 2.5e-08, - "deprecation_date": "2026-05-25", - "input_cost_per_audio_token": 5e-07, - "input_cost_per_token": 2.5e-07, - "litellm_provider": "gemini", + "gemini-3.1-pro-preview-customtools": { + "prompt_cache_min_tokens": 4096, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_reasoning_token": 1.5e-06, - "output_cost_per_token": 1.5e-06, - "rpm": 15, - "source": "https://ai.google.dev/gemini-api/docs/models", + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "output_cost_per_token_batches": 6e-06, + "output_cost_per_image": 0.00012, + "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#gemini-models", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -28196,21 +27810,18 @@ "text" ], "supports_audio_input": true, - "supports_audio_output": false, "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, "supports_video_input": true, "supports_vision": true, "supports_web_search": true, + "supports_url_context": true, "supports_native_streaming": true, - "tpm": 250000, "search_context_cost_per_query": { "search_context_size_low": 0.014, "search_context_size_medium": 0.014, @@ -28219,29 +27830,22 @@ "web_search_billing_unit": "per_query", "google_maps_grounding_cost_per_query": 0.014 }, - "gemini/gemini-3.1-flash-lite": { - "cache_read_input_audio_token_cost": 5e-08, - "cache_read_input_token_cost": 2.5e-08, - "cache_read_input_token_cost_flex": 1.25e-08, - "cache_read_input_token_cost_priority": 4.5e-08, - "deprecation_date": "2027-05-07", - "input_cost_per_audio_token": 5e-07, - "input_cost_per_token": 2.5e-07, - "input_cost_per_token_batches": 1.25e-07, - "input_cost_per_token_flex": 1.25e-07, - "input_cost_per_token_priority": 4.5e-07, - "litellm_provider": "gemini", + "vertex_ai/gemini-3-pro-preview": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "vertex_ai", "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 65535, + "max_tokens": 65535, "mode": "chat", - "output_cost_per_reasoning_token": 1.5e-06, - "output_cost_per_token": 1.5e-06, - "output_cost_per_token_batches": 7.5e-07, - "output_cost_per_token_flex": 7.5e-07, - "output_cost_per_token_priority": 2.7e-06, - "rpm": 15, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "output_cost_per_token_batches": 6e-06, + "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -28257,103 +27861,43 @@ "text" ], "supports_audio_input": true, - "supports_audio_output": false, "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, "supports_video_input": true, "supports_vision": true, "supports_web_search": true, "supports_native_streaming": true, - "tpm": 250000, + "input_cost_per_token_priority": 3.6e-06, + "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, + "output_cost_per_token_priority": 2.16e-05, + "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, + "cache_read_input_token_cost_priority": 3.6e-07, + "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, "search_context_cost_per_query": { "search_context_size_low": 0.014, "search_context_size_medium": 0.014, "search_context_size_high": 0.014 }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014, - "input_cost_per_audio_token_batches": 2.5e-07 + "web_search_billing_unit": "per_query" }, - "gemini/gemini-3.5-flash-lite": { - "cache_read_input_token_cost": 3e-08, - "cache_read_input_token_cost_flex": 2e-08, - "cache_read_input_token_cost_priority": 5e-08, - "input_cost_per_token": 3e-07, - "input_cost_per_token_batches": 1.5e-07, - "input_cost_per_token_flex": 1.5e-07, - "input_cost_per_token_priority": 5.4e-07, - "litellm_provider": "gemini", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "chat", - "output_cost_per_reasoning_token": 2.5e-06, - "output_cost_per_token": 2.5e-06, - "output_cost_per_token_batches": 1.25e-06, - "output_cost_per_token_flex": 1.25e-06, - "output_cost_per_token_priority": 4.5e-06, - "rpm": 15, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, - "supports_audio_output": false, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "tpm": 250000, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014 - }, - "gemini/gemini-3-flash-preview": { + "vertex_ai/gemini-3-flash-preview": { "cache_read_input_audio_token_cost": 1e-07, "cache_read_input_token_cost": 5e-08, "cache_read_input_token_cost_flex": 5e-08, - "input_cost_per_audio_token": 1e-06, "input_cost_per_token": 5e-07, - "litellm_provider": "gemini", + "input_cost_per_audio_token": 1e-06, + "litellm_provider": "vertex_ai", "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 65535, + "max_tokens": 65535, "mode": "chat", - "output_cost_per_reasoning_token": 3e-06, "output_cost_per_token": 3e-06, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -28368,20 +27912,18 @@ "supported_output_modalities": [ "text" ], - "supports_audio_output": false, + "supports_audio_input": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, + "supports_video_input": true, "supports_vision": true, "supports_web_search": true, "supports_native_streaming": true, - "tpm": 800000, "input_cost_per_token_priority": 9e-07, "input_cost_per_audio_token_priority": 1.8e-06, "output_cost_per_token_priority": 5.4e-06, @@ -28397,23 +27939,24 @@ "input_cost_per_token_batches": 2.5e-07, "input_cost_per_token_flex": 2.5e-07, "output_cost_per_token_batches": 1.5e-06, - "output_cost_per_token_flex": 1.5e-06, - "supports_audio_input": true + "output_cost_per_token_flex": 1.5e-06 }, - "gemini/gemini-3.5-flash": { + "vertex_ai/gemini-3.5-flash": { "prompt_cache_min_tokens": 4096, + "deprecation_date": "2027-05-19", "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_audio_token": 1.5e-06, + "cache_read_input_token_cost_batches": 7.5e-08, "input_cost_per_token": 1.5e-06, - "litellm_provider": "gemini", + "input_cost_per_audio_token": 1.5e-06, + "litellm_provider": "vertex_ai", "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 65535, + "max_tokens": 65535, "mode": "chat", "output_cost_per_reasoning_token": 9e-06, "output_cost_per_token": 9e-06, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "regional_endpoint_uplift_multiplier": 1.1, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -28428,7 +27971,6 @@ "supported_output_modalities": [ "text" ], - "supports_audio_output": false, "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, @@ -28443,7 +27985,6 @@ "supports_vision": true, "supports_web_search": true, "supports_native_streaming": true, - "tpm": 800000, "input_cost_per_token_priority": 2.7e-06, "input_cost_per_audio_token_priority": 2.7e-06, "output_cost_per_token_priority": 1.62e-05, @@ -28459,16 +28000,17 @@ "output_cost_per_token_batches": 4.5e-06, "input_cost_per_token_flex": 7.5e-07, "output_cost_per_token_flex": 4.5e-06, - "cache_read_input_token_cost_flex": 8e-08 + "cache_read_input_token_cost_flex": 7.5e-08 }, - "gemini/gemini-3.6-flash": { + "vertex_ai/gemini-3.6-flash": { "prompt_cache_min_tokens": 4096, "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, "cache_read_input_token_cost_flex": 3.75e-08, "input_cost_per_token": 7.5e-07, "input_cost_per_token_batches": 3.75e-07, "input_cost_per_token_flex": 3.75e-07, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, @@ -28477,8 +28019,8 @@ "output_cost_per_token": 3.75e-06, "output_cost_per_token_batches": 1.875e-06, "output_cost_per_token_flex": 1.875e-06, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "regional_endpoint_uplift_multiplier": 1.1, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -28493,7 +28035,6 @@ "supported_output_modalities": [ "text" ], - "supports_audio_output": false, "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, @@ -28508,7 +28049,6 @@ "supports_vision": true, "supports_web_search": true, "supports_native_streaming": true, - "tpm": 800000, "input_cost_per_token_priority": 1.35e-06, "output_cost_per_token_priority": 6.75e-06, "cache_read_input_token_cost_priority": 1.35e-07, @@ -28520,14 +28060,15 @@ "web_search_billing_unit": "per_query", "google_maps_grounding_cost_per_query": 0.014 }, - "gemini/gemini-3.7-flash": { + "vertex_ai/gemini-3.7-flash": { "prompt_cache_min_tokens": 4096, "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, "cache_read_input_token_cost_flex": 3.75e-08, "input_cost_per_token": 7.5e-07, "input_cost_per_token_batches": 3.75e-07, "input_cost_per_token_flex": 3.75e-07, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, @@ -28536,8 +28077,8 @@ "output_cost_per_token": 3.75e-06, "output_cost_per_token_batches": 1.875e-06, "output_cost_per_token_flex": 1.875e-06, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "regional_endpoint_uplift_multiplier": 1.1, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -28552,7 +28093,6 @@ "supported_output_modalities": [ "text" ], - "supports_audio_output": false, "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, @@ -28568,7 +28108,6 @@ "supports_vision": true, "supports_web_search": true, "supports_native_streaming": true, - "tpm": 800000, "input_cost_per_token_priority": 1.35e-06, "output_cost_per_token_priority": 6.75e-06, "cache_read_input_token_cost_priority": 1.35e-07, @@ -28580,14 +28119,15 @@ "web_search_billing_unit": "per_query", "google_maps_grounding_cost_per_query": 0.014 }, - "gemini/gemini-3.8-flash": { + "vertex_ai/gemini-3.8-flash": { "prompt_cache_min_tokens": 4096, "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, "cache_read_input_token_cost_flex": 3.75e-08, "input_cost_per_token": 7.5e-07, "input_cost_per_token_batches": 3.75e-07, "input_cost_per_token_flex": 3.75e-07, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, @@ -28596,8 +28136,8 @@ "output_cost_per_token": 3.75e-06, "output_cost_per_token_batches": 1.875e-06, "output_cost_per_token_flex": 1.875e-06, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "regional_endpoint_uplift_multiplier": 1.1, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -28612,7 +28152,6 @@ "supported_output_modalities": [ "text" ], - "supports_audio_output": false, "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, @@ -28628,7 +28167,6 @@ "supports_vision": true, "supports_web_search": true, "supports_native_streaming": true, - "tpm": 800000, "input_cost_per_token_priority": 1.35e-06, "output_cost_per_token_priority": 6.75e-06, "cache_read_input_token_cost_priority": 1.35e-07, @@ -28640,21 +28178,30 @@ "web_search_billing_unit": "per_query", "google_maps_grounding_cost_per_query": 0.014 }, - "gemini/gemini-omni-flash-preview": { - "input_cost_per_audio_token": 1.5e-06, + "vertex_ai/gemini-3.8-flash-cyber": { + "cache_read_input_token_cost": 1.5e-07, + "cache_read_input_token_cost_batches": 7.5e-08, + "cache_read_input_token_cost_flex": 7.5e-08, + "cache_read_input_token_cost_priority": 2.7e-07, "input_cost_per_token": 1.5e-06, - "litellm_provider": "gemini", - "max_input_tokens": 131072, + "input_cost_per_token_batches": 7.5e-07, + "input_cost_per_token_flex": 7.5e-07, + "input_cost_per_token_priority": 2.7e-06, + "litellm_provider": "vertex_ai", + "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_reasoning_token": 9e-06, - "output_cost_per_token": 9e-06, - "output_cost_per_video_token": 1.75e-05, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "output_cost_per_reasoning_token": 7.5e-06, + "output_cost_per_token": 7.5e-06, + "output_cost_per_token_batches": 3.75e-06, + "output_cost_per_token_flex": 3.75e-06, + "output_cost_per_token_priority": 1.35e-05, + "regional_endpoint_uplift_multiplier": 1.1, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ - "/v1beta/interactions" + "/v1/chat/completions", + "/v1/completions" ], "supported_modalities": [ "text", @@ -28663,25 +28210,69 @@ "video" ], "supported_output_modalities": [ - "text", - "video" + "text" ], "supports_audio_input": true, + "supports_function_calling": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, + "supports_minimal_reasoning_effort": false, + "supports_response_schema": true, "supports_system_messages": true, + "supports_tool_choice": false, + "supports_url_context": false, "supports_video_input": true, "supports_vision": true, - "tpm": 800000, - "deprecation_date": "2026-09-30" + "supports_web_search": false, + "supports_native_streaming": true }, - "gemini/gemini-3.1-pro-preview": { + "vertex_ai/gemini-3.8-live": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_image_token": 1e-06, + "input_cost_per_token": 7.5e-07, + "input_cost_per_video_per_second": 3.3333333333333335e-05, + "input_cost_per_video_token": 1e-06, + "litellm_provider": "vertex_ai", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 4.5e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/vertex_ai/live", + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "supports_function_calling": true, + "supports_response_schema": false, + "supports_vision": true, + "supports_web_search": true, + "gemini_audio_only_live": true, + "output_cost_per_video_token": 1e-06 + }, + "vertex_ai/gemini-3.1-pro-preview": { "prompt_cache_min_tokens": 4096, "cache_read_input_token_cost": 2e-07, "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, "input_cost_per_token": 2e-06, "input_cost_per_token_above_200k_tokens": 4e-06, "input_cost_per_token_batches": 1e-06, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, @@ -28689,8 +28280,8 @@ "output_cost_per_token": 1.2e-05, "output_cost_per_token_above_200k_tokens": 1.8e-05, "output_cost_per_token_batches": 6e-06, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "output_cost_per_image": 0.00012, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -28718,7 +28309,6 @@ "supports_web_search": true, "supports_url_context": true, "supports_native_streaming": true, - "tpm": 800000, "input_cost_per_token_priority": 3.6e-06, "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, "output_cost_per_token_priority": 2.16e-05, @@ -28736,14 +28326,15 @@ "input_cost_per_token_flex": 1e-06, "output_cost_per_token_flex": 6e-06 }, - "gemini/gemini-3.1-pro-preview-customtools": { + "vertex_ai/gemini-3.1-pro-preview-customtools": { "prompt_cache_min_tokens": 4096, "cache_read_input_token_cost": 2e-07, "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_creation_input_token_cost_above_200k_tokens": 2.5e-07, "input_cost_per_token": 2e-06, "input_cost_per_token_above_200k_tokens": 4e-06, "input_cost_per_token_batches": 1e-06, - "litellm_provider": "gemini", + "litellm_provider": "vertex_ai", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, @@ -28751,8 +28342,8 @@ "output_cost_per_token": 1.2e-05, "output_cost_per_token_above_200k_tokens": 1.8e-05, "output_cost_per_token_batches": 6e-06, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "output_cost_per_image": 0.00012, + "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#gemini-models", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -28780,247 +28371,110 @@ "supports_web_search": true, "supports_url_context": true, "supports_native_streaming": true, - "tpm": 800000, "input_cost_per_token_priority": 3.6e-06, "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, "output_cost_per_token_priority": 2.16e-05, "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, "cache_read_input_token_cost_priority": 3.6e-07, "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, - "cache_read_input_token_cost_flex": 2e-07, "search_context_cost_per_query": { "search_context_size_low": 0.014, "search_context_size_medium": 0.014, "search_context_size_high": 0.014 }, "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014, - "input_cost_per_token_flex": 1e-06, - "output_cost_per_token_flex": 6e-06 + "google_maps_grounding_cost_per_query": 0.014 }, - "gemini-3-flash-preview": { - "cache_read_input_audio_token_cost": 1e-07, - "cache_read_input_token_cost": 5e-08, - "cache_read_input_token_cost_flex": 5e-08, - "input_cost_per_audio_token": 1e-06, - "input_cost_per_token": 5e-07, + "gemini-2.5-pro-preview-tts": { + "cache_read_input_token_cost": 1.25e-07, + "input_cost_per_audio_token": 7e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 5e-07, "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 1048576, "max_output_tokens": 65535, "max_tokens": 65535, "mode": "chat", - "output_cost_per_reasoning_token": 3e-06, - "output_cost_per_token": 3e-06, + "output_cost_per_audio_token": 2e-05, + "output_cost_per_token": 2e-05, "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], "supported_modalities": [ - "text", - "image", - "audio", - "video" + "text" ], "supported_output_modalities": [ - "text" + "audio" ], "supports_audio_output": false, "supports_function_calling": true, "supports_parallel_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, "supports_vision": true, "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 9e-07, - "input_cost_per_audio_token_priority": 1.8e-06, - "output_cost_per_token_priority": 5.4e-06, - "cache_read_input_token_cost_priority": 9e-08, "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014, - "input_cost_per_audio_token_batches": 5e-07, - "input_cost_per_token_batches": 2.5e-07, - "input_cost_per_token_flex": 2.5e-07, - "output_cost_per_token_batches": 1.5e-06, - "output_cost_per_token_flex": 1.5e-06 - }, - "gemini-omni-flash-preview": { - "input_cost_per_audio_token": 1.5e-06, - "input_cost_per_token": 1.5e-06, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, - "mode": "chat", - "output_cost_per_reasoning_token": 9e-06, - "output_cost_per_token": 9e-06, - "output_cost_per_video_token": 1.75e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text", - "video" - ], - "supports_audio_input": true, - "supports_reasoning": true, - "supports_system_messages": true, - "supports_video_input": true, - "supports_vision": true + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 + } }, - "gemini-3.5-flash": { - "prompt_cache_min_tokens": 4096, - "deprecation_date": "2027-05-19", - "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_audio_token": 1.5e-06, - "input_cost_per_token": 1.5e-06, + "gemini-robotics-er-1.5-preview": { + "cache_read_input_token_cost": 0, + "input_cost_per_token": 3e-07, + "input_cost_per_audio_token": 1e-06, "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 1048576, "max_output_tokens": 65535, "max_tokens": 65535, "mode": "chat", - "output_cost_per_reasoning_token": 9e-06, - "output_cost_per_token": 9e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "output_cost_per_token": 2.5e-06, + "output_cost_per_reasoning_token": 2.5e-06, + "source": "https://ai.google.dev/gemini-api/docs/models#gemini-robotics-er-1-5-preview", "supported_endpoints": [ "/v1/chat/completions", - "/v1/completions", - "/v1/batch" + "/v1/completions" ], "supported_modalities": [ "text", "image", - "audio", - "video" + "video", + "audio" ], "supported_output_modalities": [ "text" ], "supports_audio_output": false, - "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 2.7e-06, - "input_cost_per_audio_token_priority": 2.7e-06, - "output_cost_per_token_priority": 1.62e-05, - "cache_read_input_token_cost_priority": 2.7e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014, - "input_cost_per_token_batches": 7.5e-07, - "output_cost_per_token_batches": 4.5e-06, - "input_cost_per_token_flex": 7.5e-07, - "output_cost_per_token_flex": 4.5e-06, - "cache_read_input_token_cost_flex": 7.5e-08 + "supports_vision": true }, - "gemini-3.6-flash": { - "prompt_cache_min_tokens": 4096, - "cache_read_input_token_cost": 7.5e-08, - "cache_read_input_token_cost_flex": 3.75e-08, - "input_cost_per_token": 7.5e-07, - "input_cost_per_token_batches": 3.75e-07, - "input_cost_per_token_flex": 3.75e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, + "gemini/gemini-robotics-er-2-preview": { + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_batches": 5e-08, + "input_cost_per_audio_token": 1e-06, + "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 131072, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_reasoning_token": 3.75e-06, - "output_cost_per_token": 3.75e-06, - "output_cost_per_token_batches": 1.875e-06, - "output_cost_per_token_flex": 1.875e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": false, - "supports_audio_input": true, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 1.35e-06, - "output_cost_per_token_priority": 6.75e-06, - "cache_read_input_token_cost_priority": 1.35e-07, + "output_cost_per_reasoning_token": 5e-06, + "output_cost_per_token": 5e-06, + "output_cost_per_token_batches": 2.5e-06, "search_context_cost_per_query": { "search_context_size_low": 0.014, "search_context_size_medium": 0.014, "search_context_size_high": 0.014 }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014 - }, - "gemini-3.7-flash": { - "prompt_cache_min_tokens": 4096, - "cache_read_input_token_cost": 7.5e-08, - "cache_read_input_token_cost_flex": 3.75e-08, - "input_cost_per_token": 7.5e-07, - "input_cost_per_token_batches": 3.75e-07, - "input_cost_per_token_flex": 3.75e-07, - "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "chat", - "output_cost_per_reasoning_token": 3.75e-06, - "output_cost_per_token": 3.75e-06, - "output_cost_per_token_batches": 1.875e-06, - "output_cost_per_token_flex": 1.875e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ "/v1/chat/completions", "/v1/completions", @@ -29035,14 +28489,13 @@ "supported_output_modalities": [ "text" ], - "supports_audio_output": false, "supports_audio_input": true, + "supports_audio_output": false, "supports_function_calling": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_minimal_reasoning_effort": false, "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, @@ -29050,1762 +28503,3692 @@ "supports_video_input": true, "supports_vision": true, "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 1.35e-06, - "output_cost_per_token_priority": 6.75e-06, - "cache_read_input_token_cost_priority": 1.35e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014 + "web_search_billing_unit": "per_query" }, - "gemini-3.8-flash": { - "prompt_cache_min_tokens": 4096, - "cache_read_input_token_cost": 7.5e-08, - "cache_read_input_token_cost_flex": 3.75e-08, - "input_cost_per_token": 7.5e-07, - "input_cost_per_token_batches": 3.75e-07, - "input_cost_per_token_flex": 3.75e-07, + "gemini-2.5-computer-use-preview-10-2025": { + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_above_200k_tokens": 2.5e-06, "litellm_provider": "vertex_ai-language-models", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 128000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_reasoning_token": 3.75e-06, - "output_cost_per_token": 3.75e-06, - "output_cost_per_token_batches": 1.875e-06, - "output_cost_per_token_flex": 1.875e-06, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_200k_tokens": 1.5e-05, "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], "supported_modalities": [ "text", - "image", - "audio", - "video" + "image" ], "supported_output_modalities": [ "text" ], - "supports_audio_output": false, - "supports_audio_input": true, + "supports_computer_use": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_minimal_reasoning_effort": false, - "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "supports_native_streaming": true, - "input_cost_per_token_priority": 1.35e-06, - "output_cost_per_token_priority": 6.75e-06, - "cache_read_input_token_cost_priority": 1.35e-07, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "web_search_billing_unit": "per_query", - "google_maps_grounding_cost_per_query": 0.014 + "supports_vision": true }, - "gemini/gemini-2.5-pro-preview-tts": { - "cache_read_input_token_cost": 1.25e-07, - "input_cost_per_audio_token": 7e-07, - "input_cost_per_token": 1e-06, - "input_cost_per_token_batches": 5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 8192, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_audio_token": 2e-05, - "output_cost_per_token": 2e-05, - "rpm": 10000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_modalities": [ - "text" - ], - "supported_output_modalities": [ - "audio" - ], - "supports_audio_output": false, - "supports_function_calling": false, - "supports_prompt_caching": true, - "supports_response_schema": false, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false, - "tpm": 10000000, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - }, - "supports_audio_input": false + "gemini-embedding-001": { + "deprecation_date": "2028-05-20", + "input_cost_per_token": 1.5e-07, + "input_cost_per_token_batches": 1.2e-07, + "litellm_provider": "vertex_ai-embedding-models", + "max_input_tokens": 2048, + "max_tokens": 2048, + "mode": "embedding", + "output_cost_per_token": 0, + "output_vector_size": 3072, + "source": "https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models" }, - "gemini/gemini-exp-1114": { - "input_cost_per_token": 0, - "input_cost_per_token_above_128k_tokens": 0, - "litellm_provider": "gemini", - "max_input_tokens": 1048576, - "max_output_tokens": 8192, + "gemini-embedding-2-preview": { + "input_cost_per_audio_token": 6.5e-06, + "input_cost_per_audio_token_batches": 3.25e-06, + "input_cost_per_image_token": 4.5e-07, + "input_cost_per_image_token_batches": 2.25e-07, + "input_cost_per_token": 2e-07, + "input_cost_per_token_batches": 1e-07, + "input_cost_per_video_token": 1.2e-05, + "input_cost_per_video_token_batches": 6e-06, + "litellm_provider": "vertex_ai-embedding-models", + "max_input_tokens": 8192, "max_tokens": 8192, - "metadata": { - "notes": "Rate limits not documented for gemini-exp-1114. Assuming same as gemini-1.5-pro.", - "supports_tool_choice": true - }, - "mode": "chat", + "mode": "embedding", "output_cost_per_token": 0, - "output_cost_per_token_above_128k_tokens": 0, - "rpm": 1000, - "source": "https://ai.google.dev/pricing", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "tpm": 4000000 + "output_vector_size": 3072, + "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", + "uses_embed_content": true }, - "gemini/gemini-exp-1206": { - "input_cost_per_token": 0, - "input_cost_per_token_above_128k_tokens": 0, - "litellm_provider": "gemini", - "max_input_tokens": 2097152, - "max_output_tokens": 8192, + "gemini-embedding-2": { + "input_cost_per_audio_token": 6.5e-06, + "input_cost_per_audio_token_batches": 3.25e-06, + "input_cost_per_image_token": 4.5e-07, + "input_cost_per_image_token_batches": 2.25e-07, + "input_cost_per_token": 2e-07, + "input_cost_per_token_batches": 1e-07, + "input_cost_per_video_token": 1.2e-05, + "input_cost_per_video_token_batches": 6e-06, + "litellm_provider": "vertex_ai-embedding-models", + "max_input_tokens": 8192, "max_tokens": 8192, - "metadata": { - "notes": "Rate limits not documented for gemini-exp-1206. Assuming same as gemini-1.5-pro.", - "supports_tool_choice": true - }, - "mode": "chat", + "mode": "embedding", "output_cost_per_token": 0, - "output_cost_per_token_above_128k_tokens": 0, - "rpm": 1000, - "source": "https://ai.google.dev/pricing", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "tpm": 4000000 + "output_vector_size": 3072, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supports_multimodal": true, + "uses_embed_content": true }, - "gemini/gemini-gemma-2-27b-it": { - "input_cost_per_token": 3.5e-07, - "litellm_provider": "gemini", - "max_output_tokens": 8192, + "vertex_ai/gemini-embedding-2-preview": { + "input_cost_per_audio_token": 6.5e-06, + "input_cost_per_audio_token_batches": 3.25e-06, + "input_cost_per_image_token": 4.5e-07, + "input_cost_per_image_token_batches": 2.25e-07, + "input_cost_per_token": 2e-07, + "input_cost_per_token_batches": 1e-07, + "input_cost_per_video_token": 1.2e-05, + "input_cost_per_video_token_batches": 6e-06, + "litellm_provider": "vertex_ai", + "max_input_tokens": 8192, "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 1.05e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models#foundation_models", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true, - "tpm": 250000, - "rpm": 10 + "mode": "embedding", + "output_cost_per_token": 0, + "output_vector_size": 3072, + "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", + "supports_multimodal": true, + "uses_embed_content": true }, - "gemini/gemini-gemma-2-9b-it": { - "input_cost_per_token": 3.5e-07, - "litellm_provider": "gemini", - "max_output_tokens": 8192, + "vertex_ai/gemini-embedding-2": { + "input_cost_per_audio_token": 6.5e-06, + "input_cost_per_audio_token_batches": 3.25e-06, + "input_cost_per_image_token": 4.5e-07, + "input_cost_per_image_token_batches": 2.25e-07, + "input_cost_per_token": 2e-07, + "input_cost_per_token_batches": 1e-07, + "input_cost_per_video_token": 1.2e-05, + "input_cost_per_video_token_batches": 6e-06, + "litellm_provider": "vertex_ai", + "max_input_tokens": 8192, "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 1.05e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models#foundation_models", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true, - "tpm": 250000, - "rpm": 10 + "mode": "embedding", + "output_cost_per_token": 0, + "output_vector_size": 3072, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supports_multimodal": true, + "uses_embed_content": true }, - "gemini/gemma-3-27b-it": { - "input_cost_per_audio_per_second": 0, - "input_cost_per_audio_per_second_above_128k_tokens": 0, + "gemini-flash-experimental": { "input_cost_per_character": 0, - "input_cost_per_character_above_128k_tokens": 0, - "input_cost_per_image": 0, - "input_cost_per_image_above_128k_tokens": 0, "input_cost_per_token": 0, - "input_cost_per_token_above_128k_tokens": 0, - "input_cost_per_video_per_second": 0, - "input_cost_per_video_per_second_above_128k_tokens": 0, - "litellm_provider": "gemini", - "max_input_tokens": 131072, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1000000, "max_output_tokens": 8192, "max_tokens": 8192, - "mode": "chat", - "output_cost_per_character": 0, - "output_cost_per_character_above_128k_tokens": 0, + "mode": "embedding", "output_cost_per_token": 0, - "output_cost_per_token_above_128k_tokens": 0, - "source": "https://aistudio.google.com", - "supports_audio_output": false, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_system_messages": false, - "supports_tool_choice": true, - "supports_vision": true + "output_vector_size": 3072, + "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", + "uses_embed_content": true }, - "gemini/gemma-4-26b-a4b-it": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, + "gemini/gemini-embedding-001": { + "deprecation_date": "2028-05-14", + "input_cost_per_token": 1.5e-07, "litellm_provider": "gemini", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, + "max_input_tokens": 2048, + "max_tokens": 2048, + "mode": "embedding", + "output_cost_per_token": 0, + "output_vector_size": 3072, + "rpm": 10000, + "source": "https://ai.google.dev/gemini-api/docs/embeddings#model-versions", + "tpm": 10000000 + }, + "gemini/gemini-embedding-2": { + "input_cost_per_audio_token": 6.5e-06, + "input_cost_per_audio_token_batches": 3.25e-06, + "input_cost_per_image_token": 4.5e-07, + "input_cost_per_image_token_batches": 2.25e-07, + "input_cost_per_token": 2e-07, + "input_cost_per_token_batches": 1e-07, + "input_cost_per_video_token": 1.2e-05, + "input_cost_per_video_token_batches": 6e-06, + "litellm_provider": "gemini", + "max_input_tokens": 8192, + "max_tokens": 8192, + "mode": "embedding", + "output_cost_per_token": 0, + "output_vector_size": 3072, + "rpm": 10000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supports_audio_input": true, + "supports_multimodal": true, "supports_vision": true, - "source": "https://ai.google.dev/gemini-api/docs/pricing" + "tpm": 10000000 }, - "gemini/gemma-4-31b-it": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, + "gemini/gemini-3-pro-image-preview": { + "deprecation_date": "2026-06-25", + "input_cost_per_image": 0.0011, + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, + "input_cost_per_token_flex": 1e-06, + "input_cost_per_token_priority": 3.6e-06, "litellm_provider": "gemini", - "max_input_tokens": 262144, + "max_input_tokens": 131072, "max_output_tokens": 32768, "max_tokens": 32768, - "mode": "chat", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, + "mode": "image_generation", + "output_cost_per_image": 0.134, + "output_cost_per_image_token": 0.00012, + "output_cost_per_token": 1.2e-05, + "rpm": 1000, + "tpm": 4000000, + "output_cost_per_token_batches": 6e-06, + "output_cost_per_token_flex": 6e-06, + "output_cost_per_token_priority": 2.16e-05, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text", + "image" + ], + "supports_function_calling": false, + "supports_prompt_caching": true, + "supports_response_schema": false, "supports_system_messages": true, - "supports_tool_choice": true, "supports_vision": true, - "source": "https://ai.google.dev/gemini-api/docs/pricing" - }, - "gemini/imagen-3.0-fast-generate-001": { - "litellm_provider": "gemini", - "mode": "image_generation", - "output_cost_per_image": 0.02, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" - }, - "gemini/imagen-3.0-generate-001": { - "litellm_provider": "gemini", - "mode": "image_generation", - "output_cost_per_image": 0.04, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" - }, - "gemini/imagen-3.0-generate-002": { - "deprecation_date": "2025-11-10", - "litellm_provider": "gemini", - "mode": "image_generation", - "output_cost_per_image": 0.04, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" - }, - "gemini/imagen-4.0-fast-generate-001": { - "deprecation_date": "2026-08-17", - "litellm_provider": "gemini", - "mode": "image_generation", - "output_cost_per_image": 0.02, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" - }, - "gemini/imagen-4.0-generate-001": { - "deprecation_date": "2026-08-17", - "litellm_provider": "gemini", - "mode": "image_generation", - "output_cost_per_image": 0.04, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" + "supports_web_search": true, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "supports_reasoning": false }, - "gemini/imagen-4.0-ultra-generate-001": { - "deprecation_date": "2026-08-17", + "gemini/gemini-3.1-flash-image-preview": { + "deprecation_date": "2026-06-25", + "input_cost_per_token": 5e-07, + "input_cost_per_token_batches": 2.5e-07, "litellm_provider": "gemini", + "max_input_tokens": 65536, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "image_generation", - "output_cost_per_image": 0.06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" + "output_cost_per_image": 0.045, + "output_cost_per_image_token": 6e-05, + "output_cost_per_token": 3e-06, + "output_cost_per_token_batches": 1.5e-06, + "rpm": 1000, + "tpm": 4000000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text", + "image" + ], + "supports_function_calling": false, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_system_messages": true, + "supports_vision": true, + "supports_web_search": true, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query" }, - "gemini/learnlm-1.5-pro-experimental": { - "input_cost_per_audio_per_second": 0, - "input_cost_per_audio_per_second_above_128k_tokens": 0, - "input_cost_per_character": 0, - "input_cost_per_character_above_128k_tokens": 0, - "input_cost_per_image": 0, - "input_cost_per_image_above_128k_tokens": 0, - "input_cost_per_token": 0, - "input_cost_per_token_above_128k_tokens": 0, - "input_cost_per_video_per_second": 0, - "input_cost_per_video_per_second_above_128k_tokens": 0, + "gemini/gemini-3.1-flash-lite-preview": { + "cache_read_input_audio_token_cost": 5e-08, + "cache_read_input_token_cost": 2.5e-08, + "cache_read_input_token_cost_batches": 1.25e-08, + "cache_read_input_token_cost_flex": 1.25e-08, + "cache_read_input_token_cost_priority": 4.5e-08, + "deprecation_date": "2026-05-25", + "input_cost_per_audio_token": 5e-07, + "input_cost_per_token": 2.5e-07, + "input_cost_per_token_batches": 1.25e-07, + "input_cost_per_token_flex": 1.25e-07, + "input_cost_per_token_priority": 4.5e-07, "litellm_provider": "gemini", - "max_input_tokens": 32767, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_character": 0, - "output_cost_per_character_above_128k_tokens": 0, - "output_cost_per_token": 0, - "output_cost_per_token_above_128k_tokens": 0, - "source": "https://aistudio.google.com", + "output_cost_per_reasoning_token": 1.5e-06, + "output_cost_per_token": 1.5e-06, + "output_cost_per_token_batches": 7.5e-07, + "output_cost_per_token_flex": 7.5e-07, + "output_cost_per_token_priority": 2.7e-06, + "rpm": 15, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true, "supports_audio_output": false, "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "tpm": 250000, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014, + "input_cost_per_audio_token_batches": 2.5e-07 }, - "gemini/lyria-3-clip-preview": { - "input_cost_per_token": 0, + "gemini/gemini-embedding-2-preview": { + "input_cost_per_audio_token": 6.5e-06, + "input_cost_per_audio_token_batches": 3.25e-06, + "input_cost_per_image_token": 4.5e-07, + "input_cost_per_image_token_batches": 2.25e-07, + "input_cost_per_token": 2e-07, + "input_cost_per_token_batches": 1e-07, + "input_cost_per_video_token": 1.2e-05, + "input_cost_per_video_token_batches": 6e-06, "litellm_provider": "gemini", - "max_input_tokens": 131072, - "max_output_tokens": 8192, + "max_input_tokens": 8192, "max_tokens": 8192, - "mode": "chat", - "output_cost_per_image": 0.04, + "mode": "embedding", "output_cost_per_token": 0, + "output_vector_size": 3072, + "rpm": 10000, "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_modalities": [ - "text" - ], - "supported_output_modalities": [ - "audio" - ], - "supports_audio_input": false, - "supports_audio_output": true, - "supports_function_calling": false, - "supports_prompt_caching": false, - "supports_response_schema": false, - "supports_system_messages": false, - "supports_vision": false, - "supports_web_search": false + "supports_audio_input": true, + "supports_multimodal": true, + "supports_vision": true, + "tpm": 10000000 }, - "gemini/lyria-3-pro-preview": { - "input_cost_per_token": 0, + "gemini/deep-research-preview-04-2026": { + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, "litellm_provider": "gemini", "max_input_tokens": 131072, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 0, + "output_cost_per_token": 1.2e-05, + "rpm": 1000, + "tpm": 4000000, + "output_cost_per_token_batches": 6e-06, "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], "supported_modalities": [ - "text" + "text", + "image" ], "supported_output_modalities": [ - "audio" + "text" ], - "supports_audio_input": false, - "supports_audio_output": true, "supports_function_calling": false, "supports_prompt_caching": false, "supports_response_schema": false, - "supports_system_messages": false, - "supports_vision": false, - "supports_web_search": false, - "output_cost_per_image": 0.08 + "supports_system_messages": true, + "supports_vision": true, + "supports_web_search": true, + "search_context_cost_per_query": { + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 + } }, - "gemini/veo-2.0-generate-001": { - "deprecation_date": "2026-06-30", + "gemini/deep-research-max-preview-04-2026": { + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, "litellm_provider": "gemini", - "max_input_tokens": 1024, - "max_tokens": 1024, - "mode": "video_generation", - "output_cost_per_second": 0.35, - "source": "https://ai.google.dev/gemini-api/docs/video", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 1.2e-05, + "rpm": 1000, + "tpm": 4000000, + "output_cost_per_token_batches": 6e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], "supported_modalities": [ - "text" + "text", + "image" ], "supported_output_modalities": [ - "video" - ] + "text" + ], + "supports_function_calling": false, + "supports_prompt_caching": false, + "supports_response_schema": false, + "supports_system_messages": true, + "supports_vision": true, + "supports_web_search": true, + "search_context_cost_per_query": { + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 + } }, - "gemini/veo-3.1-fast-generate-preview": { + "gemini/gemini-2.5-flash": { + "cache_read_input_audio_token_cost": 1e-07, + "cache_read_input_token_cost": 3e-08, + "cache_read_input_token_cost_batches": 3e-08, + "cache_read_input_token_cost_flex": 3e-08, + "cache_read_input_token_cost_priority": 5.4e-08, + "input_cost_per_audio_token": 1e-06, + "input_cost_per_token": 3e-07, "litellm_provider": "gemini", - "max_input_tokens": 1024, - "max_tokens": 1024, - "mode": "video_generation", - "output_cost_per_second": 0.1, - "output_cost_per_second_1080p": 0.12, - "output_cost_per_second_4k": 0.3, + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 2.5e-06, + "output_cost_per_token": 2.5e-06, + "rpm": 100000, "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], "supported_modalities": [ - "text" + "text", + "image", + "audio", + "video" ], "supported_output_modalities": [ - "video" - ] + "text" + ], + "supports_audio_output": false, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_vision": true, + "supports_web_search": true, + "tpm": 8000000, + "search_context_cost_per_query": { + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 + }, + "google_maps_grounding_cost_per_query": 0.025, + "input_cost_per_audio_token_batches": 5e-07, + "input_cost_per_token_batches": 1.5e-07, + "input_cost_per_token_flex": 1.5e-07, + "input_cost_per_token_priority": 5.4e-07, + "output_cost_per_token_batches": 1.25e-06, + "output_cost_per_token_flex": 1.25e-06, + "output_cost_per_token_priority": 4.5e-06, + "supports_audio_input": true, + "supports_image_size": false }, - "gemini/veo-3.1-generate-preview": { + "gemini/gemini-2.5-flash-image": { + "cache_read_input_token_cost": 3e-08, + "deprecation_date": "2026-10-02", + "input_cost_per_audio_token": 1e-06, + "input_cost_per_token": 3e-07, + "input_cost_per_token_batches": 1.5e-07, + "input_cost_per_token_flex": 1.5e-07, + "input_cost_per_token_priority": 5.4e-07, "litellm_provider": "gemini", - "max_input_tokens": 1024, - "max_tokens": 1024, - "mode": "video_generation", - "output_cost_per_second": 0.4, - "output_cost_per_second_4k": 0.6, + "supports_reasoning": false, + "max_input_tokens": 65536, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "image_generation", + "output_cost_per_image": 0.039, + "output_cost_per_image_token": 3e-05, + "output_cost_per_reasoning_token": 2.5e-06, + "output_cost_per_token": 2.5e-06, + "rpm": 100000, "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], "supported_modalities": [ - "text" + "text", + "image", + "audio", + "video" ], "supported_output_modalities": [ - "video" - ] + "text", + "image" + ], + "supports_audio_output": false, + "supports_function_calling": false, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_response_schema": false, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_vision": true, + "supports_web_search": false, + "tpm": 8000000, + "search_context_cost_per_query": { + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 + }, + "supports_audio_input": false, + "supports_image_size": false }, - "gemini/veo-3.1-lite-generate-preview": { + "gemini/gemini-3-pro-image": { + "input_cost_per_image": 0.0011, + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, + "input_cost_per_token_flex": 1e-06, + "input_cost_per_token_priority": 3.6e-06, "litellm_provider": "gemini", - "max_input_tokens": 1024, - "max_tokens": 1024, - "mode": "video_generation", - "output_cost_per_second": 0.05, - "output_cost_per_second_1080p": 0.08, - "source": "https://ai.google.dev/gemini-api/docs/video", + "max_input_tokens": 65536, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "image_generation", + "output_cost_per_image": 0.134, + "output_cost_per_image_token": 0.00012, + "output_cost_per_token": 1.2e-05, + "rpm": 1000, + "tpm": 4000000, + "output_cost_per_token_batches": 6e-06, + "output_cost_per_token_flex": 6e-06, + "output_cost_per_token_priority": 2.16e-05, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], "supported_modalities": [ - "text" + "text", + "image" ], "supported_output_modalities": [ - "video" - ] + "text", + "image" + ], + "supports_function_calling": false, + "supports_prompt_caching": false, + "supports_response_schema": false, + "supports_system_messages": true, + "supports_vision": true, + "supports_web_search": true, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "supports_reasoning": true }, - "gemini/veo-3.1-fast-generate-001": { + "gemini/nano-banana-pro-preview": { + "input_cost_per_image": 0.0011, + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, + "input_cost_per_token_flex": 1e-06, + "input_cost_per_token_priority": 3.6e-06, "litellm_provider": "gemini", - "max_input_tokens": 1024, - "max_tokens": 1024, - "mode": "video_generation", - "output_cost_per_second": 0.1, - "output_cost_per_second_1080p": 0.12, - "output_cost_per_second_4k": 0.3, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "image_generation", + "output_cost_per_image": 0.134, + "output_cost_per_image_token": 0.00012, + "output_cost_per_token": 1.2e-05, + "rpm": 1000, + "tpm": 4000000, + "output_cost_per_token_batches": 6e-06, + "output_cost_per_token_flex": 6e-06, + "output_cost_per_token_priority": 2.16e-05, "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], "supported_modalities": [ - "text" + "text", + "image" ], "supported_output_modalities": [ - "video" - ] + "text", + "image" + ], + "supports_function_calling": false, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_vision": true, + "supports_web_search": true, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query" }, - "gemini/veo-3.1-generate-001": { + "gemini/gemini-3.1-flash-image": { + "input_cost_per_token": 5e-07, + "input_cost_per_token_batches": 2.5e-07, "litellm_provider": "gemini", - "max_input_tokens": 1024, - "max_tokens": 1024, - "mode": "video_generation", - "output_cost_per_second": 0.4, - "output_cost_per_second_4k": 0.6, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "image_generation", + "output_cost_per_image": 0.045, + "output_cost_per_image_token": 6e-05, + "output_cost_per_token": 3e-06, + "output_cost_per_token_batches": 1.5e-06, + "rpm": 1000, + "tpm": 4000000, "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], "supported_modalities": [ - "text" + "text", + "image" ], "supported_output_modalities": [ - "video" - ] - }, - "github_copilot/claude-haiku-4.5": { - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 16000, - "max_tokens": 16000, - "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions" + "text", + "image" ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_vision": true + "supports_function_calling": false, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": false, + "supports_system_messages": true, + "supports_vision": true, + "supports_web_search": true, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "supports_pdf_input": true }, - "github_copilot/claude-opus-4.5": { - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 16000, - "max_tokens": 16000, - "mode": "chat", + "gemini/gemini-3.1-flash-lite-image": { + "input_cost_per_image": 0.00028, + "input_cost_per_token": 2.5e-07, + "input_cost_per_token_batches": 1.25e-07, + "litellm_provider": "gemini", + "max_input_tokens": 65536, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "image_generation", + "output_cost_per_image": 0.0336, + "output_cost_per_image_token": 3e-05, + "output_cost_per_token": 1.5e-06, + "output_cost_per_token_batches": 7.5e-07, + "rpm": 1000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ - "/v1/chat/completions" + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text", + "image" + ], + "supports_function_calling": false, + "supports_pdf_input": true, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": false, + "supports_system_messages": true, "supports_vision": true, - "supports_output_config": true + "supports_web_search": false, + "tpm": 4000000 }, - "github_copilot/claude-opus-4.6-fast": { - "supports_adaptive_thinking": true, - "supports_legacy_thinking": true, - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 16000, - "max_tokens": 16000, + "gemini/deep-research-pro-preview-12-2025": { + "input_cost_per_image": 0.0011, + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", + "output_cost_per_token": 1.2e-05, + "rpm": 1000, + "tpm": 4000000, + "output_cost_per_token_batches": 6e-06, + "source": "https://ai.google.dev/gemini-api/docs/models/deep-research-pro-preview-12-2025", "supported_endpoints": [ - "/v1/chat/completions" + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_vision": true - }, - "github_copilot/claude-opus-41": { - "litellm_provider": "github_copilot", - "max_input_tokens": 80000, - "max_output_tokens": 16000, - "max_tokens": 16000, - "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions" + "supported_modalities": [ + "text", + "image", + "audio", + "video" ], - "supports_vision": true + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": false, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_vision": true, + "supports_web_search": true, + "search_context_cost_per_query": { + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 + }, + "supports_pdf_input": true }, - "github_copilot/claude-sonnet-4": { - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 16000, - "max_tokens": 16000, + "gemini/gemini-2.5-flash-lite": { + "cache_read_input_audio_token_cost": 3e-08, + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_batches": 1e-08, + "cache_read_input_token_cost_flex": 1e-08, + "cache_read_input_token_cost_priority": 1.8e-08, + "input_cost_per_audio_token": 3e-07, + "input_cost_per_token": 1e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", + "output_cost_per_reasoning_token": 4e-07, + "output_cost_per_token": 4e-07, + "rpm": 15, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ - "/v1/chat/completions" + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" ], + "supports_audio_output": false, "supports_function_calling": true, "supports_parallel_function_calling": true, - "supports_vision": true + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_vision": true, + "supports_web_search": true, + "tpm": 250000, + "search_context_cost_per_query": { + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 + }, + "google_maps_grounding_cost_per_query": 0.025, + "input_cost_per_audio_token_batches": 1.5e-07, + "input_cost_per_token_batches": 5e-08, + "input_cost_per_token_flex": 5e-08, + "input_cost_per_token_priority": 1.8e-07, + "output_cost_per_token_batches": 2e-07, + "output_cost_per_token_flex": 2e-07, + "output_cost_per_token_priority": 7.2e-07, + "supports_audio_input": true, + "supports_image_size": false }, - "github_copilot/claude-sonnet-4.5": { - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 16000, - "max_tokens": 16000, + "gemini/gemini-flash-latest": { + "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_token": 7.5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", + "output_cost_per_reasoning_token": 3.75e-06, + "output_cost_per_token": 3.75e-06, + "rpm": 15, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ - "/v1/chat/completions" + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_output": false, "supports_function_calling": true, "supports_parallel_function_calling": true, - "supports_vision": true - }, - "github_copilot/gpt-3.5-turbo": { - "litellm_provider": "github_copilot", - "max_input_tokens": 16384, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "supports_function_calling": true - }, - "github_copilot/gpt-3.5-turbo-0613": { - "litellm_provider": "github_copilot", - "max_input_tokens": 16384, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "supports_function_calling": true - }, - "github_copilot/gpt-4": { - "litellm_provider": "github_copilot", - "max_input_tokens": 32768, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "supports_function_calling": true - }, - "github_copilot/gpt-4-0613": { - "litellm_provider": "github_copilot", - "max_input_tokens": 32768, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "supports_function_calling": true - }, - "github_copilot/gpt-4-o-preview": { - "litellm_provider": "github_copilot", - "max_input_tokens": 64000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true - }, - "github_copilot/gpt-4.1": { - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_vision": true, + "supports_web_search": true, + "tpm": 250000, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "google_maps_grounding_cost_per_query": 0.014, + "cache_read_input_token_cost_flex": 3.75e-08, + "cache_read_input_token_cost_priority": 1.35e-07, + "input_cost_per_token_batches": 3.75e-07, + "input_cost_per_token_flex": 3.75e-07, + "input_cost_per_token_priority": 1.35e-06, + "output_cost_per_token_batches": 1.875e-06, + "output_cost_per_token_flex": 1.875e-06, + "output_cost_per_token_priority": 6.75e-06, + "prompt_cache_min_tokens": 4096, + "supports_audio_input": true, + "supports_native_streaming": true, + "supports_video_input": true, + "web_search_billing_unit": "per_query" }, - "github_copilot/gpt-4.1-2025-04-14": { - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "gemini/gemini-flash-lite-latest": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 3e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", + "output_cost_per_reasoning_token": 2.5e-06, + "output_cost_per_token": 2.5e-06, + "rpm": 15, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_output": false, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true - }, - "github_copilot/gpt-41-copilot": { - "litellm_provider": "github_copilot", - "mode": "completion" - }, - "github_copilot/gpt-4o": { - "litellm_provider": "github_copilot", - "max_input_tokens": 64000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_vision": true - }, - "github_copilot/gpt-4o-2024-05-13": { - "litellm_provider": "github_copilot", - "max_input_tokens": 64000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_vision": true - }, - "github_copilot/gpt-4o-2024-08-06": { - "litellm_provider": "github_copilot", - "max_input_tokens": 64000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_vision": true, + "supports_web_search": true, + "tpm": 250000, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "google_maps_grounding_cost_per_query": 0.014, + "cache_read_input_token_cost_flex": 2e-08, + "cache_read_input_token_cost_priority": 5e-08, + "input_cost_per_token_batches": 1.5e-07, + "input_cost_per_token_flex": 1.5e-07, + "input_cost_per_token_priority": 5.4e-07, + "output_cost_per_token_batches": 1.25e-06, + "output_cost_per_token_flex": 1.25e-06, + "output_cost_per_token_priority": 4.5e-06, + "supports_audio_input": true, + "supports_native_streaming": true, + "supports_video_input": true, + "web_search_billing_unit": "per_query" }, - "github_copilot/gpt-4o-2024-11-20": { - "litellm_provider": "github_copilot", - "max_input_tokens": 64000, + "gemini/gemini-2.5-flash-preview-tts": { + "input_cost_per_token": 5e-07, + "input_cost_per_token_batches": 2.5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 8192, "max_output_tokens": 16384, "max_tokens": 16384, - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_vision": true - }, - "github_copilot/gpt-4o-mini": { - "litellm_provider": "github_copilot", - "max_input_tokens": 64000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true - }, - "github_copilot/gpt-4o-mini-2024-07-18": { - "litellm_provider": "github_copilot", - "max_input_tokens": 64000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true + "mode": "audio_speech", + "output_cost_per_audio_token": 1e-05, + "output_cost_per_token": 1e-05, + "output_cost_per_token_batches": 5e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/audio/speech" + ], + "tpm": 4000000, + "rpm": 10, + "supports_audio_input": false, + "supports_function_calling": false, + "supports_response_schema": false, + "supports_web_search": false }, - "github_copilot/gpt-5": { - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "gemini/gemini-2.5-pro": { + "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_above_200k_tokens": 2.5e-07, + "cache_read_input_token_cost_above_200k_tokens_priority": 4.5e-07, + "cache_read_input_token_cost_batches": 1.25e-07, + "cache_read_input_token_cost_flex": 1.25e-07, + "cache_read_input_token_cost_priority": 2.25e-07, + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_priority": 2.25e-06, + "input_cost_per_token_above_200k_tokens_priority": 4.5e-06, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_200k_tokens": 1.5e-05, + "output_cost_per_token_priority": 1.8e-05, + "output_cost_per_token_above_200k_tokens_priority": 2.7e-05, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ "/v1/chat/completions", - "/v1/responses" + "/v1/completions" ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_vision": true - }, - "github_copilot/gpt-5-mini": { - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "prompt_cache_min_tokens": 2048, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "tpm": 800000, + "search_context_cost_per_query": { + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 + }, + "google_maps_grounding_cost_per_query": 0.025, + "input_cost_per_token_batches": 6.25e-07, + "input_cost_per_token_flex": 6.25e-07, + "output_cost_per_token_batches": 5e-06, + "output_cost_per_token_flex": 5e-06, + "supports_url_context": true }, - "github_copilot/gpt-5.1": { - "litellm_provider": "github_copilot", + "gemini/gemini-2.5-computer-use-preview-10-2025": { + "deprecation_date": "2026-07-28", + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "litellm_provider": "gemini", "max_input_tokens": 128000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_200k_tokens": 1.5e-05, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ "/v1/chat/completions", - "/v1/responses" + "/v1/completions" + ], + "supported_modalities": [ + "text", + "image" ], + "supported_output_modalities": [ + "text" + ], + "supports_computer_use": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "tpm": 800000 }, - "github_copilot/gpt-5.1-codex-max": { - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", + "gemini/gemini-3.1-flash-lite": { + "cache_read_input_audio_token_cost": 5e-08, + "cache_read_input_token_cost": 2.5e-08, + "cache_read_input_token_cost_batches": 1.25e-08, + "cache_read_input_token_cost_flex": 1.25e-08, + "cache_read_input_token_cost_priority": 4.5e-08, + "deprecation_date": "2027-05-07", + "input_cost_per_audio_token": 5e-07, + "input_cost_per_token": 2.5e-07, + "input_cost_per_token_batches": 1.25e-07, + "input_cost_per_token_flex": 1.25e-07, + "input_cost_per_token_priority": 4.5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 1.5e-06, + "output_cost_per_token": 1.5e-06, + "output_cost_per_token_batches": 7.5e-07, + "output_cost_per_token_flex": 7.5e-07, + "output_cost_per_token_priority": 2.7e-06, + "rpm": 15, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ - "/v1/responses" + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" ], + "supports_audio_input": true, + "supports_audio_output": false, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "tpm": 250000, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014, + "input_cost_per_audio_token_batches": 2.5e-07 }, - "github_copilot/gpt-5.2": { - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "gemini/gemini-3.5-flash-lite": { + "cache_read_input_token_cost": 3e-08, + "cache_read_input_token_cost_batches": 2e-08, + "cache_read_input_token_cost_flex": 2e-08, + "cache_read_input_token_cost_priority": 5e-08, + "input_cost_per_token": 3e-07, + "input_cost_per_token_batches": 1.5e-07, + "input_cost_per_token_flex": 1.5e-07, + "input_cost_per_token_priority": 5.4e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", + "output_cost_per_reasoning_token": 2.5e-06, + "output_cost_per_token": 2.5e-06, + "output_cost_per_token_batches": 1.25e-06, + "output_cost_per_token_flex": 1.25e-06, + "output_cost_per_token_priority": 4.5e-06, + "rpm": 15, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ "/v1/chat/completions", - "/v1/responses" + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true, + "supports_audio_output": false, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "tpm": 250000, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014 }, - "github_copilot/gpt-5.3-codex": { - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", + "gemini/gemini-3-flash-preview": { + "cache_read_input_audio_token_cost": 1e-07, + "cache_read_input_token_cost": 5e-08, + "cache_read_input_token_cost_batches": 5e-08, + "cache_read_input_token_cost_flex": 5e-08, + "input_cost_per_audio_token": 1e-06, + "input_cost_per_token": 5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 3e-06, + "output_cost_per_token": 3e-06, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ - "/v1/responses" + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" ], + "supports_audio_output": false, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "tpm": 800000, + "input_cost_per_token_priority": 9e-07, + "input_cost_per_audio_token_priority": 1.8e-06, + "output_cost_per_token_priority": 5.4e-06, + "cache_read_input_token_cost_priority": 9e-08, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014, + "input_cost_per_audio_token_batches": 5e-07, + "input_cost_per_token_batches": 2.5e-07, + "input_cost_per_token_flex": 2.5e-07, + "output_cost_per_token_batches": 1.5e-06, + "output_cost_per_token_flex": 1.5e-06, + "supports_audio_input": true }, - "github_copilot/mai-code-1-flash": { - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_token": 7.5e-07, - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "gemini/gemini-3.5-flash": { + "prompt_cache_min_tokens": 4096, + "cache_read_input_token_cost": 1.5e-07, + "cache_read_input_token_cost_batches": 7.5e-08, + "input_cost_per_audio_token": 1.5e-06, + "input_cost_per_token": 1.5e-06, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 4.5e-06, + "output_cost_per_reasoning_token": 9e-06, + "output_cost_per_token": 9e-06, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ - "/v1/chat/completions" + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" ], + "supports_audio_output": false, + "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, - "supports_response_schema": true + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "tpm": 800000, + "input_cost_per_token_priority": 2.7e-06, + "input_cost_per_audio_token_priority": 2.7e-06, + "output_cost_per_token_priority": 1.62e-05, + "cache_read_input_token_cost_priority": 2.7e-07, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014, + "input_cost_per_token_batches": 7.5e-07, + "output_cost_per_token_batches": 4.5e-06, + "input_cost_per_token_flex": 7.5e-07, + "output_cost_per_token_flex": 4.5e-06, + "cache_read_input_token_cost_flex": 8e-08 }, - "github_copilot/mai-code-1-flash-internal": { + "gemini/gemini-3.6-flash": { + "prompt_cache_min_tokens": 4096, "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, + "cache_read_input_token_cost_flex": 3.75e-08, "input_cost_per_token": 7.5e-07, - "litellm_provider": "github_copilot", - "max_input_tokens": 128000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "input_cost_per_token_batches": 3.75e-07, + "input_cost_per_token_flex": 3.75e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 4.5e-06, - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true - }, - "github_copilot/text-embedding-3-small": { - "litellm_provider": "github_copilot", - "max_input_tokens": 8191, - "max_tokens": 8191, - "mode": "embedding" - }, - "github_copilot/text-embedding-3-small-inference": { - "litellm_provider": "github_copilot", - "max_input_tokens": 8191, - "max_tokens": 8191, - "mode": "embedding" - }, - "github_copilot/text-embedding-ada-002": { - "litellm_provider": "github_copilot", - "max_input_tokens": 8191, - "max_tokens": 8191, - "mode": "embedding" - }, - "chatgpt/gpt-5.5": { - "litellm_provider": "chatgpt", - "source": "https://platform.openai.com/docs/models/gpt-5.5", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", + "output_cost_per_reasoning_token": 3.75e-06, + "output_cost_per_token": 3.75e-06, + "output_cost_per_token_batches": 1.875e-06, + "output_cost_per_token_flex": 1.875e-06, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ "/v1/chat/completions", - "/v1/responses" + "/v1/completions", + "/v1/batch" ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_vision": true - }, - "chatgpt/gpt-5.6-luna": { - "litellm_provider": "chatgpt", - "source": "https://platform.openai.com/docs/models/gpt-5.6-luna", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" + "supported_modalities": [ + "text", + "image", + "audio", + "video" ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_vision": true - }, - "chatgpt/gpt-5.6-sol": { - "litellm_provider": "chatgpt", - "source": "https://platform.openai.com/docs/models/gpt-5.6-sol", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" + "supported_output_modalities": [ + "text" ], + "supports_audio_output": false, + "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "tpm": 800000, + "input_cost_per_token_priority": 1.35e-06, + "output_cost_per_token_priority": 6.75e-06, + "cache_read_input_token_cost_priority": 1.35e-07, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014 }, - "chatgpt/gpt-5.6-terra": { - "litellm_provider": "chatgpt", - "source": "https://platform.openai.com/docs/models/gpt-5.6-terra", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", + "gemini/gemini-3.7-flash": { + "prompt_cache_min_tokens": 4096, + "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, + "cache_read_input_token_cost_flex": 3.75e-08, + "input_cost_per_token": 7.5e-07, + "input_cost_per_token_batches": 3.75e-07, + "input_cost_per_token_flex": 3.75e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 3.75e-06, + "output_cost_per_token": 3.75e-06, + "output_cost_per_token_batches": 1.875e-06, + "output_cost_per_token_flex": 1.875e-06, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ "/v1/chat/completions", - "/v1/responses" + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" ], + "supports_audio_output": false, + "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_minimal_reasoning_effort": false, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "tpm": 800000, + "input_cost_per_token_priority": 1.35e-06, + "output_cost_per_token_priority": 6.75e-06, + "cache_read_input_token_cost_priority": 1.35e-07, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014 }, - "chatgpt/gpt-5.4": { - "litellm_provider": "chatgpt", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", + "gemini/gemini-3.8-flash": { + "prompt_cache_min_tokens": 4096, + "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, + "cache_read_input_token_cost_flex": 3.75e-08, + "input_cost_per_token": 7.5e-07, + "input_cost_per_token_batches": 3.75e-07, + "input_cost_per_token_flex": 3.75e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 3.75e-06, + "output_cost_per_token": 3.75e-06, + "output_cost_per_token_batches": 1.875e-06, + "output_cost_per_token_flex": 1.875e-06, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ "/v1/chat/completions", - "/v1/responses" + "/v1/completions", + "/v1/batch" ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_vision": true - }, - "chatgpt/gpt-5.4-pro": { - "litellm_provider": "chatgpt", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "supported_endpoints": [ - "/v1/responses" + "supported_modalities": [ + "text", + "image", + "audio", + "video" ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_output": false, + "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_minimal_reasoning_effort": false, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "tpm": 800000, + "input_cost_per_token_priority": 1.35e-06, + "output_cost_per_token_priority": 6.75e-06, + "cache_read_input_token_cost_priority": 1.35e-07, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014 }, - "chatgpt/gpt-5.3-codex": { - "litellm_provider": "chatgpt", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", + "gemini/gemini-omni-flash-preview": { + "input_cost_per_audio_token": 1.5e-06, + "input_cost_per_token": 1.5e-06, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 9e-06, + "output_cost_per_token": 9e-06, + "output_cost_per_video_token": 1.75e-05, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ - "/v1/responses" + "/v1beta/interactions" ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_vision": true + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text", + "video" + ], + "supports_audio_input": true, + "supports_reasoning": true, + "supports_system_messages": true, + "supports_video_input": true, + "supports_vision": true, + "tpm": 800000, + "deprecation_date": "2026-09-30" }, - "chatgpt/gpt-5.3-codex-spark": { - "litellm_provider": "chatgpt", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", + "gemini/gemini-3.1-pro-preview": { + "prompt_cache_min_tokens": 4096, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "output_cost_per_token_batches": 6e-06, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ - "/v1/responses" + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" ], + "supports_audio_input": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_url_context": true, + "supports_native_streaming": true, + "tpm": 800000, + "input_cost_per_token_priority": 3.6e-06, + "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, + "output_cost_per_token_priority": 2.16e-05, + "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, + "cache_read_input_token_cost_priority": 3.6e-07, + "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, + "cache_read_input_token_cost_batches": 2e-07, + "cache_read_input_token_cost_flex": 2e-07, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014, + "input_cost_per_token_flex": 1e-06, + "output_cost_per_token_flex": 6e-06 }, - "chatgpt/gpt-5.3-instant": { - "litellm_provider": "chatgpt", - "max_input_tokens": 128000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "mode": "responses", + "gemini/gemini-3.1-pro-preview-customtools": { + "prompt_cache_min_tokens": 4096, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "output_cost_per_token_batches": 6e-06, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", "supported_endpoints": [ "/v1/chat/completions", - "/v1/responses" + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_url_context": true, + "supports_native_streaming": true, + "tpm": 800000, + "input_cost_per_token_priority": 3.6e-06, + "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, + "output_cost_per_token_priority": 2.16e-05, + "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, + "cache_read_input_token_cost_priority": 3.6e-07, + "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, + "cache_read_input_token_cost_batches": 2e-07, + "cache_read_input_token_cost_flex": 2e-07, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014, + "input_cost_per_token_flex": 1e-06, + "output_cost_per_token_flex": 6e-06 }, - "chatgpt/gpt-5.3-chat-latest": { - "litellm_provider": "chatgpt", - "max_input_tokens": 128000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "mode": "responses", + "gemini-3-flash-preview": { + "cache_read_input_audio_token_cost": 1e-07, + "cache_read_input_token_cost": 5e-08, + "cache_read_input_token_cost_flex": 5e-08, + "input_cost_per_audio_token": 1e-06, + "input_cost_per_token": 5e-07, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1048576, + "max_output_tokens": 65535, + "max_tokens": 65535, + "mode": "chat", + "output_cost_per_reasoning_token": 3e-06, + "output_cost_per_token": 3e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", - "/v1/responses" + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" ], + "supports_audio_output": false, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true - }, - "chatgpt/gpt-5.2-codex": { - "litellm_provider": "chatgpt", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "input_cost_per_token_priority": 9e-07, + "input_cost_per_audio_token_priority": 1.8e-06, + "output_cost_per_token_priority": 5.4e-06, + "cache_read_input_token_cost_priority": 9e-08, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014, + "input_cost_per_audio_token_batches": 5e-07, + "input_cost_per_token_batches": 2.5e-07, + "input_cost_per_token_flex": 2.5e-07, + "output_cost_per_token_batches": 1.5e-06, + "output_cost_per_token_flex": 1.5e-06 + }, + "gemini-omni-flash-preview": { + "input_cost_per_audio_token": 1.5e-06, + "input_cost_per_token": 1.5e-06, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1048576, + "max_output_tokens": 65535, + "max_tokens": 65535, + "mode": "chat", + "output_cost_per_reasoning_token": 9e-06, + "output_cost_per_token": 9e-06, + "output_cost_per_video_token": 1.75e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ - "/v1/responses" + "/v1/chat/completions" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text", + "video" + ], + "supports_audio_input": true, + "supports_reasoning": true, + "supports_system_messages": true, + "supports_video_input": true, + "supports_vision": true + }, + "gemini-3.5-flash": { + "prompt_cache_min_tokens": 4096, + "deprecation_date": "2027-05-19", + "cache_read_input_token_cost": 1.5e-07, + "cache_read_input_token_cost_batches": 7.5e-08, + "input_cost_per_audio_token": 1.5e-06, + "input_cost_per_token": 1.5e-06, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1048576, + "max_output_tokens": 65535, + "max_tokens": 65535, + "mode": "chat", + "output_cost_per_reasoning_token": 9e-06, + "output_cost_per_token": 9e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" ], + "supports_audio_output": false, + "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "input_cost_per_token_priority": 2.7e-06, + "input_cost_per_audio_token_priority": 2.7e-06, + "output_cost_per_token_priority": 1.62e-05, + "cache_read_input_token_cost_priority": 2.7e-07, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014, + "input_cost_per_token_batches": 7.5e-07, + "output_cost_per_token_batches": 4.5e-06, + "input_cost_per_token_flex": 7.5e-07, + "output_cost_per_token_flex": 4.5e-06, + "cache_read_input_token_cost_flex": 7.5e-08 }, - "chatgpt/gpt-5.2": { - "litellm_provider": "chatgpt", - "max_input_tokens": 128000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "mode": "responses", + "gemini-3.6-flash": { + "prompt_cache_min_tokens": 4096, + "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, + "cache_read_input_token_cost_flex": 3.75e-08, + "input_cost_per_token": 7.5e-07, + "input_cost_per_token_batches": 3.75e-07, + "input_cost_per_token_flex": 3.75e-07, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 3.75e-06, + "output_cost_per_token": 3.75e-06, + "output_cost_per_token_batches": 1.875e-06, + "output_cost_per_token_flex": 1.875e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ "/v1/chat/completions", - "/v1/responses" + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" ], + "supports_audio_output": false, + "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "input_cost_per_token_priority": 1.35e-06, + "output_cost_per_token_priority": 6.75e-06, + "cache_read_input_token_cost_priority": 1.35e-07, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014 }, - "chatgpt/gpt-5.1-codex-max": { - "litellm_provider": "chatgpt", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", + "gemini-3.7-flash": { + "prompt_cache_min_tokens": 4096, + "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, + "cache_read_input_token_cost_flex": 3.75e-08, + "input_cost_per_token": 7.5e-07, + "input_cost_per_token_batches": 3.75e-07, + "input_cost_per_token_flex": 3.75e-07, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 3.75e-06, + "output_cost_per_token": 3.75e-06, + "output_cost_per_token_batches": 1.875e-06, + "output_cost_per_token_flex": 1.875e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ - "/v1/responses" + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" ], + "supports_audio_output": false, + "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_minimal_reasoning_effort": false, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "input_cost_per_token_priority": 1.35e-06, + "output_cost_per_token_priority": 6.75e-06, + "cache_read_input_token_cost_priority": 1.35e-07, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014 }, - "chatgpt/gpt-5.1-codex-mini": { - "litellm_provider": "chatgpt", - "max_input_tokens": 128000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "mode": "responses", + "gemini-3.8-flash": { + "prompt_cache_min_tokens": 4096, + "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, + "cache_read_input_token_cost_flex": 3.75e-08, + "input_cost_per_token": 7.5e-07, + "input_cost_per_token_batches": 3.75e-07, + "input_cost_per_token_flex": 3.75e-07, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 3.75e-06, + "output_cost_per_token": 3.75e-06, + "output_cost_per_token_batches": 1.875e-06, + "output_cost_per_token_flex": 1.875e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_endpoints": [ - "/v1/responses" + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_output": false, + "supports_audio_input": true, "supports_function_calling": true, "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_minimal_reasoning_effort": false, "supports_response_schema": true, - "supports_vision": true + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "supports_native_streaming": true, + "input_cost_per_token_priority": 1.35e-06, + "output_cost_per_token_priority": 6.75e-06, + "cache_read_input_token_cost_priority": 1.35e-07, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "web_search_billing_unit": "per_query", + "google_maps_grounding_cost_per_query": 0.014 }, - "gigachat/GigaChat-2": { - "input_cost_per_token": 0.0, - "litellm_provider": "gigachat", - "max_input_tokens": 128000, + "gemini-3.8-flash-cyber": { + "cache_read_input_token_cost": 1.5e-07, + "cache_read_input_token_cost_batches": 7.5e-08, + "cache_read_input_token_cost_flex": 7.5e-08, + "cache_read_input_token_cost_priority": 2.7e-07, + "input_cost_per_token": 1.5e-06, + "input_cost_per_token_batches": 7.5e-07, + "input_cost_per_token_flex": 7.5e-07, + "input_cost_per_token_priority": 2.7e-06, + "litellm_provider": "vertex_ai-language-models", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 7.5e-06, + "output_cost_per_token": 7.5e-06, + "output_cost_per_token_batches": 3.75e-06, + "output_cost_per_token_flex": 3.75e-06, + "output_cost_per_token_priority": 1.35e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_output": false, + "supports_audio_input": true, + "supports_function_calling": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_minimal_reasoning_effort": false, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": false, + "supports_url_context": false, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": false, + "supports_native_streaming": true + }, + "gemini/gemini-2.5-pro-preview-tts": { + "cache_read_input_token_cost": 1.25e-07, + "input_cost_per_audio_token": 7e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 8192, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_audio_token": 2e-05, + "output_cost_per_token": 2e-05, + "output_cost_per_token_batches": 1e-05, + "rpm": 10000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "audio" + ], + "supports_audio_output": false, + "supports_function_calling": false, + "supports_prompt_caching": true, + "supports_response_schema": false, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false, + "tpm": 10000000, + "search_context_cost_per_query": { + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 + }, + "supports_audio_input": false + }, + "gemini/gemini-exp-1114": { + "input_cost_per_token": 0, + "input_cost_per_token_above_128k_tokens": 0, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, "max_output_tokens": 8192, "max_tokens": 8192, + "metadata": { + "notes": "Rate limits not documented for gemini-exp-1114. Assuming same as gemini-1.5-pro.", + "supports_tool_choice": true + }, "mode": "chat", - "output_cost_per_token": 0.0, + "output_cost_per_token": 0, + "output_cost_per_token_above_128k_tokens": 0, + "rpm": 1000, + "source": "https://ai.google.dev/pricing", "supports_function_calling": true, - "supports_system_messages": true + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "tpm": 4000000 }, - "gigachat/GigaChat-2-Max": { - "input_cost_per_token": 0.0, - "litellm_provider": "gigachat", - "max_input_tokens": 128000, + "gemini/gemini-exp-1206": { + "input_cost_per_token": 0, + "input_cost_per_token_above_128k_tokens": 0, + "litellm_provider": "gemini", + "max_input_tokens": 2097152, "max_output_tokens": 8192, "max_tokens": 8192, + "metadata": { + "notes": "Rate limits not documented for gemini-exp-1206. Assuming same as gemini-1.5-pro.", + "supports_tool_choice": true + }, "mode": "chat", - "output_cost_per_token": 0.0, + "output_cost_per_token": 0, + "output_cost_per_token_above_128k_tokens": 0, + "rpm": 1000, + "source": "https://ai.google.dev/pricing", "supports_function_calling": true, + "supports_response_schema": true, "supports_system_messages": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": true, + "tpm": 4000000 }, - "gigachat/GigaChat-2-Pro": { - "input_cost_per_token": 0.0, - "litellm_provider": "gigachat", - "max_input_tokens": 128000, + "gemini/gemini-gemma-2-27b-it": { + "input_cost_per_token": 3.5e-07, + "litellm_provider": "gemini", "max_output_tokens": 8192, "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 0.0, + "output_cost_per_token": 1.05e-06, + "source": "https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models#foundation_models", "supports_function_calling": true, - "supports_system_messages": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": true, + "tpm": 250000, + "rpm": 10 }, - "gigachat/Embeddings": { - "input_cost_per_token": 0.0, - "litellm_provider": "gigachat", - "max_input_tokens": 512, - "max_tokens": 512, - "mode": "embedding", - "output_cost_per_token": 0.0, - "output_vector_size": 1024 + "gemini/gemini-gemma-2-9b-it": { + "input_cost_per_token": 3.5e-07, + "litellm_provider": "gemini", + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 1.05e-06, + "source": "https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models#foundation_models", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, + "tpm": 250000, + "rpm": 10 }, - "gigachat/Embeddings-2": { - "input_cost_per_token": 0.0, - "litellm_provider": "gigachat", - "max_input_tokens": 512, - "max_tokens": 512, - "mode": "embedding", - "output_cost_per_token": 0.0, - "output_vector_size": 1024 + "gemini/gemma-3-27b-it": { + "input_cost_per_audio_per_second": 0, + "input_cost_per_audio_per_second_above_128k_tokens": 0, + "input_cost_per_character": 0, + "input_cost_per_character_above_128k_tokens": 0, + "input_cost_per_image": 0, + "input_cost_per_image_above_128k_tokens": 0, + "input_cost_per_token": 0, + "input_cost_per_token_above_128k_tokens": 0, + "input_cost_per_video_per_second": 0, + "input_cost_per_video_per_second_above_128k_tokens": 0, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_character": 0, + "output_cost_per_character_above_128k_tokens": 0, + "output_cost_per_token": 0, + "output_cost_per_token_above_128k_tokens": 0, + "source": "https://aistudio.google.com", + "supports_audio_output": false, + "supports_function_calling": true, + "supports_response_schema": true, + "supports_system_messages": false, + "supports_tool_choice": true, + "supports_vision": true }, - "gigachat/EmbeddingsGigaR": { + "gemini/gemma-4-26b-a4b-it": { "input_cost_per_token": 0.0, - "litellm_provider": "gigachat", - "max_input_tokens": 4096, - "max_tokens": 4096, - "mode": "embedding", "output_cost_per_token": 0.0, - "output_vector_size": 2560 + "litellm_provider": "gemini", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "source": "https://ai.google.dev/gemini-api/docs/pricing" }, - "gigachat/GigaEmbeddings-3B-2025-09": { + "gemini/gemma-4-31b-it": { "input_cost_per_token": 0.0, - "litellm_provider": "gigachat", - "max_input_tokens": 4096, - "max_tokens": 4096, - "mode": "embedding", "output_cost_per_token": 0.0, - "output_vector_size": 2048 + "litellm_provider": "gemini", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "source": "https://ai.google.dev/gemini-api/docs/pricing" }, - "gmi/anthropic/claude-opus-4.5": { - "input_cost_per_token": 5e-06, - "litellm_provider": "gmi", - "max_input_tokens": 409600, - "max_output_tokens": 32000, - "max_tokens": 32000, + "gemini/imagen-3.0-fast-generate-001": { + "litellm_provider": "gemini", + "mode": "image_generation", + "output_cost_per_image": 0.02, + "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" + }, + "gemini/imagen-3.0-generate-001": { + "litellm_provider": "gemini", + "mode": "image_generation", + "output_cost_per_image": 0.04, + "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" + }, + "gemini/learnlm-1.5-pro-experimental": { + "input_cost_per_audio_per_second": 0, + "input_cost_per_audio_per_second_above_128k_tokens": 0, + "input_cost_per_character": 0, + "input_cost_per_character_above_128k_tokens": 0, + "input_cost_per_image": 0, + "input_cost_per_image_above_128k_tokens": 0, + "input_cost_per_token": 0, + "input_cost_per_token_above_128k_tokens": 0, + "input_cost_per_video_per_second": 0, + "input_cost_per_video_per_second_above_128k_tokens": 0, + "litellm_provider": "gemini", + "max_input_tokens": 32767, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 2.5e-05, + "output_cost_per_character": 0, + "output_cost_per_character_above_128k_tokens": 0, + "output_cost_per_token": 0, + "output_cost_per_token_above_128k_tokens": 0, + "source": "https://aistudio.google.com", + "supports_audio_output": false, + "supports_function_calling": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "gemini/lyria-3-clip-preview": { + "input_cost_per_token": 0, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_image": 0.04, + "output_cost_per_token": 0, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "audio" + ], + "supports_audio_input": false, + "supports_audio_output": true, + "supports_function_calling": false, + "supports_prompt_caching": false, + "supports_response_schema": false, + "supports_system_messages": false, + "supports_vision": false, + "supports_web_search": false + }, + "gemini/lyria-3-pro-preview": { + "input_cost_per_token": 0, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 0, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "audio" + ], + "supports_audio_input": false, + "supports_audio_output": true, + "supports_function_calling": false, + "supports_prompt_caching": false, + "supports_response_schema": false, + "supports_system_messages": false, + "supports_vision": false, + "supports_web_search": false, + "output_cost_per_image": 0.08 + }, + "gemini/veo-3.1-fast-generate-preview": { + "deprecation_date": "2026-10-22", + "litellm_provider": "gemini", + "max_input_tokens": 1024, + "max_tokens": 1024, + "mode": "video_generation", + "output_cost_per_second": 0.1, + "output_cost_per_second_1080p": 0.12, + "output_cost_per_second_4k": 0.3, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "video" + ] + }, + "gemini/veo-3.1-generate-preview": { + "deprecation_date": "2026-10-22", + "litellm_provider": "gemini", + "max_input_tokens": 1024, + "max_tokens": 1024, + "mode": "video_generation", + "output_cost_per_second": 0.4, + "output_cost_per_second_4k": 0.6, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "video" + ] + }, + "gemini/veo-3.1-lite-generate-preview": { + "deprecation_date": "2026-10-22", + "litellm_provider": "gemini", + "max_input_tokens": 1024, + "max_tokens": 1024, + "mode": "video_generation", + "output_cost_per_second": 0.05, + "output_cost_per_second_1080p": 0.08, + "source": "https://ai.google.dev/gemini-api/docs/video", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "video" + ] + }, + "gemini/veo-3.1-fast-generate-001": { + "litellm_provider": "gemini", + "max_input_tokens": 1024, + "max_tokens": 1024, + "mode": "video_generation", + "output_cost_per_second": 0.1, + "output_cost_per_second_1080p": 0.12, + "output_cost_per_second_4k": 0.3, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "video" + ] + }, + "gemini/veo-3.1-generate-001": { + "litellm_provider": "gemini", + "max_input_tokens": 1024, + "max_tokens": 1024, + "mode": "video_generation", + "output_cost_per_second": 0.4, + "output_cost_per_second_4k": 0.6, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "video" + ] + }, + "github_copilot/claude-haiku-4.5": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 1e-06, + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 16000, + "max_tokens": 16000, + "mode": "chat", + "output_cost_per_token": 5e-06, + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_vision": true + }, + "github_copilot/claude-opus-4.5": { + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 16000, + "max_tokens": 16000, + "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, + "supports_parallel_function_calling": true, "supports_vision": true, "supports_output_config": true }, - "gmi/anthropic/claude-sonnet-4.5": { - "input_cost_per_token": 3e-06, - "litellm_provider": "gmi", - "max_input_tokens": 409600, - "max_output_tokens": 32000, - "max_tokens": 32000, + "github_copilot/claude-opus-4.6-fast": { + "supports_adaptive_thinking": true, + "supports_legacy_thinking": true, + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", - "output_cost_per_token": 1.5e-05, + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, + "supports_parallel_function_calling": true, "supports_vision": true }, - "gmi/anthropic/claude-sonnet-4": { + "github_copilot/claude-opus-41": { + "litellm_provider": "github_copilot", + "max_input_tokens": 80000, + "max_output_tokens": 16000, + "max_tokens": 16000, + "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_vision": true + }, + "github_copilot/claude-sonnet-4": { + "cache_creation_input_token_cost": 3.75e-06, + "cache_read_input_token_cost": 3e-07, "input_cost_per_token": 3e-06, - "litellm_provider": "gmi", - "max_input_tokens": 409600, - "max_output_tokens": 32000, - "max_tokens": 32000, + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", "output_cost_per_token": 1.5e-05, + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, + "supports_parallel_function_calling": true, "supports_vision": true }, - "gmi/anthropic/claude-opus-4": { - "input_cost_per_token": 1.5e-05, - "litellm_provider": "gmi", - "max_input_tokens": 409600, - "max_output_tokens": 32000, - "max_tokens": 32000, + "github_copilot/claude-sonnet-4.5": { + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", - "output_cost_per_token": 7.5e-05, + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, + "supports_parallel_function_calling": true, "supports_vision": true }, - "gmi/openai/gpt-5.2": { - "input_cost_per_token": 1.75e-06, - "litellm_provider": "gmi", - "max_input_tokens": 409600, - "max_output_tokens": 32000, - "max_tokens": 32000, + "github_copilot/gpt-3.5-turbo": { + "litellm_provider": "github_copilot", + "max_input_tokens": 16384, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 1.4e-05, "supports_function_calling": true }, - "gmi/openai/gpt-5.1": { - "input_cost_per_token": 1.25e-06, - "litellm_provider": "gmi", - "max_input_tokens": 409600, - "max_output_tokens": 32000, - "max_tokens": 32000, + "github_copilot/gpt-3.5-turbo-0613": { + "litellm_provider": "github_copilot", + "max_input_tokens": 16384, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 1e-05, "supports_function_calling": true }, - "gmi/openai/gpt-5": { - "input_cost_per_token": 1.25e-06, - "litellm_provider": "gmi", - "max_input_tokens": 409600, - "max_output_tokens": 32000, - "max_tokens": 32000, + "github_copilot/gpt-4": { + "litellm_provider": "github_copilot", + "max_input_tokens": 32768, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 1e-05, "supports_function_calling": true }, - "gmi/openai/gpt-4o": { - "input_cost_per_token": 2.5e-06, - "litellm_provider": "gmi", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "github_copilot/gpt-4-0613": { + "litellm_provider": "github_copilot", + "max_input_tokens": 32768, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "supports_function_calling": true + }, + "github_copilot/gpt-4-o-preview": { + "litellm_provider": "github_copilot", + "max_input_tokens": 64000, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 1e-05, "supports_function_calling": true, - "supports_vision": true + "supports_parallel_function_calling": true }, - "gmi/openai/gpt-4o-mini": { - "input_cost_per_token": 1.5e-07, - "litellm_provider": "gmi", - "max_input_tokens": 131072, + "github_copilot/gpt-4.1": { + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, "max_output_tokens": 16384, "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 6e-07, "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, "supports_vision": true }, - "gmi/deepseek-ai/DeepSeek-V3.2": { - "input_cost_per_token": 2.8e-07, - "litellm_provider": "gmi", - "max_input_tokens": 163840, + "github_copilot/gpt-4.1-2025-04-14": { + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, "max_output_tokens": 16384, "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 4e-07, - "supports_function_calling": true + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true }, - "gmi/deepseek-ai/DeepSeek-V3-0324": { - "input_cost_per_token": 2.8e-07, - "litellm_provider": "gmi", - "max_input_tokens": 163840, - "max_output_tokens": 16384, - "max_tokens": 16384, + "github_copilot/gpt-41-copilot": { + "litellm_provider": "github_copilot", + "mode": "completion" + }, + "github_copilot/gpt-4o": { + "litellm_provider": "github_copilot", + "max_input_tokens": 64000, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 8.8e-07, - "supports_function_calling": true + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_vision": true }, - "gmi/google/gemini-3-flash-preview": { - "input_cost_per_token": 5e-07, - "litellm_provider": "gmi", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "github_copilot/gpt-4o-2024-05-13": { + "litellm_provider": "github_copilot", + "max_input_tokens": 64000, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 3e-06, "supports_function_calling": true, - "supports_vision": true, - "supports_system_messages": true + "supports_parallel_function_calling": true, + "supports_vision": true }, - "gmi/moonshotai/Kimi-K2-Thinking": { - "input_cost_per_token": 8e-07, - "litellm_provider": "gmi", - "max_input_tokens": 262144, + "github_copilot/gpt-4o-2024-08-06": { + "litellm_provider": "github_copilot", + "max_input_tokens": 64000, "max_output_tokens": 16384, "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1.2e-06 + "supports_function_calling": true, + "supports_parallel_function_calling": true }, - "gmi/MiniMaxAI/MiniMax-M2.1": { - "input_cost_per_token": 3e-07, - "litellm_provider": "gmi", - "max_input_tokens": 196608, + "github_copilot/gpt-4o-2024-11-20": { + "litellm_provider": "github_copilot", + "max_input_tokens": 64000, "max_output_tokens": 16384, "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1.2e-06 + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_vision": true }, - "baseten/MiniMaxAI/MiniMax-M2.5": { - "input_cost_per_token": 3e-07, - "litellm_provider": "baseten", + "github_copilot/gpt-4o-mini": { + "litellm_provider": "github_copilot", + "max_input_tokens": 64000, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 1.2e-06 + "supports_function_calling": true, + "supports_parallel_function_calling": true }, - "baseten/nvidia/Nemotron-120B-A12B": { - "input_cost_per_token": 3e-07, - "litellm_provider": "baseten", + "github_copilot/gpt-4o-mini-2024-07-18": { + "litellm_provider": "github_copilot", + "max_input_tokens": 64000, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 7.5e-07 + "supports_function_calling": true, + "supports_parallel_function_calling": true }, - "baseten/zai-org/GLM-5": { - "input_cost_per_token": 9.5e-07, - "litellm_provider": "baseten", + "github_copilot/gpt-5": { + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3.15e-06 + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true }, - "baseten/zai-org/GLM-4.7": { - "input_cost_per_token": 6e-07, - "litellm_provider": "baseten", + "github_copilot/gpt-5-mini": { + "cache_read_input_token_cost": 2.5e-08, + "input_cost_per_token": 2.5e-07, + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 2.2e-06 + "output_cost_per_token": 2e-06, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true }, - "baseten/zai-org/GLM-4.6": { - "input_cost_per_token": 6e-07, - "litellm_provider": "baseten", + "github_copilot/gpt-5.1": { + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 2.2e-06 + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true }, - "baseten/moonshotai/Kimi-K2.5": { - "input_cost_per_token": 6e-07, - "litellm_provider": "baseten", - "mode": "chat", - "output_cost_per_token": 3e-06 + "github_copilot/gpt-5.1-codex-max": { + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "supported_endpoints": [ + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true }, - "baseten/moonshotai/Kimi-K2-Thinking": { - "input_cost_per_token": 6e-07, - "litellm_provider": "baseten", + "github_copilot/gpt-5.2": { + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 2.5e-06 - }, - "baseten/moonshotai/Kimi-K2-Instruct-0905": { - "input_cost_per_token": 6e-07, - "litellm_provider": "baseten", - "mode": "chat", - "output_cost_per_token": 2.5e-06 + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true }, - "baseten/openai/gpt-oss-120b": { - "input_cost_per_token": 1e-07, - "litellm_provider": "baseten", - "mode": "chat", - "output_cost_per_token": 5e-07 + "github_copilot/gpt-5.3-codex": { + "cache_read_input_token_cost": 1.75e-07, + "input_cost_per_token": 1.75e-06, + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "output_cost_per_token": 1.4e-05, + "supported_endpoints": [ + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true }, - "baseten/deepseek-ai/DeepSeek-V3.1": { - "input_cost_per_token": 5e-07, - "litellm_provider": "baseten", + "github_copilot/mai-code-1-flash": { + "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_token": 7.5e-07, + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 1.5e-06 + "output_cost_per_token": 4.5e-06, + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true }, - "baseten/deepseek-ai/DeepSeek-V3-0324": { - "input_cost_per_token": 7.7e-07, - "litellm_provider": "baseten", + "github_copilot/mai-code-1-flash-internal": { + "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_token": 7.5e-07, + "litellm_provider": "github_copilot", + "max_input_tokens": 128000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 7.7e-07 + "output_cost_per_token": 4.5e-06, + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true }, - "gmi/Qwen/Qwen3-VL-235B-A22B-Instruct-FP8": { - "input_cost_per_token": 3e-07, - "litellm_provider": "gmi", - "max_input_tokens": 262144, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1.4e-06, - "supports_vision": true + "github_copilot/text-embedding-3-small": { + "litellm_provider": "github_copilot", + "max_input_tokens": 8191, + "max_tokens": 8191, + "mode": "embedding" }, - "gmi/zai-org/GLM-4.7-FP8": { - "input_cost_per_token": 4e-07, - "litellm_provider": "gmi", - "max_input_tokens": 202752, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 2e-06 + "github_copilot/text-embedding-3-small-inference": { + "litellm_provider": "github_copilot", + "max_input_tokens": 8191, + "max_tokens": 8191, + "mode": "embedding" }, - "google.gemma-3-12b-it": { - "input_cost_per_token": 9e-08, - "litellm_provider": "bedrock_converse", + "github_copilot/text-embedding-ada-002": { + "litellm_provider": "github_copilot", + "max_input_tokens": 8191, + "max_tokens": 8191, + "mode": "embedding" + }, + "chatgpt/gpt-5.5": { + "litellm_provider": "chatgpt", + "source": "https://platform.openai.com/docs/models/gpt-5.5", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_reasoning": true, + "supports_none_reasoning_effort": true, + "supports_xhigh_reasoning_effort": true, + "supports_minimal_reasoning_effort": false + }, + "chatgpt/gpt-5.6-luna": { + "litellm_provider": "chatgpt", + "source": "https://platform.openai.com/docs/models/gpt-5.6-luna", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true + }, + "chatgpt/gpt-5.6-sol": { + "litellm_provider": "chatgpt", + "source": "https://platform.openai.com/docs/models/gpt-5.6-sol", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true + }, + "chatgpt/gpt-5.6-terra": { + "litellm_provider": "chatgpt", + "source": "https://platform.openai.com/docs/models/gpt-5.6-terra", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true + }, + "chatgpt/gpt-5.4": { + "litellm_provider": "chatgpt", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_reasoning": true, + "supports_none_reasoning_effort": true, + "default_reasoning_effort": "none", + "supports_xhigh_reasoning_effort": true, + "supports_minimal_reasoning_effort": false + }, + "chatgpt/gpt-5.4-pro": { + "litellm_provider": "chatgpt", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "supported_endpoints": [ + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_reasoning": true, + "supports_none_reasoning_effort": false, + "supports_xhigh_reasoning_effort": true, + "supports_minimal_reasoning_effort": false + }, + "chatgpt/gpt-5.3-codex": { + "litellm_provider": "chatgpt", "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 2.9e-07, - "supports_system_messages": true, - "supports_vision": true + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "supported_endpoints": [ + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_reasoning": true, + "supports_none_reasoning_effort": false, + "supports_xhigh_reasoning_effort": false, + "supports_minimal_reasoning_effort": true }, - "google.gemma-3-27b-it": { - "input_cost_per_token": 2.3e-07, - "litellm_provider": "bedrock_converse", + "chatgpt/gpt-5.3-codex-spark": { + "litellm_provider": "chatgpt", "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 3.8e-07, - "supports_system_messages": true, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "supported_endpoints": [ + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, "supports_vision": true }, - "google.gemma-3-4b-it": { - "input_cost_per_token": 4e-08, - "litellm_provider": "bedrock_converse", + "chatgpt/gpt-5.3-instant": { + "litellm_provider": "chatgpt", "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 8e-08, - "supports_system_messages": true, + "max_output_tokens": 64000, + "max_tokens": 64000, + "mode": "responses", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, "supports_vision": true }, - "google_pse/search": { - "input_cost_per_query": 0.005, - "litellm_provider": "google_pse", - "mode": "search" - }, - "global.anthropic.claude-sonnet-4-5-20250929-v1:0": { - "cache_creation_input_token_cost": 3.75e-06, - "cache_creation_input_token_cost_above_1hr": 6e-06, - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 3e-06, - "input_cost_per_token_above_200k_tokens": 6e-06, - "output_cost_per_token_above_200k_tokens": 2.25e-05, - "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, - "cache_creation_input_token_cost_above_1hr_above_200k_tokens": 1.2e-05, - "cache_read_input_token_cost_above_200k_tokens": 6e-07, - "litellm_provider": "bedrock_converse", - "supports_tool_search": true, - "max_input_tokens": 200000, + "chatgpt/gpt-5.3-chat-latest": { + "litellm_provider": "chatgpt", + "max_input_tokens": 128000, "max_output_tokens": 64000, "max_tokens": 64000, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": true, - "supports_computer_use": true, + "mode": "responses", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_parallel_function_calling": true, "supports_response_schema": true, - "supports_tool_choice": true, "supports_vision": true, - "supports_native_structured_output": true, - "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024, - "input_cost_per_token_batches": 1.5e-06, - "output_cost_per_token_batches": 7.5e-06 + "supports_reasoning": true }, - "global.anthropic.claude-sonnet-4-20250514-v1:0": { - "cache_creation_input_token_cost": 3.75e-06, - "cache_read_input_token_cost": 3e-07, - "deprecation_date": "2026-10-14", - "input_cost_per_token": 3e-06, - "input_cost_per_token_above_200k_tokens": 6e-06, - "output_cost_per_token_above_200k_tokens": 2.25e-05, - "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, - "cache_read_input_token_cost_above_200k_tokens": 6e-07, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 1000000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": true, - "supports_computer_use": true, + "chatgpt/gpt-5.2-codex": { + "litellm_provider": "chatgpt", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "supported_endpoints": [ + "/v1/responses" + ], "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_parallel_function_calling": true, "supports_response_schema": true, - "supports_tool_choice": true, "supports_vision": true, - "bedrock_converse_supports_strict_tools": false, - "prompt_cache_min_tokens": 1024 + "supports_reasoning": true }, - "global.anthropic.claude-haiku-4-5-20251001-v1:0": { - "cache_creation_input_token_cost": 1.25e-06, - "cache_creation_input_token_cost_above_1hr": 2e-06, - "cache_read_input_token_cost": 1e-07, - "input_cost_per_token": 1e-06, - "litellm_provider": "bedrock_converse", - "supports_tool_search": true, - "max_input_tokens": 200000, + "chatgpt/gpt-5.2": { + "litellm_provider": "chatgpt", + "max_input_tokens": 128000, "max_output_tokens": 64000, "max_tokens": 64000, - "mode": "chat", - "output_cost_per_token": 5e-06, - "source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock", - "supports_assistant_prefill": true, - "supports_computer_use": true, + "mode": "responses", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_parallel_function_calling": true, + "supports_response_schema": true, + "supports_vision": true, "supports_reasoning": true, + "supports_none_reasoning_effort": true, + "default_reasoning_effort": "none", + "supports_xhigh_reasoning_effort": true, + "supports_minimal_reasoning_effort": false + }, + "chatgpt/gpt-5.1-codex-max": { + "litellm_provider": "chatgpt", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "supported_endpoints": [ + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, "supports_response_schema": true, - "supports_tool_choice": true, "supports_vision": true, - "supports_native_structured_output": true, - "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096, - "input_cost_per_token_batches": 5e-07, - "output_cost_per_token_batches": 2.5e-06 + "supports_reasoning": true }, - "global.amazon.nova-2-lite-v1:0": { - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 1000000, + "chatgpt/gpt-5.1-codex-mini": { + "litellm_provider": "chatgpt", + "max_input_tokens": 128000, "max_output_tokens": 64000, "max_tokens": 64000, - "mode": "chat", - "output_cost_per_token": 2.5e-06, + "mode": "responses", + "supported_endpoints": [ + "/v1/responses" + ], "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_parallel_function_calling": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_video_input": true, - "supports_vision": true + "supports_vision": true, + "supports_reasoning": true }, - "gpt-3.5-turbo": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 5e-07, - "litellm_provider": "openai", - "max_input_tokens": 16385, - "max_output_tokens": 4096, - "max_tokens": 4096, + "gigachat/GigaChat-2": { + "input_cost_per_token": 0.0, + "litellm_provider": "gigachat", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 1.5e-06, - "source": "https://developers.openai.com/api/docs/pricing", + "output_cost_per_token": 0.0, "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_system_messages": true, - "supports_tool_choice": true + "supports_system_messages": true }, - "gpt-3.5-turbo-0125": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 5e-07, - "input_cost_per_token_batches": 2.5e-07, - "litellm_provider": "openai", - "max_input_tokens": 16385, - "max_output_tokens": 4096, - "max_tokens": 4096, + "gigachat/GigaChat-2-Max": { + "input_cost_per_token": 0.0, + "litellm_provider": "gigachat", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 1.5e-06, - "output_cost_per_token_batches": 7.5e-07, - "source": "https://developers.openai.com/api/docs/pricing", + "output_cost_per_token": 0.0, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, "supports_system_messages": true, - "supports_tool_choice": true + "supports_vision": true }, - "gpt-3.5-turbo-1106": { - "deprecation_date": "2026-09-28", - "input_cost_per_token": 1e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "openai", - "max_input_tokens": 16385, - "max_output_tokens": 4096, - "max_tokens": 4096, + "gigachat/GigaChat-2-Pro": { + "input_cost_per_token": 0.0, + "litellm_provider": "gigachat", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 2e-06, - "output_cost_per_token_batches": 2e-06, - "source": "https://developers.openai.com/api/docs/pricing", + "output_cost_per_token": 0.0, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, "supports_system_messages": true, - "supports_tool_choice": true + "supports_vision": true }, - "gpt-3.5-turbo-16k": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 3e-06, - "litellm_provider": "openai", - "max_input_tokens": 16385, - "max_output_tokens": 4096, + "gigachat/Embeddings": { + "input_cost_per_token": 0.0, + "litellm_provider": "gigachat", + "max_input_tokens": 512, + "max_tokens": 512, + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 1024 + }, + "gigachat/Embeddings-2": { + "input_cost_per_token": 0.0, + "litellm_provider": "gigachat", + "max_input_tokens": 512, + "max_tokens": 512, + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 1024 + }, + "gigachat/EmbeddingsGigaR": { + "input_cost_per_token": 0.0, + "litellm_provider": "gigachat", + "max_input_tokens": 4096, "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 4e-06, - "supports_prompt_caching": true, - "supports_system_messages": true, - "supports_tool_choice": true + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 2560 }, - "gpt-3.5-turbo-instruct": { - "deprecation_date": "2026-09-28", - "input_cost_per_token": 1.5e-06, - "litellm_provider": "text-completion-openai", - "max_input_tokens": 8192, - "max_output_tokens": 4096, + "gigachat/GigaEmbeddings-3B-2025-09": { + "input_cost_per_token": 0.0, + "litellm_provider": "gigachat", + "max_input_tokens": 4096, "max_tokens": 4096, - "mode": "completion", - "output_cost_per_token": 2e-06, - "source": "https://developers.openai.com/api/docs/pricing" + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 2048 }, - "gpt-3.5-turbo-instruct-0914": { - "input_cost_per_token": 1.5e-06, - "litellm_provider": "text-completion-openai", - "max_input_tokens": 8192, - "max_output_tokens": 4097, - "max_tokens": 4097, - "mode": "completion", - "output_cost_per_token": 2e-06 + "gmi/anthropic/claude-opus-4.5": { + "input_cost_per_token": 5e-06, + "litellm_provider": "gmi", + "max_input_tokens": 409600, + "max_output_tokens": 32000, + "max_tokens": 32000, + "mode": "chat", + "output_cost_per_token": 2.5e-05, + "supports_function_calling": true, + "supports_vision": true, + "supports_output_config": true }, - "gpt-4": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 3e-05, - "litellm_provider": "openai", - "max_input_tokens": 8192, - "max_output_tokens": 4096, - "max_tokens": 4096, + "gmi/anthropic/claude-sonnet-4.5": { + "input_cost_per_token": 3e-06, + "litellm_provider": "gmi", + "max_input_tokens": 409600, + "max_output_tokens": 32000, + "max_tokens": 32000, "mode": "chat", - "output_cost_per_token": 6e-05, + "output_cost_per_token": 1.5e-05, "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_system_messages": true, - "supports_tool_choice": true + "supports_vision": true }, - "gpt-4-0125-preview": { - "deprecation_date": "2026-03-26", - "input_cost_per_token": 1e-05, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, + "gmi/anthropic/claude-sonnet-4": { + "input_cost_per_token": 3e-06, + "litellm_provider": "gmi", + "max_input_tokens": 409600, + "max_output_tokens": 32000, + "max_tokens": 32000, "mode": "chat", - "output_cost_per_token": 3e-05, + "output_cost_per_token": 1.5e-05, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_system_messages": true, - "supports_tool_choice": true + "supports_vision": true }, - "gpt-4-0314": { - "deprecation_date": "2026-03-26", - "input_cost_per_token": 3e-05, - "litellm_provider": "openai", - "max_input_tokens": 8192, - "max_output_tokens": 4096, - "max_tokens": 4096, + "gmi/anthropic/claude-opus-4": { + "input_cost_per_token": 1.5e-05, + "litellm_provider": "gmi", + "max_input_tokens": 409600, + "max_output_tokens": 32000, + "max_tokens": 32000, "mode": "chat", - "output_cost_per_token": 6e-05, - "supports_system_messages": true, - "supports_tool_choice": true + "output_cost_per_token": 7.5e-05, + "supports_function_calling": true, + "supports_vision": true }, - "gpt-4-0613": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 3e-05, - "input_cost_per_token_batches": 1.5e-05, - "litellm_provider": "openai", - "max_input_tokens": 8192, - "max_output_tokens": 4096, - "max_tokens": 4096, + "gmi/openai/gpt-5.2": { + "input_cost_per_token": 1.75e-06, + "litellm_provider": "gmi", + "max_input_tokens": 409600, + "max_output_tokens": 32000, + "max_tokens": 32000, "mode": "chat", - "output_cost_per_token": 6e-05, - "output_cost_per_token_batches": 3e-05, - "source": "https://developers.openai.com/api/docs/pricing", + "output_cost_per_token": 1.4e-05, + "supports_function_calling": true + }, + "gmi/openai/gpt-5.1": { + "input_cost_per_token": 1.25e-06, + "litellm_provider": "gmi", + "max_input_tokens": 409600, + "max_output_tokens": 32000, + "max_tokens": 32000, + "mode": "chat", + "output_cost_per_token": 1e-05, + "supports_function_calling": true + }, + "gmi/openai/gpt-5": { + "input_cost_per_token": 1.25e-06, + "litellm_provider": "gmi", + "max_input_tokens": 409600, + "max_output_tokens": 32000, + "max_tokens": 32000, + "mode": "chat", + "output_cost_per_token": 1e-05, + "supports_function_calling": true + }, + "gmi/openai/gpt-4o": { + "input_cost_per_token": 2.5e-06, + "litellm_provider": "gmi", + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1e-05, "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_system_messages": true, - "supports_tool_choice": true + "supports_vision": true }, - "gpt-4-1106-preview": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 1e-05, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, + "gmi/openai/gpt-4o-mini": { + "input_cost_per_token": 1.5e-07, + "litellm_provider": "gmi", + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 3e-05, + "output_cost_per_token": 6e-07, + "supports_function_calling": true, + "supports_vision": true + }, + "gmi/deepseek-ai/DeepSeek-V3.2": { + "input_cost_per_token": 2.8e-07, + "litellm_provider": "gmi", + "max_input_tokens": 163840, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 4e-07, + "supports_function_calling": true + }, + "gmi/deepseek-ai/DeepSeek-V3-0324": { + "input_cost_per_token": 2.8e-07, + "litellm_provider": "gmi", + "max_input_tokens": 163840, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 8.8e-07, + "supports_function_calling": true + }, + "gmi/google/gemini-3-flash-preview": { + "input_cost_per_token": 5e-07, + "litellm_provider": "gmi", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 3e-06, + "supports_function_calling": true, + "supports_vision": true, + "supports_system_messages": true + }, + "gmi/moonshotai/Kimi-K2-Thinking": { + "input_cost_per_token": 8e-07, + "litellm_provider": "gmi", + "max_input_tokens": 262144, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.2e-06 + }, + "gmi/MiniMaxAI/MiniMax-M2.1": { + "input_cost_per_token": 3e-07, + "litellm_provider": "gmi", + "max_input_tokens": 196608, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.2e-06 + }, + "baseten/MiniMaxAI/MiniMax-M2.5": { + "input_cost_per_token": 3e-07, + "litellm_provider": "baseten", + "mode": "chat", + "output_cost_per_token": 1.2e-06 + }, + "baseten/nvidia/Nemotron-120B-A12B": { + "input_cost_per_token": 3e-07, + "litellm_provider": "baseten", + "mode": "chat", + "output_cost_per_token": 7.5e-07 + }, + "baseten/zai-org/GLM-5": { + "input_cost_per_token": 9.5e-07, + "litellm_provider": "baseten", + "mode": "chat", + "output_cost_per_token": 3.15e-06 + }, + "baseten/zai-org/GLM-4.7": { + "cache_read_input_token_cost": 1.2e-07, + "input_cost_per_token": 6e-07, + "litellm_provider": "baseten", + "max_input_tokens": 200000, + "max_output_tokens": 200000, + "max_tokens": 200000, + "mode": "chat", + "output_cost_per_token": 2.2e-06, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_prompt_caching": true, - "supports_system_messages": true, - "supports_tool_choice": true + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "gpt-4-turbo": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 1e-05, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, + "baseten/zai-org/GLM-4.6": { + "input_cost_per_token": 6e-07, + "litellm_provider": "baseten", "mode": "chat", - "output_cost_per_token": 3e-05, + "output_cost_per_token": 2.2e-06 + }, + "baseten/moonshotai/Kimi-K2.5": { + "input_cost_per_token": 6e-07, + "litellm_provider": "baseten", + "mode": "chat", + "output_cost_per_token": 3e-06 + }, + "baseten/moonshotai/Kimi-K2-Thinking": { + "input_cost_per_token": 6e-07, + "litellm_provider": "baseten", + "mode": "chat", + "output_cost_per_token": 2.5e-06 + }, + "baseten/moonshotai/Kimi-K2-Instruct-0905": { + "input_cost_per_token": 6e-07, + "litellm_provider": "baseten", + "mode": "chat", + "output_cost_per_token": 2.5e-06 + }, + "baseten/openai/gpt-oss-120b": { + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 1e-07, + "litellm_provider": "baseten", + "max_input_tokens": 128072, + "max_output_tokens": 128072, + "max_tokens": 128072, + "mode": "chat", + "output_cost_per_token": 5e-07, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_system_messages": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_tool_choice": true, + "supports_vision": false + }, + "baseten/deepseek-ai/DeepSeek-V3.1": { + "input_cost_per_token": 5e-07, + "litellm_provider": "baseten", + "mode": "chat", + "output_cost_per_token": 1.5e-06 + }, + "baseten/deepseek-ai/DeepSeek-V3-0324": { + "input_cost_per_token": 7.7e-07, + "litellm_provider": "baseten", + "mode": "chat", + "output_cost_per_token": 7.7e-07 + }, + "gmi/Qwen/Qwen3-VL-235B-A22B-Instruct-FP8": { + "input_cost_per_token": 3e-07, + "litellm_provider": "gmi", + "max_input_tokens": 262144, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.4e-06, "supports_vision": true }, - "gpt-4-turbo-2024-04-09": { - "deprecation_date": "2026-10-23", - "input_cost_per_token": 1e-05, - "input_cost_per_token_batches": 5e-06, - "litellm_provider": "openai", + "gmi/zai-org/GLM-4.7-FP8": { + "input_cost_per_token": 4e-07, + "litellm_provider": "gmi", + "max_input_tokens": 202752, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 2e-06 + }, + "google.gemma-3-12b-it": { + "input_cost_per_token": 9e-08, + "litellm_provider": "bedrock_converse", "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", - "output_cost_per_token": 3e-05, - "output_cost_per_token_batches": 1.5e-05, - "source": "https://developers.openai.com/api/docs/pricing", + "output_cost_per_token": 2.9e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_response_schema": true, "supports_system_messages": true, - "supports_tool_choice": true, "supports_vision": true }, - "gpt-4-turbo-preview": { - "deprecation_date": "2026-03-26", - "input_cost_per_token": 1e-05, - "litellm_provider": "openai", + "google.gemma-3-27b-it": { + "input_cost_per_token": 2.3e-07, + "litellm_provider": "bedrock_converse", "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", - "output_cost_per_token": 3e-05, + "output_cost_per_token": 3.8e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_response_schema": true, "supports_system_messages": true, - "supports_tool_choice": true + "supports_vision": true }, - "gpt-4.1": { - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_priority": 8.75e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_batches": 1e-06, - "input_cost_per_token_priority": 3.5e-06, - "litellm_provider": "openai", - "max_input_tokens": 1047576, - "max_output_tokens": 32768, - "max_tokens": 32768, + "google.gemma-3-4b-it": { + "input_cost_per_token": 4e-08, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 128000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", - "output_cost_per_token": 8e-06, - "output_cost_per_token_batches": 4e-06, - "output_cost_per_token_priority": 1.4e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.025, - "search_context_size_low": 0.025, - "search_context_size_medium": 0.025 - }, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/batch", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "output_cost_per_token": 8e-08, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_response_schema": true, "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true + "supports_vision": true }, - "gpt-4.1-2025-04-14": { - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_priority": 8.75e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_priority": 3.5e-06, - "input_cost_per_token_batches": 1e-06, - "litellm_provider": "openai", - "max_input_tokens": 1047576, - "max_output_tokens": 32768, - "max_tokens": 32768, + "google_pse/search": { + "input_cost_per_query": 0.005, + "litellm_provider": "google_pse", + "mode": "search" + }, + "global.anthropic.claude-sonnet-4-5-20250929-v1:0": { + "cache_creation_input_token_cost": 3.75e-06, + "cache_creation_input_token_cost_above_1hr": 6e-06, + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 3e-06, + "input_cost_per_token_above_200k_tokens": 6e-06, + "output_cost_per_token_above_200k_tokens": 2.25e-05, + "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, + "cache_creation_input_token_cost_above_1hr_above_200k_tokens": 1.2e-05, + "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 200000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 8e-06, - "output_cost_per_token_priority": 1.4e-05, - "output_cost_per_token_batches": 4e-06, + "output_cost_per_token": 1.5e-05, "search_context_cost_per_query": { - "search_context_size_high": 0.025, - "search_context_size_low": 0.025, - "search_context_size_medium": 0.025 + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 }, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/batch", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "supports_assistant_prefill": true, + "supports_computer_use": true, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_native_structured_output": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 1024, + "input_cost_per_token_batches": 1.5e-06, + "output_cost_per_token_batches": 7.5e-06, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "gpt-4.1-mini": { - "cache_read_input_token_cost": 1e-07, - "cache_read_input_token_cost_priority": 1.75e-07, - "input_cost_per_token": 4e-07, - "input_cost_per_token_batches": 2e-07, - "input_cost_per_token_priority": 7e-07, - "litellm_provider": "openai", - "max_input_tokens": 1047576, - "max_output_tokens": 32768, + "global.anthropic.claude-sonnet-4-20250514-v1:0": { + "cache_creation_input_token_cost": 3.75e-06, + "cache_read_input_token_cost": 3e-07, + "deprecation_date": "2026-10-14", + "input_cost_per_token": 3e-06, + "input_cost_per_token_above_200k_tokens": 6e-06, + "output_cost_per_token_above_200k_tokens": 2.25e-05, + "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, + "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 64000, + "max_tokens": 64000, + "mode": "chat", + "output_cost_per_token": 1.5e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_assistant_prefill": true, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "bedrock_converse_supports_strict_tools": false, + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" + }, + "global.anthropic.claude-haiku-4-5-20251001-v1:0": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_creation_input_token_cost_above_1hr": 2e-06, + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 1e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 200000, + "max_output_tokens": 64000, + "max_tokens": 64000, + "mode": "chat", + "output_cost_per_token": 5e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_assistant_prefill": true, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_native_structured_output": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 4096, + "input_cost_per_token_batches": 5e-07, + "output_cost_per_token_batches": 2.5e-06 + }, + "global.amazon.nova-2-lite-v1:0": { + "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_token": 3e-07, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 64000, + "max_tokens": 64000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_video_input": true, + "supports_vision": true + }, + "gpt-3.5-turbo": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 5e-07, + "litellm_provider": "openai", + "max_input_tokens": 16385, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 1.5e-06, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "gpt-3.5-turbo-0125": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 5e-07, + "input_cost_per_token_batches": 2.5e-07, + "litellm_provider": "openai", + "max_input_tokens": 16385, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 1.5e-06, + "output_cost_per_token_batches": 7.5e-07, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "gpt-3.5-turbo-1106": { + "deprecation_date": "2026-09-28", + "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "openai", + "max_input_tokens": 16385, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 2e-06, + "output_cost_per_token_batches": 2e-06, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "gpt-3.5-turbo-16k": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 3e-06, + "litellm_provider": "openai", + "max_input_tokens": 16385, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 4e-06, + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "gpt-3.5-turbo-instruct": { + "deprecation_date": "2026-09-28", + "input_cost_per_token": 1.5e-06, + "litellm_provider": "text-completion-openai", + "max_input_tokens": 8192, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "completion", + "output_cost_per_token": 2e-06, + "source": "https://developers.openai.com/api/docs/pricing" + }, + "gpt-3.5-turbo-instruct-0914": { + "input_cost_per_token": 1.5e-06, + "litellm_provider": "text-completion-openai", + "max_input_tokens": 8192, + "max_output_tokens": 4097, + "max_tokens": 4097, + "mode": "completion", + "output_cost_per_token": 2e-06 + }, + "gpt-4": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 3e-05, + "litellm_provider": "openai", + "max_input_tokens": 8192, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 6e-05, + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "gpt-4-0613": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 3e-05, + "input_cost_per_token_batches": 1.5e-05, + "litellm_provider": "openai", + "max_input_tokens": 8192, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 6e-05, + "output_cost_per_token_batches": 3e-05, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "gpt-4-1106-preview": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 1e-05, + "litellm_provider": "openai", + "max_input_tokens": 128000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 3e-05, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "gpt-4-turbo": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 1e-05, + "litellm_provider": "openai", + "max_input_tokens": 128000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 3e-05, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "gpt-4-turbo-2024-04-09": { + "deprecation_date": "2026-10-23", + "input_cost_per_token": 1e-05, + "input_cost_per_token_batches": 5e-06, + "litellm_provider": "openai", + "max_input_tokens": 128000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 3e-05, + "output_cost_per_token_batches": 1.5e-05, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "gpt-4.1": { + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_priority": 8.75e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, + "input_cost_per_token_priority": 3.5e-06, + "litellm_provider": "openai", + "max_input_tokens": 1047576, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 8e-06, + "output_cost_per_token_batches": 4e-06, + "output_cost_per_token_priority": 1.4e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.025, + "search_context_size_low": 0.025, + "search_context_size_medium": 0.025 + }, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, + "gpt-4.1-2025-04-14": { + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_priority": 8.75e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_priority": 3.5e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "openai", + "max_input_tokens": 1047576, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 8e-06, + "output_cost_per_token_priority": 1.4e-05, + "output_cost_per_token_batches": 4e-06, + "search_context_cost_per_query": { + "search_context_size_high": 0.025, + "search_context_size_low": 0.025, + "search_context_size_medium": 0.025 + }, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, + "gpt-4.1-mini": { + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_priority": 1.75e-07, + "input_cost_per_token": 4e-07, + "input_cost_per_token_batches": 2e-07, + "input_cost_per_token_priority": 7e-07, + "litellm_provider": "openai", + "max_input_tokens": 1047576, + "max_output_tokens": 32768, "max_tokens": 32768, "mode": "chat", "output_cost_per_token": 1.6e-06, @@ -31053,24 +32436,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "gpt-4o-audio-preview": { - "deprecation_date": "2026-05-07", - "input_cost_per_audio_token": 4e-05, - "input_cost_per_token": 2.5e-06, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_audio_token": 8e-05, - "output_cost_per_token": 1e-05, - "supports_audio_input": true, - "supports_audio_output": true, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_system_messages": true, - "supports_tool_choice": true - }, "gpt-4o-audio-preview-2024-12-17": { "deprecation_date": "2027-01-20", "input_cost_per_audio_token": 4e-05, @@ -31255,44 +32620,6 @@ "supports_tool_choice": true, "supports_vision": false }, - "gpt-audio-mini-2025-10-06": { - "deprecation_date": "2026-07-23", - "input_cost_per_audio_token": 1e-05, - "input_cost_per_token": 6e-07, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_audio_token": 2e-05, - "output_cost_per_token": 2.4e-06, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses", - "/v1/realtime", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": false - }, "gpt-audio-mini-2025-12-15": { "input_cost_per_audio_token": 1e-05, "input_cost_per_token": 6e-07, @@ -31389,24 +32716,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "gpt-4o-mini-audio-preview": { - "deprecation_date": "2026-05-07", - "input_cost_per_audio_token": 1e-05, - "input_cost_per_token": 1.5e-07, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_audio_token": 2e-05, - "output_cost_per_token": 6e-07, - "supports_audio_input": true, - "supports_audio_output": true, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_system_messages": true, - "supports_tool_choice": true - }, "gpt-4o-mini-audio-preview-2024-12-17": { "deprecation_date": "2027-01-20", "input_cost_per_audio_token": 1e-05, @@ -31425,26 +32734,6 @@ "supports_system_messages": true, "supports_tool_choice": true }, - "gpt-4o-mini-realtime-preview": { - "cache_creation_input_audio_token_cost": 3e-07, - "cache_read_input_token_cost": 3e-07, - "deprecation_date": "2026-05-07", - "input_cost_per_audio_token": 1e-05, - "input_cost_per_token": 6e-07, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "realtime", - "output_cost_per_audio_token": 2e-05, - "output_cost_per_token": 2.4e-06, - "supports_audio_input": true, - "supports_audio_output": true, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_system_messages": true, - "supports_tool_choice": true - }, "gpt-4o-mini-realtime-preview-2024-12-17": { "cache_creation_input_audio_token_cost": 3e-07, "cache_read_input_token_cost": 3e-07, @@ -31491,32 +32780,6 @@ "supports_vision": true, "supports_web_search": true }, - "gpt-4o-mini-search-preview-2025-03-11": { - "cache_read_input_token_cost": 7.5e-08, - "deprecation_date": "2026-07-23", - "input_cost_per_token": 1.5e-07, - "input_cost_per_token_batches": 7.5e-08, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 6e-07, - "output_cost_per_token_batches": 3e-07, - "search_context_cost_per_query": { - "search_context_size_high": 0.025, - "search_context_size_low": 0.025, - "search_context_size_medium": 0.025 - }, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true - }, "gpt-4o-mini-transcribe": { "input_cost_per_audio_token": 1.25e-06, "input_cost_per_token": 1.25e-06, @@ -31551,115 +32814,51 @@ "audio" ] }, - "gpt-4o-realtime-preview": { - "cache_read_input_token_cost": 2.5e-06, - "deprecation_date": "2026-05-07", - "input_cost_per_audio_token": 4e-05, - "input_cost_per_token": 5e-06, + "gpt-4o-mini-tts-2025-03-20": { + "input_cost_per_token": 6e-07, "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "realtime", - "output_cost_per_audio_token": 8e-05, - "output_cost_per_token": 2e-05, - "supports_audio_input": true, - "supports_audio_output": true, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_system_messages": true, - "supports_tool_choice": true + "mode": "audio_speech", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_second": 0.00025, + "output_cost_per_token": 1e-05, + "source": "https://developers.openai.com/api/docs/models/gpt-4o-mini-tts", + "supported_endpoints": [ + "/v1/audio/speech" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "audio" + ] }, - "gpt-4o-realtime-preview-2024-12-17": { - "cache_read_input_token_cost": 2.5e-06, - "deprecation_date": "2026-05-07", - "input_cost_per_audio_token": 4e-05, - "input_cost_per_token": 5e-06, + "gpt-4o-search-preview": { + "cache_read_input_token_cost": 1.25e-06, + "input_cost_per_token": 2.5e-06, + "input_cost_per_token_batches": 1.25e-06, "litellm_provider": "openai", "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "realtime", - "output_cost_per_audio_token": 8e-05, - "output_cost_per_token": 2e-05, - "supports_audio_input": true, - "supports_audio_output": true, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1e-05, + "output_cost_per_token_batches": 5e-06, + "search_context_cost_per_query": { + "search_context_size_high": 0.025, + "search_context_size_low": 0.025, + "search_context_size_medium": 0.025 + }, "supports_function_calling": true, "supports_parallel_function_calling": true, - "supports_system_messages": true, - "supports_tool_choice": true - }, - "gpt-4o-realtime-preview-2025-06-03": { - "cache_read_input_token_cost": 2.5e-06, - "deprecation_date": "2026-05-07", - "input_cost_per_audio_token": 4e-05, - "input_cost_per_token": 5e-06, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "realtime", - "output_cost_per_audio_token": 8e-05, - "output_cost_per_token": 2e-05, - "supports_audio_input": true, - "supports_audio_output": true, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_system_messages": true, - "supports_tool_choice": true - }, - "gpt-4o-search-preview": { - "cache_read_input_token_cost": 1.25e-06, - "input_cost_per_token": 2.5e-06, - "input_cost_per_token_batches": 1.25e-06, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1e-05, - "output_cost_per_token_batches": 5e-06, - "search_context_cost_per_query": { - "search_context_size_high": 0.025, - "search_context_size_low": 0.025, - "search_context_size_medium": 0.025 - }, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_response_schema": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_response_schema": true, "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "gpt-4o-search-preview-2025-03-11": { - "cache_read_input_token_cost": 1.25e-06, - "deprecation_date": "2026-07-23", - "input_cost_per_token": 2.5e-06, - "input_cost_per_token_batches": 1.25e-06, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1e-05, - "output_cost_per_token_batches": 5e-06, - "search_context_cost_per_query": { - "search_context_size_high": 0.025, - "search_context_size_low": 0.025, - "search_context_size_medium": 0.025 - }, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true - }, "gpt-4o-transcribe": { "input_cost_per_audio_token": 2.5e-06, "input_cost_per_token": 2.5e-06, @@ -31676,7 +32875,9 @@ "source": "https://developers.openai.com/api/docs/pricing" }, "gpt-image-1.5": { + "cache_read_input_image_token_cost": 2e-06, "cache_read_input_token_cost": 1.25e-06, + "cache_read_input_token_cost_batches": 6.3e-07, "deprecation_date": "2026-12-01", "input_cost_per_token": 5e-06, "litellm_provider": "openai", @@ -31695,7 +32896,9 @@ "supports_pdf_input": true }, "gpt-image-1.5-2025-12-16": { + "cache_read_input_image_token_cost": 2e-06, "cache_read_input_token_cost": 1.25e-06, + "cache_read_input_token_cost_batches": 6.3e-07, "deprecation_date": "2026-12-01", "input_cost_per_token": 5e-06, "litellm_provider": "openai", @@ -31714,7 +32917,9 @@ "supports_pdf_input": true }, "gpt-image-2": { + "cache_read_input_image_token_cost": 2e-06, "cache_read_input_token_cost": 1.25e-06, + "cache_read_input_token_cost_batches": 6.25e-07, "input_cost_per_token": 5e-06, "litellm_provider": "openai", "mode": "image_generation", @@ -31731,12 +32936,14 @@ "supports_pdf_input": true }, "gpt-image-2-2026-04-21": { + "cache_read_input_image_token_cost": 2e-06, "cache_read_input_token_cost": 1.25e-06, "input_cost_per_token": 5e-06, "litellm_provider": "openai", "mode": "image_generation", "input_cost_per_image_token": 8e-06, "output_cost_per_image_token": 3e-05, + "source": "https://developers.openai.com/api/docs/pricing", "supported_endpoints": [ "/v1/images/generations", "/v1/images/edits" @@ -31745,11 +32952,15 @@ "supports_pdf_input": true }, "gpt-image-2.5-flare": { + "cache_read_input_image_token_cost": 2e-06, "cache_read_input_token_cost": 1.25e-06, + "cache_read_input_token_cost_batches": 6.25e-07, "input_cost_per_token": 5e-06, "litellm_provider": "openai", "mode": "image_generation", "input_cost_per_image_token": 8e-06, + "input_cost_per_image_token_batches": 4e-06, + "input_cost_per_token_batches": 2.5e-06, "output_cost_per_image_token": 3e-05, "supported_endpoints": [ "/v1/images/generations", @@ -31760,6 +32971,7 @@ "source": "https://developers.openai.com/api/docs/pricing" }, "gpt-image-2.5-flare-2026-09-08": { + "cache_read_input_image_token_cost": 2e-06, "cache_read_input_token_cost": 1.25e-06, "input_cost_per_token": 5e-06, "litellm_provider": "openai", @@ -31775,11 +32987,15 @@ "source": "https://developers.openai.com/api/docs/pricing" }, "gpt-image-2.5-sunburst": { + "cache_read_input_image_token_cost": 2e-06, "cache_read_input_token_cost": 1.25e-06, + "cache_read_input_token_cost_batches": 6.25e-07, "input_cost_per_token": 5e-06, "litellm_provider": "openai", "mode": "image_generation", "input_cost_per_image_token": 8e-06, + "input_cost_per_image_token_batches": 4e-06, + "input_cost_per_token_batches": 2.5e-06, "output_cost_per_image_token": 3e-05, "supported_endpoints": [ "/v1/images/generations", @@ -31790,6 +33006,7 @@ "source": "https://developers.openai.com/api/docs/pricing" }, "gpt-image-2.5-sunburst-2026-09-08": { + "cache_read_input_image_token_cost": 2e-06, "cache_read_input_token_cost": 1.25e-06, "input_cost_per_token": 5e-06, "litellm_provider": "openai", @@ -32166,6 +33383,7 @@ }, "gpt-5": { "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_batches": 6.25e-08, "cache_read_input_token_cost_flex": 6.25e-08, "cache_read_input_token_cost_priority": 2.5e-07, "input_cost_per_token": 1.25e-06, @@ -32214,26 +33432,18 @@ "supports_xhigh_reasoning_effort": false, "supports_minimal_reasoning_effort": true }, - "gpt-5.1": { + "gpt-5-codex": { "cache_read_input_token_cost": 1.25e-07, - "cache_read_input_token_cost_flex": 6.25e-08, - "cache_read_input_token_cost_priority": 2.5e-07, + "deprecation_date": "2026-07-23", "input_cost_per_token": 1.25e-06, - "input_cost_per_token_priority": 2.5e-06, "litellm_provider": "openai", "max_input_tokens": 272000, "max_output_tokens": 128000, "max_tokens": 128000, - "mode": "chat", + "mode": "responses", "output_cost_per_token": 1e-05, - "output_cost_per_token_priority": 2e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, + "source": "https://developers.openai.com/api/docs/models/gpt-5-codex", "supported_endpoints": [ - "/v1/chat/completions", "/v1/responses" ], "supported_modalities": [ @@ -32241,8 +33451,7 @@ "image" ], "supported_output_modalities": [ - "text", - "image" + "text" ], "supports_function_calling": true, "supports_native_streaming": true, @@ -32251,22 +33460,13 @@ "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true, - "supports_none_reasoning_effort": true, - "default_reasoning_effort": "none", - "input_cost_per_token_batches": 6.25e-07, - "input_cost_per_token_flex": 6.25e-07, - "output_cost_per_token_batches": 5e-06, - "output_cost_per_token_flex": 5e-06, - "source": "https://developers.openai.com/api/docs/pricing", - "supports_xhigh_reasoning_effort": false, - "supports_minimal_reasoning_effort": false + "supports_web_search": true }, - "gpt-5.1-2025-11-13": { + "gpt-5.1": { "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_batches": 6.25e-08, "cache_read_input_token_cost_flex": 6.25e-08, "cache_read_input_token_cost_priority": 2.5e-07, "input_cost_per_token": 1.25e-06, @@ -32316,26 +33516,49 @@ "supports_xhigh_reasoning_effort": false, "supports_minimal_reasoning_effort": false }, - "gpt-5.1-chat-latest": { + "gpt-5.1-codex-mini": { + "cache_read_input_token_cost": 2.5e-08, + "deprecation_date": "2026-07-23", + "input_cost_per_token": 2.5e-07, + "litellm_provider": "openai", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "output_cost_per_token": 2e-06, + "source": "https://developers.openai.com/api/docs/models/gpt-5.1-codex-mini", + "supported_endpoints": [ + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "gpt-5.1-codex-max": { "cache_read_input_token_cost": 1.25e-07, - "cache_read_input_token_cost_priority": 2.5e-07, "deprecation_date": "2026-07-23", "input_cost_per_token": 1.25e-06, - "input_cost_per_token_priority": 2.5e-06, "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", "output_cost_per_token": 1e-05, - "output_cost_per_token_priority": 2e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, + "source": "https://developers.openai.com/api/docs/models/gpt-5.1-codex-max", "supported_endpoints": [ - "/v1/chat/completions", "/v1/responses" ], "supported_modalities": [ @@ -32343,46 +33566,31 @@ "image" ], "supported_output_modalities": [ - "text", - "image" + "text" ], - "supports_function_calling": false, + "supports_function_calling": true, "supports_native_streaming": true, - "supports_parallel_function_calling": false, + "supports_parallel_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": false, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true, - "supports_none_reasoning_effort": true, - "default_reasoning_effort": "none", - "supports_xhigh_reasoning_effort": false, - "supports_minimal_reasoning_effort": true + "supports_web_search": true }, - "gpt-5.2": { - "cache_read_input_token_cost": 1.75e-07, - "cache_read_input_token_cost_flex": 8.75e-08, - "cache_read_input_token_cost_priority": 3.5e-07, - "input_cost_per_token": 1.75e-06, - "input_cost_per_token_priority": 3.5e-06, + "gpt-5.1-codex": { + "cache_read_input_token_cost": 1.25e-07, + "deprecation_date": "2026-07-23", + "input_cost_per_token": 1.25e-06, "litellm_provider": "openai", - "max_input_tokens": 272000, + "max_input_tokens": 400000, "max_output_tokens": 128000, "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 1.4e-05, - "output_cost_per_token_priority": 2.8e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, + "mode": "responses", + "output_cost_per_token": 1e-05, + "source": "https://developers.openai.com/api/docs/models/gpt-5.1-codex", "supported_endpoints": [ - "/v1/chat/completions", - "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -32390,8 +33598,7 @@ "image" ], "supported_output_modalities": [ - "text", - "image" + "text" ], "supports_function_calling": true, "supports_native_streaming": true, @@ -32400,33 +33607,56 @@ "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true, - "supports_none_reasoning_effort": true, - "default_reasoning_effort": "none", - "input_cost_per_token_batches": 8.75e-07, - "input_cost_per_token_flex": 8.75e-07, - "output_cost_per_token_batches": 7e-06, - "output_cost_per_token_flex": 7e-06, - "source": "https://developers.openai.com/api/docs/pricing", - "supports_xhigh_reasoning_effort": true, - "supports_minimal_reasoning_effort": false + "supports_web_search": true }, - "gpt-5.2-2025-12-11": { - "cache_read_input_token_cost": 1.75e-07, - "cache_read_input_token_cost_flex": 8.75e-08, - "cache_read_input_token_cost_priority": 3.5e-07, - "input_cost_per_token": 1.75e-06, - "input_cost_per_token_priority": 3.5e-06, + "gpt-5.1-chat-latest": { + "cache_read_input_token_cost": 1.25e-07, + "deprecation_date": "2026-07-23", + "input_cost_per_token": 1.25e-06, + "litellm_provider": "openai", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1e-05, + "source": "https://developers.openai.com/api/docs/models/gpt-5.1-chat-latest", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "gpt-5.1-2025-11-13": { + "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_batches": 6.25e-08, + "cache_read_input_token_cost_flex": 6.25e-08, + "cache_read_input_token_cost_priority": 2.5e-07, + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_priority": 2.5e-06, "litellm_provider": "openai", "max_input_tokens": 272000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.4e-05, - "output_cost_per_token_priority": 2.8e-05, + "output_cost_per_token": 1e-05, + "output_cost_per_token_priority": 2e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -32434,7 +33664,6 @@ }, "supported_endpoints": [ "/v1/chat/completions", - "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -32458,24 +33687,25 @@ "supports_web_search": true, "supports_none_reasoning_effort": true, "default_reasoning_effort": "none", - "input_cost_per_token_batches": 8.75e-07, - "input_cost_per_token_flex": 8.75e-07, - "output_cost_per_token_batches": 7e-06, - "output_cost_per_token_flex": 7e-06, + "input_cost_per_token_batches": 6.25e-07, + "input_cost_per_token_flex": 6.25e-07, + "output_cost_per_token_batches": 5e-06, + "output_cost_per_token_flex": 5e-06, "source": "https://developers.openai.com/api/docs/pricing", - "supports_xhigh_reasoning_effort": true, + "supports_xhigh_reasoning_effort": false, "supports_minimal_reasoning_effort": false }, - "gpt-5.2-chat-latest": { + "gpt-5.2": { "cache_read_input_token_cost": 1.75e-07, + "cache_read_input_token_cost_batches": 8.75e-08, + "cache_read_input_token_cost_flex": 8.75e-08, "cache_read_input_token_cost_priority": 3.5e-07, - "deprecation_date": "2026-08-10", "input_cost_per_token": 1.75e-06, "input_cost_per_token_priority": 3.5e-06, "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "max_input_tokens": 272000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 1.4e-05, "output_cost_per_token_priority": 2.8e-05, @@ -32486,6 +33716,7 @@ }, "supported_endpoints": [ "/v1/chat/completions", + "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -32493,7 +33724,8 @@ "image" ], "supported_output_modalities": [ - "text" + "text", + "image" ], "supports_function_calling": true, "supports_native_streaming": true, @@ -32506,22 +33738,93 @@ "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true, - "supports_none_reasoning_effort": false, - "supports_xhigh_reasoning_effort": false, - "supports_minimal_reasoning_effort": true + "supports_none_reasoning_effort": true, + "default_reasoning_effort": "none", + "input_cost_per_token_batches": 8.75e-07, + "input_cost_per_token_flex": 8.75e-07, + "output_cost_per_token_batches": 7e-06, + "output_cost_per_token_flex": 7e-06, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_xhigh_reasoning_effort": true, + "supports_minimal_reasoning_effort": false }, - "gpt-5.3-chat-latest": { + "gpt-5.2-codex": { + "cache_read_input_token_cost": 1.75e-07, + "deprecation_date": "2026-07-23", + "input_cost_per_token": 1.75e-06, + "litellm_provider": "openai", + "max_input_tokens": 272000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "output_cost_per_token": 1.4e-05, + "source": "https://developers.openai.com/api/docs/models/gpt-5.2-codex", + "supported_endpoints": [ + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, + "gpt-5.2-chat-latest": { "cache_read_input_token_cost": 1.75e-07, - "cache_read_input_token_cost_priority": 3.5e-07, "deprecation_date": "2026-08-10", "input_cost_per_token": 1.75e-06, - "input_cost_per_token_priority": 3.5e-06, "litellm_provider": "openai", "max_input_tokens": 128000, "max_output_tokens": 16384, "max_tokens": 16384, "mode": "chat", "output_cost_per_token": 1.4e-05, + "source": "https://developers.openai.com/api/docs/models/gpt-5.2-chat-latest", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "gpt-5.2-2025-12-11": { + "cache_read_input_token_cost": 1.75e-07, + "cache_read_input_token_cost_batches": 8.75e-08, + "cache_read_input_token_cost_flex": 8.75e-08, + "cache_read_input_token_cost_priority": 3.5e-07, + "input_cost_per_token": 1.75e-06, + "input_cost_per_token_priority": 3.5e-06, + "litellm_provider": "openai", + "max_input_tokens": 272000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 1.4e-05, "output_cost_per_token_priority": 2.8e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, @@ -32530,6 +33833,7 @@ }, "supported_endpoints": [ "/v1/chat/completions", + "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -32537,7 +33841,8 @@ "image" ], "supported_output_modalities": [ - "text" + "text", + "image" ], "supports_function_calling": true, "supports_native_streaming": true, @@ -32550,9 +33855,15 @@ "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true, - "supports_none_reasoning_effort": false, - "supports_xhigh_reasoning_effort": false, - "supports_minimal_reasoning_effort": true + "supports_none_reasoning_effort": true, + "default_reasoning_effort": "none", + "input_cost_per_token_batches": 8.75e-07, + "input_cost_per_token_flex": 8.75e-07, + "output_cost_per_token_batches": 7e-06, + "output_cost_per_token_flex": 7e-06, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_xhigh_reasoning_effort": true, + "supports_minimal_reasoning_effort": false }, "gpt-5.2-pro": { "input_cost_per_token": 2.1e-05, @@ -32649,15 +33960,26 @@ "cache_read_input_token_cost_above_272k_tokens": 2e-06, "cache_read_input_token_cost_above_272k_tokens_flex": 1e-06, "cache_read_input_token_cost_above_272k_tokens_priority": 4e-06, + "cache_read_input_token_cost_batches": 5e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 1e-06, + "cache_creation_input_token_cost_batches": 6.25e-06, + "cache_creation_input_token_cost_above_272k_tokens_batches": 1.25e-05, + "cache_creation_input_token_cost_above_272k_tokens_ultrafast": 0.00015, + "cache_creation_input_token_cost_ultrafast": 7.5e-05, + "cache_read_input_token_cost_above_272k_tokens_ultrafast": 1.2e-05, "cache_read_input_token_cost_flex": 5e-07, "cache_read_input_token_cost_priority": 2e-06, + "cache_read_input_token_cost_ultrafast": 6e-06, "input_cost_per_token": 1e-05, "input_cost_per_token_above_272k_tokens": 2e-05, "input_cost_per_token_above_272k_tokens_flex": 1e-05, "input_cost_per_token_above_272k_tokens_priority": 4e-05, "input_cost_per_token_batches": 5e-06, + "input_cost_per_token_above_272k_tokens_batches": 1e-05, + "input_cost_per_token_above_272k_tokens_ultrafast": 0.00012, "input_cost_per_token_flex": 5e-06, "input_cost_per_token_priority": 2e-05, + "input_cost_per_token_ultrafast": 6e-05, "litellm_provider": "openai", "max_input_tokens": 922000, "max_output_tokens": 128000, @@ -32668,8 +33990,11 @@ "output_cost_per_token_above_272k_tokens_flex": 3.75e-05, "output_cost_per_token_above_272k_tokens_priority": 0.00015, "output_cost_per_token_batches": 2.5e-05, + "output_cost_per_token_above_272k_tokens_batches": 3.75e-05, + "output_cost_per_token_above_272k_tokens_ultrafast": 0.00045, "output_cost_per_token_flex": 2.5e-05, "output_cost_per_token_priority": 0.0001, + "output_cost_per_token_ultrafast": 0.0003, "regional_processing_uplift_multiplier_eu": 1.1, "regional_processing_uplift_multiplier_us": 1.1, "search_context_cost_per_query": { @@ -32708,6 +34033,158 @@ "supports_web_search": true, "supports_xhigh_reasoning_effort": true }, + "gpt-6-sol": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_creation_input_token_cost_above_272k_tokens_flex": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens_priority": 1e-05, + "cache_creation_input_token_cost_flex": 1.25e-06, + "cache_creation_input_token_cost_priority": 5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "cache_read_input_token_cost_above_272k_tokens_flex": 2e-07, + "cache_read_input_token_cost_above_272k_tokens_priority": 8e-07, + "cache_read_input_token_cost_batches": 1e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 2e-07, + "cache_creation_input_token_cost_batches": 1.25e-06, + "cache_creation_input_token_cost_above_272k_tokens_batches": 2.5e-06, + "cache_read_input_token_cost_flex": 1e-07, + "cache_read_input_token_cost_priority": 4e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, + "input_cost_per_token_above_272k_tokens_flex": 2e-06, + "input_cost_per_token_above_272k_tokens_priority": 8e-06, + "input_cost_per_token_batches": 1e-06, + "input_cost_per_token_above_272k_tokens_batches": 2e-06, + "input_cost_per_token_flex": 1e-06, + "input_cost_per_token_priority": 4e-06, + "litellm_provider": "openai", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, + "output_cost_per_token_above_272k_tokens_flex": 7.5e-06, + "output_cost_per_token_above_272k_tokens_priority": 3e-05, + "output_cost_per_token_batches": 5e-06, + "output_cost_per_token_above_272k_tokens_batches": 7.5e-06, + "output_cost_per_token_flex": 5e-06, + "output_cost_per_token_priority": 2e-05, + "regional_processing_uplift_multiplier_eu": 1.1, + "regional_processing_uplift_multiplier_us": 1.1, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_native_streaming": true, + "supports_none_reasoning_effort": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_cache_breakpoint": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_xhigh_reasoning_effort": true + }, + "gpt-6-luna": { + "cache_creation_input_token_cost": 1.25e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-07, + "cache_creation_input_token_cost_above_272k_tokens_flex": 1.25e-07, + "cache_creation_input_token_cost_above_272k_tokens_priority": 5e-07, + "cache_creation_input_token_cost_flex": 6.25e-08, + "cache_creation_input_token_cost_priority": 2.5e-07, + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "cache_read_input_token_cost_above_272k_tokens_flex": 1e-08, + "cache_read_input_token_cost_above_272k_tokens_priority": 4e-08, + "cache_read_input_token_cost_batches": 5e-09, + "cache_read_input_token_cost_above_272k_tokens_batches": 1e-08, + "cache_creation_input_token_cost_batches": 6.25e-08, + "cache_creation_input_token_cost_above_272k_tokens_batches": 1.25e-07, + "cache_read_input_token_cost_flex": 5e-09, + "cache_read_input_token_cost_priority": 2e-08, + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_272k_tokens": 2e-07, + "input_cost_per_token_above_272k_tokens_flex": 1e-07, + "input_cost_per_token_above_272k_tokens_priority": 4e-07, + "input_cost_per_token_batches": 5e-08, + "input_cost_per_token_above_272k_tokens_batches": 1e-07, + "input_cost_per_token_flex": 5e-08, + "input_cost_per_token_priority": 2e-07, + "litellm_provider": "openai", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 5e-07, + "output_cost_per_token_above_272k_tokens": 7.5e-07, + "output_cost_per_token_above_272k_tokens_flex": 3.75e-07, + "output_cost_per_token_above_272k_tokens_priority": 1.5e-06, + "output_cost_per_token_batches": 2.5e-07, + "output_cost_per_token_above_272k_tokens_batches": 3.75e-07, + "output_cost_per_token_flex": 2.5e-07, + "output_cost_per_token_priority": 1e-06, + "regional_processing_uplift_multiplier_eu": 1.1, + "regional_processing_uplift_multiplier_us": 1.1, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_native_streaming": true, + "supports_none_reasoning_effort": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_cache_breakpoint": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_xhigh_reasoning_effort": true + }, "gpt-5.6": { "cache_creation_input_token_cost": 5e-06, "cache_creation_input_token_cost_above_272k_tokens": 1e-05, @@ -32719,6 +34196,10 @@ "cache_read_input_token_cost_above_272k_tokens": 8e-07, "cache_read_input_token_cost_above_272k_tokens_flex": 4e-07, "cache_read_input_token_cost_above_272k_tokens_priority": 1.6e-06, + "cache_read_input_token_cost_batches": 2e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 4e-07, + "cache_creation_input_token_cost_batches": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens_batches": 5e-06, "cache_read_input_token_cost_flex": 2e-07, "cache_read_input_token_cost_priority": 8e-07, "input_cost_per_token": 4e-06, @@ -32726,6 +34207,7 @@ "input_cost_per_token_above_272k_tokens_flex": 4e-06, "input_cost_per_token_above_272k_tokens_priority": 1.6e-05, "input_cost_per_token_batches": 2e-06, + "input_cost_per_token_above_272k_tokens_batches": 4e-06, "input_cost_per_token_flex": 2e-06, "input_cost_per_token_priority": 8e-06, "litellm_provider": "openai", @@ -32738,6 +34220,7 @@ "output_cost_per_token_above_272k_tokens_flex": 1.5e-05, "output_cost_per_token_above_272k_tokens_priority": 6e-05, "output_cost_per_token_batches": 1e-05, + "output_cost_per_token_above_272k_tokens_batches": 1.5e-05, "output_cost_per_token_flex": 1e-05, "output_cost_per_token_priority": 4e-05, "regional_processing_uplift_multiplier_eu": 1.1, @@ -32786,6 +34269,10 @@ "cache_read_input_token_cost_above_272k_tokens": 8e-07, "cache_read_input_token_cost_above_272k_tokens_flex": 4e-07, "cache_read_input_token_cost_above_272k_tokens_priority": 1.6e-06, + "cache_read_input_token_cost_batches": 2e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 4e-07, + "cache_creation_input_token_cost_batches": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens_batches": 5e-06, "cache_read_input_token_cost_flex": 2e-07, "cache_read_input_token_cost_priority": 8e-07, "input_cost_per_token": 4e-06, @@ -32793,6 +34280,7 @@ "input_cost_per_token_above_272k_tokens_flex": 4e-06, "input_cost_per_token_above_272k_tokens_priority": 1.6e-05, "input_cost_per_token_batches": 2e-06, + "input_cost_per_token_above_272k_tokens_batches": 4e-06, "input_cost_per_token_flex": 2e-06, "input_cost_per_token_priority": 8e-06, "litellm_provider": "openai", @@ -32805,6 +34293,7 @@ "output_cost_per_token_above_272k_tokens_flex": 1.5e-05, "output_cost_per_token_above_272k_tokens_priority": 6e-05, "output_cost_per_token_batches": 1e-05, + "output_cost_per_token_above_272k_tokens_batches": 1.5e-05, "output_cost_per_token_flex": 1e-05, "output_cost_per_token_priority": 4e-05, "regional_processing_uplift_multiplier_eu": 1.1, @@ -32855,6 +34344,10 @@ "cache_read_input_token_cost_above_272k_tokens": 4e-07, "cache_read_input_token_cost_above_272k_tokens_flex": 2e-07, "cache_read_input_token_cost_above_272k_tokens_priority": 8e-07, + "cache_read_input_token_cost_batches": 1e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 2e-07, + "cache_creation_input_token_cost_batches": 1.25e-06, + "cache_creation_input_token_cost_above_272k_tokens_batches": 2.5e-06, "cache_read_input_token_cost_flex": 1e-07, "cache_read_input_token_cost_priority": 4e-07, "input_cost_per_token": 2e-06, @@ -32862,6 +34355,7 @@ "input_cost_per_token_above_272k_tokens_flex": 2e-06, "input_cost_per_token_above_272k_tokens_priority": 8e-06, "input_cost_per_token_batches": 1e-06, + "input_cost_per_token_above_272k_tokens_batches": 2e-06, "input_cost_per_token_flex": 1e-06, "input_cost_per_token_priority": 4e-06, "litellm_provider": "openai", @@ -32874,6 +34368,7 @@ "output_cost_per_token_above_272k_tokens_flex": 9e-06, "output_cost_per_token_above_272k_tokens_priority": 3.6e-05, "output_cost_per_token_batches": 6e-06, + "output_cost_per_token_above_272k_tokens_batches": 9e-06, "output_cost_per_token_flex": 6e-06, "output_cost_per_token_priority": 2.4e-05, "regional_processing_uplift_multiplier_eu": 1.1, @@ -32923,6 +34418,10 @@ "cache_read_input_token_cost_above_272k_tokens": 4e-08, "cache_read_input_token_cost_above_272k_tokens_flex": 2e-08, "cache_read_input_token_cost_above_272k_tokens_priority": 8e-08, + "cache_read_input_token_cost_batches": 1e-08, + "cache_read_input_token_cost_above_272k_tokens_batches": 2e-08, + "cache_creation_input_token_cost_batches": 1.25e-07, + "cache_creation_input_token_cost_above_272k_tokens_batches": 2.5e-07, "cache_read_input_token_cost_flex": 1e-08, "cache_read_input_token_cost_priority": 4e-08, "input_cost_per_token": 2e-07, @@ -32930,6 +34429,7 @@ "input_cost_per_token_above_272k_tokens_flex": 2e-07, "input_cost_per_token_above_272k_tokens_priority": 8e-07, "input_cost_per_token_batches": 1e-07, + "input_cost_per_token_above_272k_tokens_batches": 2e-07, "input_cost_per_token_flex": 1e-07, "input_cost_per_token_priority": 4e-07, "litellm_provider": "openai", @@ -32942,6 +34442,7 @@ "output_cost_per_token_above_272k_tokens_flex": 9e-07, "output_cost_per_token_above_272k_tokens_priority": 3.6e-06, "output_cost_per_token_batches": 6e-07, + "output_cost_per_token_above_272k_tokens_batches": 9e-07, "output_cost_per_token_flex": 6e-07, "output_cost_per_token_priority": 2.4e-06, "regional_processing_uplift_multiplier_eu": 1.1, @@ -33212,12 +34713,15 @@ "gpt-5.5": { "cache_read_input_token_cost": 5e-07, "cache_read_input_token_cost_above_272k_tokens": 1e-06, + "cache_read_input_token_cost_batches": 2.5e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 5e-07, "cache_read_input_token_cost_flex": 2.5e-07, "cache_read_input_token_cost_priority": 1.25e-06, "input_cost_per_token": 5e-06, "input_cost_per_token_above_272k_tokens": 1e-05, "input_cost_per_token_flex": 2.5e-06, "input_cost_per_token_batches": 2.5e-06, + "input_cost_per_token_above_272k_tokens_batches": 5e-06, "input_cost_per_token_priority": 1.25e-05, "litellm_provider": "openai", "max_input_tokens": 1050000, @@ -33228,6 +34732,7 @@ "output_cost_per_token_above_272k_tokens": 4.5e-05, "output_cost_per_token_flex": 1.5e-05, "output_cost_per_token_batches": 1.5e-05, + "output_cost_per_token_above_272k_tokens_batches": 2.25e-05, "output_cost_per_token_priority": 7.5e-05, "regional_processing_uplift_multiplier_eu": 1.1, "regional_processing_uplift_multiplier_us": 1.1, @@ -33270,12 +34775,15 @@ "gpt-5.5-2026-04-23": { "cache_read_input_token_cost": 5e-07, "cache_read_input_token_cost_above_272k_tokens": 1e-06, + "cache_read_input_token_cost_batches": 2.5e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 5e-07, "cache_read_input_token_cost_flex": 2.5e-07, "cache_read_input_token_cost_priority": 1.25e-06, "input_cost_per_token": 5e-06, "input_cost_per_token_above_272k_tokens": 1e-05, "input_cost_per_token_flex": 2.5e-06, "input_cost_per_token_batches": 2.5e-06, + "input_cost_per_token_above_272k_tokens_batches": 5e-06, "input_cost_per_token_priority": 1.25e-05, "litellm_provider": "openai", "max_input_tokens": 1050000, @@ -33286,6 +34794,7 @@ "output_cost_per_token_above_272k_tokens": 4.5e-05, "output_cost_per_token_flex": 1.5e-05, "output_cost_per_token_batches": 1.5e-05, + "output_cost_per_token_above_272k_tokens_batches": 2.25e-05, "output_cost_per_token_priority": 7.5e-05, "regional_processing_uplift_multiplier_eu": 1.1, "regional_processing_uplift_multiplier_us": 1.1, @@ -33330,6 +34839,7 @@ "input_cost_per_token_above_272k_tokens": 6e-05, "input_cost_per_token_flex": 1.5e-05, "input_cost_per_token_batches": 1.5e-05, + "input_cost_per_token_above_272k_tokens_batches": 3e-05, "litellm_provider": "openai", "max_input_tokens": 1050000, "max_output_tokens": 128000, @@ -33339,6 +34849,7 @@ "output_cost_per_token_above_272k_tokens": 0.00027, "output_cost_per_token_flex": 9e-05, "output_cost_per_token_batches": 9e-05, + "output_cost_per_token_above_272k_tokens_batches": 0.000135, "regional_processing_uplift_multiplier_eu": 1.1, "regional_processing_uplift_multiplier_us": 1.1, "search_context_cost_per_query": { @@ -33379,6 +34890,7 @@ "input_cost_per_token_above_272k_tokens": 6e-05, "input_cost_per_token_flex": 1.5e-05, "input_cost_per_token_batches": 1.5e-05, + "input_cost_per_token_above_272k_tokens_batches": 3e-05, "litellm_provider": "openai", "max_input_tokens": 1050000, "max_output_tokens": 128000, @@ -33388,6 +34900,7 @@ "output_cost_per_token_above_272k_tokens": 0.00027, "output_cost_per_token_flex": 9e-05, "output_cost_per_token_batches": 9e-05, + "output_cost_per_token_above_272k_tokens_batches": 0.000135, "regional_processing_uplift_multiplier_eu": 1.1, "regional_processing_uplift_multiplier_us": 1.1, "search_context_cost_per_query": { @@ -33426,12 +34939,15 @@ "gpt-5.4": { "cache_read_input_token_cost": 2.5e-07, "cache_read_input_token_cost_above_272k_tokens": 5e-07, + "cache_read_input_token_cost_batches": 1.3e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 2.5e-07, "cache_read_input_token_cost_flex": 1.3e-07, "cache_read_input_token_cost_priority": 5e-07, "input_cost_per_token": 2.5e-06, "input_cost_per_token_above_272k_tokens": 5e-06, "input_cost_per_token_flex": 1.25e-06, "input_cost_per_token_batches": 1.25e-06, + "input_cost_per_token_above_272k_tokens_batches": 2.5e-06, "input_cost_per_token_priority": 5e-06, "litellm_provider": "openai", "max_input_tokens": 1050000, @@ -33442,6 +34958,7 @@ "output_cost_per_token_above_272k_tokens": 2.25e-05, "output_cost_per_token_flex": 7.5e-06, "output_cost_per_token_batches": 7.5e-06, + "output_cost_per_token_above_272k_tokens_batches": 1.125e-05, "output_cost_per_token_priority": 3e-05, "regional_processing_uplift_multiplier_eu": 1.1, "regional_processing_uplift_multiplier_us": 1.1, @@ -33479,12 +34996,15 @@ "gpt-5.4-2026-03-05": { "cache_read_input_token_cost": 2.5e-07, "cache_read_input_token_cost_above_272k_tokens": 5e-07, + "cache_read_input_token_cost_batches": 1.3e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 2.5e-07, "cache_read_input_token_cost_flex": 1.3e-07, "cache_read_input_token_cost_priority": 5e-07, "input_cost_per_token": 2.5e-06, "input_cost_per_token_above_272k_tokens": 5e-06, "input_cost_per_token_flex": 1.25e-06, "input_cost_per_token_batches": 1.25e-06, + "input_cost_per_token_above_272k_tokens_batches": 2.5e-06, "input_cost_per_token_priority": 5e-06, "litellm_provider": "openai", "max_input_tokens": 1050000, @@ -33495,6 +35015,7 @@ "output_cost_per_token_above_272k_tokens": 2.25e-05, "output_cost_per_token_flex": 7.5e-06, "output_cost_per_token_batches": 7.5e-06, + "output_cost_per_token_above_272k_tokens_batches": 1.125e-05, "output_cost_per_token_priority": 3e-05, "regional_processing_uplift_multiplier_eu": 1.1, "regional_processing_uplift_multiplier_us": 1.1, @@ -33534,6 +35055,7 @@ "input_cost_per_token_above_272k_tokens": 6e-05, "input_cost_per_token_flex": 1.5e-05, "input_cost_per_token_batches": 1.5e-05, + "input_cost_per_token_above_272k_tokens_batches": 3e-05, "litellm_provider": "openai", "max_input_tokens": 1050000, "max_output_tokens": 128000, @@ -33543,6 +35065,7 @@ "output_cost_per_token_above_272k_tokens": 0.00027, "output_cost_per_token_flex": 9e-05, "output_cost_per_token_batches": 9e-05, + "output_cost_per_token_above_272k_tokens_batches": 0.000135, "regional_processing_uplift_multiplier_eu": 1.1, "regional_processing_uplift_multiplier_us": 1.1, "search_context_cost_per_query": { @@ -33584,6 +35107,7 @@ "input_cost_per_token_above_272k_tokens": 6e-05, "input_cost_per_token_flex": 1.5e-05, "input_cost_per_token_batches": 1.5e-05, + "input_cost_per_token_above_272k_tokens_batches": 3e-05, "litellm_provider": "openai", "max_input_tokens": 1050000, "max_output_tokens": 128000, @@ -33593,6 +35117,7 @@ "output_cost_per_token_above_272k_tokens": 0.00027, "output_cost_per_token_flex": 9e-05, "output_cost_per_token_batches": 9e-05, + "output_cost_per_token_above_272k_tokens_batches": 0.000135, "regional_processing_uplift_multiplier_eu": 1.1, "regional_processing_uplift_multiplier_us": 1.1, "search_context_cost_per_query": { @@ -33631,6 +35156,7 @@ }, "gpt-5.4-mini": { "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, "cache_read_input_token_cost_flex": 3.75e-08, "cache_read_input_token_cost_priority": 1.5e-07, "input_cost_per_token": 7.5e-07, @@ -33684,6 +35210,7 @@ }, "gpt-5.4-mini-2026-03-17": { "cache_read_input_token_cost": 7.5e-08, + "cache_read_input_token_cost_batches": 3.75e-08, "cache_read_input_token_cost_flex": 3.75e-08, "cache_read_input_token_cost_priority": 1.5e-07, "input_cost_per_token": 7.5e-07, @@ -33737,6 +35264,7 @@ }, "gpt-5.4-nano": { "cache_read_input_token_cost": 2e-08, + "cache_read_input_token_cost_batches": 1e-08, "cache_read_input_token_cost_flex": 1e-08, "input_cost_per_token": 2e-07, "input_cost_per_token_flex": 1e-07, @@ -33787,6 +35315,7 @@ }, "gpt-5.4-nano-2026-03-17": { "cache_read_input_token_cost": 2e-08, + "cache_read_input_token_cost_batches": 1e-08, "cache_read_input_token_cost_flex": 1e-08, "input_cost_per_token": 2e-07, "input_cost_per_token_flex": 1e-07, @@ -33922,6 +35451,7 @@ }, "gpt-5-2025-08-07": { "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_batches": 6.25e-08, "cache_read_input_token_cost_flex": 6.25e-08, "cache_read_input_token_cost_priority": 2.5e-07, "deprecation_date": "2026-12-11", @@ -33973,6 +35503,7 @@ }, "gpt-5-chat": { "cache_read_input_token_cost": 1.25e-07, + "deprecation_date": "2026-07-23", "input_cost_per_token": 1.25e-06, "litellm_provider": "openai", "max_input_tokens": 128000, @@ -34016,9 +35547,9 @@ "max_tokens": 16384, "mode": "chat", "output_cost_per_token": 1e-05, + "source": "https://developers.openai.com/api/docs/models/gpt-5-chat-latest", "supported_endpoints": [ "/v1/chat/completions", - "/v1/batch", "/v1/responses" ], "supported_modalities": [ @@ -34028,35 +35559,34 @@ "supported_output_modalities": [ "text" ], - "supports_function_calling": false, + "supports_function_calling": true, "supports_native_streaming": true, - "supports_parallel_function_calling": false, + "supports_parallel_function_calling": true, "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": false, - "supports_vision": true, - "supports_none_reasoning_effort": false, - "supports_xhigh_reasoning_effort": false, - "supports_minimal_reasoning_effort": true + "supports_tool_choice": true, + "supports_vision": true }, - "gpt-5-codex": { - "cache_read_input_token_cost": 1.25e-07, - "deprecation_date": "2026-07-23", - "input_cost_per_token": 1.25e-06, + "gpt-5.3-codex": { + "cache_read_input_token_cost": 1.75e-07, + "cache_read_input_token_cost_priority": 3.5e-07, + "input_cost_per_token": 1.75e-06, + "input_cost_per_token_priority": 3.5e-06, "litellm_provider": "openai", "max_input_tokens": 272000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "responses", - "output_cost_per_token": 1e-05, + "output_cost_per_token": 1.4e-05, + "output_cost_per_token_priority": 2.8e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, + "source": "https://developers.openai.com/api/docs/pricing", "supported_endpoints": [ "/v1/responses" ], @@ -34082,194 +35612,19 @@ "supports_xhigh_reasoning_effort": false, "supports_minimal_reasoning_effort": true }, - "gpt-5.1-codex": { - "cache_read_input_token_cost": 1.25e-07, - "cache_read_input_token_cost_priority": 2.5e-07, - "deprecation_date": "2026-07-23", - "input_cost_per_token": 1.25e-06, - "input_cost_per_token_priority": 2.5e-06, - "litellm_provider": "openai", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "output_cost_per_token": 1e-05, - "output_cost_per_token_priority": 2e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supported_endpoints": [ - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": false, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_none_reasoning_effort": false, - "supports_xhigh_reasoning_effort": false, - "supports_minimal_reasoning_effort": true - }, - "gpt-5.1-codex-max": { - "cache_read_input_token_cost": 1.25e-07, - "deprecation_date": "2026-07-23", - "input_cost_per_token": 1.25e-06, - "litellm_provider": "openai", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "output_cost_per_token": 1e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supported_endpoints": [ - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": false, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_none_reasoning_effort": false, - "supports_xhigh_reasoning_effort": true, - "supports_minimal_reasoning_effort": true - }, - "gpt-5.1-codex-mini": { - "cache_read_input_token_cost": 2.5e-08, - "cache_read_input_token_cost_priority": 4.5e-08, - "deprecation_date": "2026-07-23", - "input_cost_per_token": 2.5e-07, - "input_cost_per_token_priority": 4.5e-07, - "litellm_provider": "openai", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "output_cost_per_token": 2e-06, - "output_cost_per_token_priority": 3.6e-06, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supported_endpoints": [ - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": false, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_none_reasoning_effort": false, - "supports_xhigh_reasoning_effort": false, - "supports_minimal_reasoning_effort": true - }, - "gpt-5.2-codex": { - "cache_read_input_token_cost": 1.75e-07, - "cache_read_input_token_cost_priority": 3.5e-07, - "deprecation_date": "2026-07-23", - "input_cost_per_token": 1.75e-06, - "input_cost_per_token_priority": 3.5e-06, - "litellm_provider": "openai", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "output_cost_per_token": 1.4e-05, - "output_cost_per_token_priority": 2.8e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supported_endpoints": [ - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": false, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_none_reasoning_effort": false, - "supports_xhigh_reasoning_effort": true, - "supports_minimal_reasoning_effort": true - }, - "gpt-5.3-codex": { + "gpt-5.3-chat-latest": { "cache_read_input_token_cost": 1.75e-07, - "cache_read_input_token_cost_priority": 3.5e-07, + "deprecation_date": "2026-08-10", "input_cost_per_token": 1.75e-06, - "input_cost_per_token_priority": 3.5e-06, "litellm_provider": "openai", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", "output_cost_per_token": 1.4e-05, - "output_cost_per_token_priority": 2.8e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "source": "https://developers.openai.com/api/docs/pricing", + "source": "https://developers.openai.com/api/docs/models/gpt-5.3-chat-latest", "supported_endpoints": [ + "/v1/chat/completions", "/v1/responses" ], "supported_modalities": [ @@ -34283,19 +35638,15 @@ "supports_native_streaming": true, "supports_parallel_function_calling": true, "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": false, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_none_reasoning_effort": false, - "supports_xhigh_reasoning_effort": false, - "supports_minimal_reasoning_effort": true + "supports_vision": true }, "gpt-5-mini": { "cache_read_input_token_cost": 2.5e-08, + "cache_read_input_token_cost_batches": 1.25e-08, "cache_read_input_token_cost_flex": 1.25e-08, "cache_read_input_token_cost_priority": 4.5e-08, "input_cost_per_token": 2.5e-07, @@ -34346,6 +35697,7 @@ }, "gpt-5-mini-2025-08-07": { "cache_read_input_token_cost": 2.5e-08, + "cache_read_input_token_cost_batches": 1.25e-08, "cache_read_input_token_cost_flex": 1.25e-08, "cache_read_input_token_cost_priority": 4.5e-08, "deprecation_date": "2026-12-11", @@ -34397,6 +35749,7 @@ }, "gpt-5-nano": { "cache_read_input_token_cost": 5e-09, + "cache_read_input_token_cost_batches": 2.5e-09, "cache_read_input_token_cost_flex": 2.5e-09, "input_cost_per_token": 5e-08, "input_cost_per_token_batches": 2.5e-08, @@ -34445,6 +35798,7 @@ }, "gpt-5-nano-2025-08-07": { "cache_read_input_token_cost": 5e-09, + "cache_read_input_token_cost_batches": 2.5e-09, "cache_read_input_token_cost_flex": 2.5e-09, "deprecation_date": "2026-12-11", "input_cost_per_token": 5e-08, @@ -34493,7 +35847,9 @@ "supports_minimal_reasoning_effort": true }, "gpt-image-1": { + "cache_read_input_image_token_cost": 2.5e-06, "cache_read_input_token_cost": 1.25e-06, + "cache_read_input_token_cost_batches": 6.3e-07, "deprecation_date": "2026-10-23", "input_cost_per_image_token": 1e-05, "input_cost_per_image_token_batches": 5e-06, @@ -34509,7 +35865,9 @@ ] }, "gpt-image-1-mini": { + "cache_read_input_image_token_cost": 2.5e-07, "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1e-07, "deprecation_date": "2026-12-01", "input_cost_per_image_token": 2.5e-06, "input_cost_per_image_token_batches": 1.25e-06, @@ -34527,6 +35885,7 @@ "gpt-realtime": { "cache_creation_input_audio_token_cost": 4e-07, "cache_read_input_audio_token_cost": 4e-07, + "cache_read_input_image_token_cost": 5e-07, "cache_read_input_token_cost": 4e-07, "deprecation_date": "2027-01-20", "input_cost_per_audio_token": 3.2e-05, @@ -34562,6 +35921,7 @@ "gpt-realtime-1.5": { "cache_creation_input_audio_token_cost": 4e-07, "cache_read_input_audio_token_cost": 4e-07, + "cache_read_input_image_token_cost": 5e-07, "cache_read_input_token_cost": 4e-07, "input_cost_per_audio_token": 3.2e-05, "input_cost_per_image_token": 5e-06, @@ -34596,6 +35956,7 @@ "gpt-realtime-2": { "cache_creation_input_audio_token_cost": 4e-07, "cache_read_input_audio_token_cost": 4e-07, + "cache_read_input_image_token_cost": 5e-07, "cache_read_input_token_cost": 4e-07, "input_cost_per_audio_token": 3.2e-05, "input_cost_per_image_token": 5e-06, @@ -34630,6 +35991,7 @@ "gpt-realtime-2.1": { "cache_creation_input_audio_token_cost": 4e-07, "cache_read_input_audio_token_cost": 4e-07, + "cache_read_input_image_token_cost": 5e-07, "cache_read_input_token_cost": 4e-07, "input_cost_per_audio_token": 3.2e-05, "input_cost_per_image_token": 5e-06, @@ -34666,6 +36028,7 @@ "gpt-realtime-2.1-mini": { "cache_creation_input_audio_token_cost": 3e-07, "cache_read_input_audio_token_cost": 3e-07, + "cache_read_input_image_token_cost": 8e-08, "cache_read_input_token_cost": 6e-08, "input_cost_per_audio_token": 1e-05, "input_cost_per_image_token": 8e-07, @@ -34702,6 +36065,7 @@ "gpt-realtime-mini": { "cache_creation_input_audio_token_cost": 3e-07, "cache_read_input_audio_token_cost": 3e-07, + "cache_read_input_image_token_cost": 8e-08, "cache_read_input_token_cost": 6e-08, "deprecation_date": "2027-01-20", "input_cost_per_audio_token": 1e-05, @@ -34737,6 +36101,7 @@ "gpt-realtime-2025-08-28": { "cache_creation_input_audio_token_cost": 4e-07, "cache_read_input_audio_token_cost": 4e-07, + "cache_read_input_image_token_cost": 5e-07, "cache_read_input_token_cost": 4e-07, "deprecation_date": "2027-01-20", "input_cost_per_audio_token": 3.2e-05, @@ -35085,44 +36450,15 @@ "supports_response_schema": true, "supports_vision": true }, - "groq/llama-3.1-8b-instant": { - "deprecation_date": "2026-08-16", - "input_cost_per_token": 5e-08, - "litellm_provider": "groq", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 8e-08, - "supports_function_calling": true, - "supports_response_schema": false, - "supports_tool_choice": true - }, - "groq/llama-3.3-70b-versatile": { - "deprecation_date": "2026-08-16", - "input_cost_per_token": 5.9e-07, - "litellm_provider": "groq", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 7.9e-07, - "supports_function_calling": true, - "supports_response_schema": false, - "supports_tool_choice": true - }, - "groq/gemma-7b-it": { - "deprecation_date": "2024-12-18", - "input_cost_per_token": 5e-08, + "groq/llama-guard-3-8b": { + "deprecation_date": "2025-06-06", + "input_cost_per_token": 2e-07, "litellm_provider": "groq", "max_input_tokens": 8192, - "max_output_tokens": 8192, "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 8e-08, - "supports_function_calling": true, - "supports_response_schema": false, - "supports_tool_choice": true + "output_cost_per_token": 2e-07, + "source": "https://console.groq.com/docs/model/llama-guard-3-8b" }, "groq/meta-llama/llama-prompt-guard-2-22m": { "input_cost_per_token": 3e-08, @@ -35144,58 +36480,6 @@ "output_cost_per_token": 4e-08, "source": "https://console.groq.com/docs/model/meta-llama/llama-prompt-guard-2-86m" }, - "groq/meta-llama/llama-guard-4-12b": { - "deprecation_date": "2026-03-05", - "input_cost_per_token": 2e-07, - "litellm_provider": "groq", - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 2e-07 - }, - "groq/meta-llama/llama-4-maverick-17b-128e-instruct": { - "deprecation_date": "2026-03-09", - "input_cost_per_token": 2e-07, - "litellm_provider": "groq", - "max_input_tokens": 131072, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 6e-07, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "groq/meta-llama/llama-4-scout-17b-16e-instruct": { - "deprecation_date": "2026-07-17", - "input_cost_per_token": 1.1e-07, - "litellm_provider": "groq", - "max_input_tokens": 131072, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 3.4e-07, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "groq/moonshotai/kimi-k2-instruct-0905": { - "deprecation_date": "2026-04-15", - "input_cost_per_token": 1e-06, - "output_cost_per_token": 3e-06, - "cache_read_input_token_cost": 5e-07, - "litellm_provider": "groq", - "max_input_tokens": 262144, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "groq/openai/gpt-oss-120b": { "cache_read_input_token_cost": 7.5e-08, "input_cost_per_token": 1.5e-07, @@ -35276,45 +36560,6 @@ "mode": "audio_speech", "source": "https://console.groq.com/docs/models" }, - "groq/playai-tts": { - "deprecation_date": "2025-12-31", - "input_cost_per_character": 5e-05, - "litellm_provider": "groq", - "max_input_tokens": 10000, - "max_output_tokens": 10000, - "max_tokens": 10000, - "mode": "audio_speech" - }, - "groq/qwen/qwen3.6-27b": { - "input_cost_per_token": 6e-07, - "litellm_provider": "groq", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://console.groq.com/docs/model/qwen/qwen3.6-27b", - "deprecation_date": "2026-09-14", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_tool_choice": true, - "supports_vision": true - }, - "groq/qwen/qwen3-32b": { - "deprecation_date": "2026-07-17", - "input_cost_per_token": 2.9e-07, - "litellm_provider": "groq", - "max_input_tokens": 131000, - "max_output_tokens": 131000, - "max_tokens": 131000, - "mode": "chat", - "output_cost_per_token": 5.9e-07, - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_tool_choice": true - }, "groq/whisper-large-v3": { "input_cost_per_second": 3.083e-05, "litellm_provider": "groq", @@ -35327,27 +36572,6 @@ "mode": "audio_transcription", "output_cost_per_second": 0.0 }, - "hd/1024-x-1024/dall-e-3": { - "deprecation_date": "2026-05-12", - "input_cost_per_pixel": 7.629e-08, - "litellm_provider": "openai", - "mode": "image_generation", - "output_cost_per_pixel": 0.0 - }, - "hd/1024-x-1792/dall-e-3": { - "deprecation_date": "2026-05-12", - "input_cost_per_pixel": 6.539e-08, - "litellm_provider": "openai", - "mode": "image_generation", - "output_cost_per_pixel": 0.0 - }, - "hd/1792-x-1024/dall-e-3": { - "deprecation_date": "2026-05-12", - "input_cost_per_pixel": 6.539e-08, - "litellm_provider": "openai", - "mode": "image_generation", - "output_cost_per_pixel": 0.0 - }, "heroku/claude-3-5-haiku": { "litellm_provider": "heroku", "max_tokens": 8192, @@ -35791,7 +37015,8 @@ "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 1024, "input_cost_per_token_batches": 1.65e-06, - "output_cost_per_token_batches": 8.25e-06 + "output_cost_per_token_batches": 8.25e-06, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "jp.anthropic.claude-haiku-4-5-20251001-v1:0": { "cache_creation_input_token_cost": 1.375e-06, @@ -35805,7 +37030,7 @@ "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 5.5e-06, - "source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock", + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_assistant_prefill": true, "supports_computer_use": true, "supports_function_calling": true, @@ -36382,7 +37607,8 @@ "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 1e-06 + "output_cost_per_token": 1e-06, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "meta.llama2-70b-chat-v1": { "input_cost_per_token": 1.95e-06, @@ -36391,27 +37617,30 @@ "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 2.56e-06 + "output_cost_per_token": 2.56e-06, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "meta.llama3-1-405b-instruct-v1:0": { - "input_cost_per_token": 5.32e-06, + "input_cost_per_token": 2.4e-06, "litellm_provider": "bedrock", "max_input_tokens": 128000, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 1.6e-05, + "output_cost_per_token": 2.4e-06, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, "supports_tool_choice": false }, "meta.llama3-1-70b-instruct-v1:0": { - "input_cost_per_token": 9.9e-07, + "input_cost_per_token": 7.2e-07, "litellm_provider": "bedrock", "max_input_tokens": 128000, "max_output_tokens": 2048, "max_tokens": 2048, "mode": "chat", - "output_cost_per_token": 9.9e-07, + "output_cost_per_token": 7.2e-07, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, "supports_tool_choice": false }, @@ -36427,13 +37656,14 @@ "supports_tool_choice": false }, "meta.llama3-2-11b-instruct-v1:0": { - "input_cost_per_token": 3.5e-07, + "input_cost_per_token": 1.6e-07, "litellm_provider": "bedrock", "max_input_tokens": 128000, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 3.5e-07, + "output_cost_per_token": 1.6e-07, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, "supports_tool_choice": false, "supports_vision": true @@ -36461,13 +37691,14 @@ "supports_tool_choice": false }, "meta.llama3-2-90b-instruct-v1:0": { - "input_cost_per_token": 2e-06, + "input_cost_per_token": 7.2e-07, "litellm_provider": "bedrock", "max_input_tokens": 128000, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 2e-06, + "output_cost_per_token": 7.2e-07, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, "supports_tool_choice": false, "supports_vision": true @@ -36833,39 +38064,50 @@ "minimax.minimax-m2": { "input_cost_per_token": 3e-07, "litellm_provider": "bedrock_converse", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_input_tokens": 1000000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "output_cost_per_token": 1.2e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_function_calling": true, "supports_system_messages": true, - "supports_native_structured_output": true + "supports_native_structured_output": true, + "supports_response_schema": true, + "supports_vision": false }, "minimax.minimax-m2.1": { "input_cost_per_token": 3e-07, "litellm_provider": "bedrock_converse", "max_input_tokens": 196000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "output_cost_per_token": 1.2e-06, "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, - "source": "https://aws.amazon.com/bedrock/pricing/" + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "minimax.minimax-m2.5": { "input_cost_per_token": 3e-07, "output_cost_per_token": 1.2e-06, "litellm_provider": "bedrock_converse", - "max_input_tokens": 1000000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_input_tokens": 196000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, - "source": "https://aws.amazon.com/bedrock/pricing/" + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "minimax/speech-02-hd": { "input_cost_per_character": 0.0001, @@ -36996,62 +38238,81 @@ "input_cost_per_token": 4e-07, "litellm_provider": "bedrock_converse", "max_input_tokens": 256000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 32000, + "max_tokens": 32000, "mode": "chat", "output_cost_per_token": 2e-06, "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, - "source": "https://aws.amazon.com/bedrock/pricing/" + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "mistral.magistral-small-2509": { "input_cost_per_token": 5e-07, "litellm_provider": "bedrock_converse", "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 40000, + "max_tokens": 40000, "mode": "chat", "output_cost_per_token": 1.5e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, "supports_function_calling": true, "supports_reasoning": true, - "supports_system_messages": true + "supports_response_schema": true, + "supports_system_messages": true, + "supports_vision": true }, "mistral.ministral-3-14b-instruct": { "input_cost_per_token": 2e-07, "litellm_provider": "bedrock_converse", "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "output_cost_per_token": 2e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, "supports_function_calling": true, "supports_system_messages": true, - "supports_native_structured_output": true + "supports_native_structured_output": true, + "supports_response_schema": true, + "supports_vision": true }, "mistral.ministral-3-3b-instruct": { "input_cost_per_token": 1e-07, "litellm_provider": "bedrock_converse", "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "output_cost_per_token": 1e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, "supports_function_calling": true, "supports_system_messages": true, - "supports_native_structured_output": true + "supports_native_structured_output": true, + "supports_response_schema": true, + "supports_vision": true }, "mistral.ministral-3-8b-instruct": { "input_cost_per_token": 1.5e-07, "litellm_provider": "bedrock_converse", "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "output_cost_per_token": 1.5e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, "supports_function_calling": true, "supports_system_messages": true, - "supports_native_structured_output": true + "supports_native_structured_output": true, + "supports_response_schema": true, + "supports_vision": true }, "mistral.mistral-7b-instruct-v0:2": { "input_cost_per_token": 1.5e-07, @@ -37061,49 +38322,59 @@ "max_tokens": 8191, "mode": "chat", "output_cost_per_token": 2e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_tool_choice": true }, "mistral.mistral-large-2402-v1:0": { - "input_cost_per_token": 8e-06, + "input_cost_per_token": 4e-06, "litellm_provider": "bedrock", "max_input_tokens": 32000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_token": 2.4e-05, + "output_cost_per_token": 1.2e-05, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true }, "mistral.mistral-large-2407-v1:0": { - "input_cost_per_token": 3e-06, + "input_cost_per_token": 2e-06, "litellm_provider": "bedrock", "max_input_tokens": 128000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", - "output_cost_per_token": 9e-06, + "output_cost_per_token": 6e-06, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, "supports_tool_choice": true }, "mistral.mistral-large-3-675b-instruct": { "input_cost_per_token": 5e-07, "litellm_provider": "bedrock_converse", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_input_tokens": 256000, + "max_output_tokens": 32000, + "max_tokens": 32000, "mode": "chat", "output_cost_per_token": 1.5e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, "supports_function_calling": true, "supports_system_messages": true, - "supports_native_structured_output": true + "supports_native_structured_output": true, + "supports_response_schema": true, + "supports_vision": true }, "mistral.mistral-small-2402-v1:0": { "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 5e-07, "litellm_provider": "bedrock", "max_input_tokens": 32000, "max_output_tokens": 8191, "max_tokens": 8191, "mode": "chat", "output_cost_per_token": 3e-06, + "output_cost_per_token_batches": 1.5e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true }, "mistral.mixtral-8x7b-instruct-v0:1": { @@ -37114,6 +38385,7 @@ "max_tokens": 8191, "mode": "chat", "output_cost_per_token": 7e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_tool_choice": true }, "mistral.voxtral-mini-3b-2507": { @@ -37124,6 +38396,7 @@ "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 4e-08, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_audio_input": true, "supports_system_messages": true, "supports_native_structured_output": true @@ -37136,23 +38409,11 @@ "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 3e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_audio_input": true, "supports_system_messages": true, "supports_native_structured_output": true }, - "mistral/codestral-2405": { - "deprecation_date": "2025-06-16", - "input_cost_per_token": 1e-06, - "litellm_provider": "mistral", - "max_input_tokens": 32000, - "max_output_tokens": 8191, - "max_tokens": 8191, - "mode": "chat", - "output_cost_per_token": 3e-06, - "supports_assistant_prefill": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "mistral/codestral-2508": { "cache_read_input_token_cost": 3e-08, "input_cost_per_token": 3e-07, @@ -37196,51 +38457,6 @@ "supports_assistant_prefill": true, "supports_tool_choice": true }, - "mistral/devstral-medium-2507": { - "deprecation_date": "2026-05-31", - "input_cost_per_token": 4e-07, - "litellm_provider": "mistral", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://mistral.ai/news/devstral", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/devstral-small-2505": { - "deprecation_date": "2025-11-30", - "input_cost_per_token": 1e-07, - "litellm_provider": "mistral", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 3e-07, - "source": "https://mistral.ai/news/devstral", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/devstral-small-2507": { - "deprecation_date": "2026-05-31", - "input_cost_per_token": 1e-07, - "litellm_provider": "mistral", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 3e-07, - "source": "https://mistral.ai/news/devstral", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "mistral/devstral-small-latest": { "cache_read_input_token_cost": 1e-08, "input_cost_per_token": 1e-07, @@ -37256,21 +38472,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "mistral/labs-devstral-small-2512": { - "deprecation_date": "2026-03-31", - "input_cost_per_token": 1e-07, - "litellm_provider": "mistral", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, - "mode": "chat", - "output_cost_per_token": 3e-07, - "source": "https://docs.mistral.ai/models/devstral-small-2-25-12", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "mistral/devstral-latest": { "cache_read_input_token_cost": 4e-08, "input_cost_per_token": 4e-07, @@ -37301,21 +38502,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "mistral/devstral-2512": { - "deprecation_date": "2026-07-31", - "input_cost_per_token": 4e-07, - "litellm_provider": "mistral", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://mistral.ai/news/devstral-2-vibe-cli", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "mistral/ministral-14b-2512": { "input_cost_per_token": 2e-07, "litellm_provider": "mistral", @@ -37443,7 +38629,6 @@ }, "mistral/voxtral-small-2507": { "cache_read_input_token_cost": 1e-08, - "input_cost_per_second": 6.666666666666667e-05, "input_cost_per_token": 1e-07, "litellm_provider": "mistral", "max_input_tokens": 32768, @@ -37459,7 +38644,6 @@ }, "mistral/voxtral-small-latest": { "cache_read_input_token_cost": 1e-08, - "input_cost_per_second": 6.666666666666667e-05, "input_cost_per_token": 1e-07, "litellm_provider": "mistral", "max_input_tokens": 32768, @@ -37475,6 +38659,7 @@ }, "mistral/zai-glm-5-2": { "cache_read_input_token_cost": 1.4e-07, + "deprecation_date": "2026-10-31", "input_cost_per_token": 1.4e-06, "litellm_provider": "mistral", "max_input_tokens": 1048576, @@ -37591,54 +38776,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "mistral/magistral-medium-2506": { - "deprecation_date": "2025-11-30", - "input_cost_per_token": 2e-06, - "litellm_provider": "mistral", - "max_input_tokens": 40000, - "max_output_tokens": 40000, - "max_tokens": 40000, - "mode": "chat", - "output_cost_per_token": 5e-06, - "source": "https://mistral.ai/news/magistral", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/magistral-medium-2509": { - "deprecation_date": "2026-07-31", - "input_cost_per_token": 2e-06, - "litellm_provider": "mistral", - "max_input_tokens": 40000, - "max_output_tokens": 40000, - "max_tokens": 40000, - "mode": "chat", - "output_cost_per_token": 5e-06, - "source": "https://mistral.ai/news/magistral", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/magistral-medium-1-2-2509": { - "deprecation_date": "2026-07-31", - "input_cost_per_token": 2e-06, - "litellm_provider": "mistral", - "max_input_tokens": 40000, - "max_output_tokens": 40000, - "max_tokens": 40000, - "mode": "chat", - "output_cost_per_token": 5e-06, - "source": "https://mistral.ai/news/magistral", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "mistral/mistral-ocr-latest": { "litellm_provider": "mistral", "ocr_cost_per_page": 0.004, @@ -37653,6 +38790,7 @@ "source": "https://mistral.ai/pricing#api-pricing" }, "mistral/mistral-ocr-4-0": { + "deprecation_date": "2026-09-30", "litellm_provider": "mistral", "ocr_cost_per_page": 0.004, "ocr_cost_per_page_batches": 0.002, @@ -37678,20 +38816,6 @@ "/v1/batch" ] }, - "mistral/mistral-ocr-2505-completion": { - "deprecation_date": "2026-05-31", - "litellm_provider": "mistral", - "ocr_cost_per_page": 0.001, - "ocr_cost_per_page_batches": 0.0005, - "annotation_cost_per_page": 0.003, - "annotation_cost_per_page_batches": 0.0015, - "mode": "ocr", - "supported_endpoints": [ - "/v1/ocr", - "/v1/batch" - ], - "source": "https://mistral.ai/pricing#api-pricing" - }, "mistral/mistral-ocr-2512": { "litellm_provider": "mistral", "ocr_cost_per_page": 0.002, @@ -37722,22 +38846,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "mistral/magistral-small-2506": { - "deprecation_date": "2025-11-30", - "input_cost_per_token": 5e-07, - "litellm_provider": "mistral", - "max_input_tokens": 40000, - "max_output_tokens": 40000, - "max_tokens": 40000, - "mode": "chat", - "output_cost_per_token": 1.5e-06, - "source": "https://mistral.ai/pricing#api-pricing", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "mistral/magistral-small-latest": { "cache_read_input_token_cost": 1.5e-08, "input_cost_per_token": 1.5e-07, @@ -37755,22 +38863,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "mistral/magistral-small-1-2-2509": { - "deprecation_date": "2026-07-31", - "input_cost_per_token": 5e-07, - "litellm_provider": "mistral", - "max_input_tokens": 40000, - "max_output_tokens": 40000, - "max_tokens": 40000, - "mode": "chat", - "output_cost_per_token": 1.5e-06, - "source": "https://mistral.ai/pricing#api-pricing", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "mistral/mistral-embed": { "input_cost_per_token": 1e-07, "litellm_provider": "mistral", @@ -37794,48 +38886,6 @@ "max_tokens": 8192, "mode": "embedding" }, - "mistral/mistral-large-2402": { - "deprecation_date": "2025-06-16", - "input_cost_per_token": 4e-06, - "litellm_provider": "mistral", - "max_input_tokens": 32000, - "max_output_tokens": 8191, - "max_tokens": 8191, - "mode": "chat", - "output_cost_per_token": 1.2e-05, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/mistral-large-2407": { - "deprecation_date": "2025-03-30", - "input_cost_per_token": 3e-06, - "litellm_provider": "mistral", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 9e-06, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/mistral-large-2411": { - "deprecation_date": "2026-05-31", - "input_cost_per_token": 2e-06, - "litellm_provider": "mistral", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 6e-06, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "mistral/mistral-large-latest": { "cache_read_input_token_cost": 5e-08, "input_cost_per_token": 5e-07, @@ -37905,49 +38955,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "mistral/mistral-medium-2312": { - "deprecation_date": "2025-06-16", - "input_cost_per_token": 2.7e-06, - "litellm_provider": "mistral", - "max_input_tokens": 32000, - "max_output_tokens": 8191, - "max_tokens": 8191, - "mode": "chat", - "output_cost_per_token": 8.1e-06, - "supports_assistant_prefill": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/mistral-medium-2505": { - "deprecation_date": "2026-08-31", - "input_cost_per_token": 4e-07, - "litellm_provider": "mistral", - "max_input_tokens": 131072, - "max_output_tokens": 8191, - "max_tokens": 8191, - "mode": "chat", - "output_cost_per_token": 2e-06, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/mistral-medium-2508": { - "deprecation_date": "2026-08-31", - "input_cost_per_token": 4e-07, - "litellm_provider": "mistral", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://mistral.ai/news/mistral-medium-3", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, "mistral/mistral-medium-2604": { "cache_read_input_token_cost": 1.5e-07, "input_cost_per_token": 1.5e-06, @@ -37990,22 +38997,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "mistral/mistral-medium-3-1-2508": { - "deprecation_date": "2026-08-31", - "input_cost_per_token": 4e-07, - "litellm_provider": "mistral", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://mistral.ai/news/mistral-medium-3", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, "mistral/mistral-medium-3-5": { "cache_read_input_token_cost": 1.5e-07, "input_cost_per_token": 1.5e-06, @@ -38062,22 +39053,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "mistral/mistral-small-3-2-2506": { - "deprecation_date": "2026-07-31", - "input_cost_per_token": 6e-08, - "litellm_provider": "mistral", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 1.8e-07, - "source": "https://mistral.ai/pricing", - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, "mistral/ministral-3-3b-2512": { "cache_read_input_token_cost": 1e-08, "input_cost_per_token": 1e-07, @@ -38171,32 +39146,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "mistral/open-codestral-mamba": { - "deprecation_date": "2025-06-06", - "input_cost_per_token": 2.5e-07, - "litellm_provider": "mistral", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, - "mode": "chat", - "output_cost_per_token": 2.5e-07, - "source": "https://mistral.ai/technology/", - "supports_assistant_prefill": true, - "supports_tool_choice": true - }, - "mistral/open-mistral-7b": { - "deprecation_date": "2025-03-30", - "input_cost_per_token": 2.5e-07, - "litellm_provider": "mistral", - "max_input_tokens": 32000, - "max_output_tokens": 8191, - "max_tokens": 8191, - "mode": "chat", - "output_cost_per_token": 2.5e-07, - "supports_assistant_prefill": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "mistral/open-mistral-nemo": { "cache_read_input_token_cost": 3e-08, "input_cost_per_token": 3e-07, @@ -38211,78 +39160,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "mistral/open-mistral-nemo-2407": { - "deprecation_date": "2026-07-31", - "input_cost_per_token": 3e-07, - "litellm_provider": "mistral", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 3e-07, - "source": "https://mistral.ai/technology/", - "supports_assistant_prefill": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/open-mixtral-8x22b": { - "deprecation_date": "2025-03-30", - "input_cost_per_token": 2e-06, - "litellm_provider": "mistral", - "max_input_tokens": 65336, - "max_output_tokens": 8191, - "max_tokens": 8191, - "mode": "chat", - "output_cost_per_token": 6e-06, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/open-mixtral-8x7b": { - "deprecation_date": "2025-03-30", - "input_cost_per_token": 7e-07, - "litellm_provider": "mistral", - "max_input_tokens": 32000, - "max_output_tokens": 8191, - "max_tokens": 8191, - "mode": "chat", - "output_cost_per_token": 7e-07, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/pixtral-12b-2409": { - "deprecation_date": "2025-12-31", - "input_cost_per_token": 1.5e-07, - "litellm_provider": "mistral", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 1.5e-07, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "mistral/pixtral-large-2411": { - "deprecation_date": "2026-05-31", - "input_cost_per_token": 2e-06, - "litellm_provider": "mistral", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 6e-06, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, "mistral/pixtral-large-latest": { "cache_read_input_token_cost": 2e-07, "input_cost_per_token": 2e-06, @@ -38301,58 +39178,35 @@ "moonshot.kimi-k2-thinking": { "input_cost_per_token": 6e-07, "litellm_provider": "bedrock_converse", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_input_tokens": 256000, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", "output_cost_per_token": 2.5e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_function_calling": true, "supports_reasoning": true, "supports_system_messages": true, - "supports_native_structured_output": true + "supports_native_structured_output": true, + "supports_response_schema": true, + "supports_vision": false }, "moonshotai.kimi-k2.5": { "input_cost_per_token": 6e-07, "litellm_provider": "bedrock_converse", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, + "max_input_tokens": 256000, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", "output_cost_per_token": 3e-06, "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, - "source": "https://aws.amazon.com/bedrock/pricing/" - }, - "moonshot/kimi-k2-0711-preview": { - "cache_read_input_token_cost": 1.5e-07, - "deprecation_date": "2026-05-25", - "input_cost_per_token": 6e-07, - "litellm_provider": "moonshot", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://platform.moonshot.ai/docs/pricing/chat#generation-model-kimi-k2", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_web_search": true - }, - "moonshot/kimi-k2-0905-preview": { - "cache_read_input_token_cost": 1.5e-07, - "deprecation_date": "2026-05-25", - "input_cost_per_token": 6e-07, - "litellm_provider": "moonshot", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://platform.moonshot.ai/docs/pricing/chat#generation-model-kimi-k2", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_web_search": true + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_response_schema": true }, "moonshot/kimi-k2.7-code": { "cache_read_input_token_cost": 1.9e-07, @@ -38372,21 +39226,6 @@ "supports_video_input": true, "supports_vision": true }, - "moonshot/kimi-k2-turbo-preview": { - "cache_read_input_token_cost": 1.5e-07, - "deprecation_date": "2026-05-25", - "input_cost_per_token": 1.15e-06, - "litellm_provider": "moonshot", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://platform.moonshot.ai/docs/pricing/chat#generation-model-kimi-k2", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_web_search": true - }, "moonshot/kimi-k2.5": { "cache_read_input_token_cost": 1e-07, "input_cost_per_token": 6e-07, @@ -38443,111 +39282,6 @@ "supports_video_input": true, "supports_vision": true }, - "moonshot/kimi-latest": { - "cache_read_input_token_cost": 1.5e-07, - "deprecation_date": "2026-01-28", - "input_cost_per_token": 2e-06, - "litellm_provider": "moonshot", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 5e-06, - "source": "https://platform.moonshot.ai/docs/pricing", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "moonshot/kimi-latest-128k": { - "cache_read_input_token_cost": 1.5e-07, - "deprecation_date": "2026-01-28", - "input_cost_per_token": 2e-06, - "litellm_provider": "moonshot", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 5e-06, - "source": "https://platform.moonshot.ai/docs/pricing", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "moonshot/kimi-latest-32k": { - "cache_read_input_token_cost": 1.5e-07, - "deprecation_date": "2026-01-28", - "input_cost_per_token": 1e-06, - "litellm_provider": "moonshot", - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://platform.moonshot.ai/docs/pricing", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "moonshot/kimi-latest-8k": { - "cache_read_input_token_cost": 1.5e-07, - "deprecation_date": "2026-01-28", - "input_cost_per_token": 2e-07, - "litellm_provider": "moonshot", - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://platform.moonshot.ai/docs/pricing", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "moonshot/kimi-thinking-preview": { - "cache_read_input_token_cost": 1.5e-07, - "deprecation_date": "2025-11-11", - "input_cost_per_token": 6e-07, - "litellm_provider": "moonshot", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://platform.moonshot.ai/docs/pricing/chat#generation-model-kimi-k2", - "supports_vision": true - }, - "moonshot/kimi-k2-thinking": { - "cache_read_input_token_cost": 1.5e-07, - "deprecation_date": "2026-05-25", - "input_cost_per_token": 6e-07, - "litellm_provider": "moonshot", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://platform.moonshot.ai/docs/pricing/chat#generation-model-kimi-k2", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "supports_web_search": true - }, - "moonshot/kimi-k2-thinking-turbo": { - "cache_read_input_token_cost": 1.5e-07, - "deprecation_date": "2026-05-25", - "input_cost_per_token": 1.15e-06, - "litellm_provider": "moonshot", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://platform.moonshot.ai/docs/pricing/chat#generation-model-kimi-k2", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "supports_web_search": true - }, "moonshot/moonshot-v1-128k": { "input_cost_per_token": 2e-06, "litellm_provider": "moonshot", @@ -38561,19 +39295,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "moonshot/moonshot-v1-128k-0430": { - "deprecation_date": "2024-04-30", - "input_cost_per_token": 2e-06, - "litellm_provider": "moonshot", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 5e-06, - "source": "https://platform.moonshot.ai/docs/pricing", - "supports_function_calling": true, - "supports_tool_choice": true - }, "moonshot/moonshot-v1-128k-vision-preview": { "input_cost_per_token": 2e-06, "litellm_provider": "moonshot", @@ -38601,19 +39322,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "moonshot/moonshot-v1-32k-0430": { - "deprecation_date": "2024-04-30", - "input_cost_per_token": 1e-06, - "litellm_provider": "moonshot", - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://platform.moonshot.ai/docs/pricing", - "supports_function_calling": true, - "supports_tool_choice": true - }, "moonshot/moonshot-v1-32k-vision-preview": { "input_cost_per_token": 1e-06, "litellm_provider": "moonshot", @@ -38641,19 +39349,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "moonshot/moonshot-v1-8k-0430": { - "deprecation_date": "2024-04-30", - "input_cost_per_token": 2e-07, - "litellm_provider": "moonshot", - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://platform.moonshot.ai/docs/pricing", - "supports_function_calling": true, - "supports_tool_choice": true - }, "moonshot/moonshot-v1-8k-vision-preview": { "input_cost_per_token": 2e-07, "litellm_provider": "moonshot", @@ -39242,12 +39937,26 @@ "nebius/deepseek-ai/DeepSeek-V4-Pro-0813": { "input_cost_per_token": 1.32e-06, "litellm_provider": "nebius", + "max_input_tokens": 979000, "mode": "chat", "output_cost_per_token": 3.96e-06, "source": "https://tokenfactory.nebius.com/models/catalog/text2text/deepseek-ai%2FDeepSeek-V4-Pro-0813", "supports_function_calling": true, "supports_reasoning": true }, + "nebius/deepseek-ai/DeepSeek-V4.1-Flash": { + "input_cost_per_token": 3e-07, + "litellm_provider": "nebius", + "max_input_tokens": 1048000, + "max_output_tokens": 384000, + "max_tokens": 384000, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "source": "https://tokenfactory.nebius.com/endpoints?modals=endpoint-details&model-id=deepseek-ai/DeepSeek-V4.1-Flash", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_vision": true + }, "nebius/MiniMaxAI/MiniMax-M2.5": { "max_tokens": 196608, "max_input_tokens": 196608, @@ -39490,6 +40199,16 @@ "supports_reasoning": true, "source": "https://tokenfactory.nebius.com/models/catalog/text2text/Qwen%2FQwen3.5-397B-A17B" }, + "nebius/Qwen/Qwen3.8-27B": { + "input_cost_per_token": 4.5e-07, + "litellm_provider": "nebius", + "max_input_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 3e-06, + "source": "https://tokenfactory.nebius.com/models/catalog/text2text/Qwen%2FQwen3.8-27B", + "supports_function_calling": true, + "supports_reasoning": true + }, "nebius/zai-org/GLM-5.1": { "max_tokens": 202752, "max_input_tokens": 202752, @@ -39517,8 +40236,8 @@ "nebius/zai-org/GLM-5.3": { "input_cost_per_token": 1.4e-06, "litellm_provider": "nebius", - "max_input_tokens": 1048576, - "max_tokens": 1048576, + "max_input_tokens": 1024000, + "max_tokens": 1024000, "mode": "chat", "output_cost_per_token": 4.4e-06, "source": "https://tokenfactory.nebius.com/models/catalog/text2text/zai-org%2FGLM-5.3", @@ -39535,7 +40254,8 @@ "mode": "chat", "supports_function_calling": true, "supports_reasoning": true, - "source": "https://tokenfactory.nebius.com/models/catalog/text2text/zai-org%2FGLM-5.3-Flash" + "source": "https://tokenfactory.nebius.com/models/catalog/text2text/zai-org%2FGLM-5.3-Flash", + "supports_vision": true }, "nebius/BAAI/bge-en-icl": { "max_tokens": 32768, @@ -39577,10 +40297,14 @@ "input_cost_per_token": 2e-07, "litellm_provider": "bedrock_converse", "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "output_cost_per_token": 6e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_response_schema": true, "supports_system_messages": true, "supports_vision": true }, @@ -39588,39 +40312,50 @@ "input_cost_per_token": 6e-08, "litellm_provider": "bedrock_converse", "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "output_cost_per_token": 2.3e-07, - "supports_system_messages": true + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_vision": false }, "nvidia.nemotron-nano-3-30b": { "input_cost_per_token": 6e-08, "litellm_provider": "bedrock_converse", - "max_input_tokens": 262144, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_input_tokens": 256000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "output_cost_per_token": 2.4e-07, "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, "source": "https://aws.amazon.com/bedrock/pricing/", - "supports_native_structured_output": true + "supports_audio_input": false, + "supports_native_structured_output": true, + "supports_response_schema": true, + "supports_vision": false }, "nvidia.nemotron-super-3-120b": { "input_cost_per_token": 1.5e-07, "litellm_provider": "bedrock_converse", "max_input_tokens": 256000, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_output_tokens": 32000, + "max_tokens": 32000, "mode": "chat", "output_cost_per_token": 6.5e-07, "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, "supports_function_calling": true, "supports_reasoning": true, + "supports_response_schema": true, "supports_system_messages": true, - "supports_tool_choice": true + "supports_tool_choice": true, + "supports_vision": false }, "o1": { "cache_read_input_token_cost": 7.5e-06, @@ -39782,72 +40517,17 @@ "supports_vision": true, "supports_web_search": true }, - "o3-2025-04-16": { - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_flex": 2.5e-07, - "cache_read_input_token_cost_priority": 8.75e-07, - "deprecation_date": "2026-12-11", - "input_cost_per_token": 2e-06, - "input_cost_per_token_batches": 1e-06, - "input_cost_per_token_flex": 1e-06, - "input_cost_per_token_priority": 3.5e-06, - "litellm_provider": "openai", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, - "mode": "chat", - "output_cost_per_token": 8e-06, - "output_cost_per_token_batches": 4e-06, - "output_cost_per_token_flex": 4e-06, - "output_cost_per_token_priority": 1.4e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/responses", - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_parallel_function_calling": false, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true - }, "o3-deep-research": { "cache_read_input_token_cost": 2.5e-06, - "deprecation_date": "2026-07-23", "input_cost_per_token": 1e-05, - "input_cost_per_token_batches": 5e-06, "litellm_provider": "openai", "max_input_tokens": 200000, "max_output_tokens": 100000, "max_tokens": 100000, "mode": "responses", "output_cost_per_token": 4e-05, - "output_cost_per_token_batches": 2e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, + "source": "https://developers.openai.com/api/docs/models/o3-deep-research", "supported_endpoints": [ - "/v1/chat/completions", "/v1/batch", "/v1/responses" ], @@ -39858,39 +40538,46 @@ "supported_output_modalities": [ "text" ], - "supports_function_calling": true, + "supports_function_calling": false, "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, + "supports_parallel_function_calling": false, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, + "supports_response_schema": false, + "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": true + "supports_pdf_input": true, + "deprecation_date": "2026-07-23" }, - "o3-deep-research-2025-06-26": { - "cache_read_input_token_cost": 2.5e-06, - "deprecation_date": "2026-07-23", - "input_cost_per_token": 1e-05, - "input_cost_per_token_batches": 5e-06, + "o3-2025-04-16": { + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_flex": 2.5e-07, + "cache_read_input_token_cost_priority": 8.75e-07, + "deprecation_date": "2026-12-11", + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, + "input_cost_per_token_flex": 1e-06, + "input_cost_per_token_priority": 3.5e-06, "litellm_provider": "openai", "max_input_tokens": 200000, "max_output_tokens": 100000, "max_tokens": 100000, - "mode": "responses", - "output_cost_per_token": 4e-05, - "output_cost_per_token_batches": 2e-05, + "mode": "chat", + "output_cost_per_token": 8e-06, + "output_cost_per_token_batches": 4e-06, + "output_cost_per_token_flex": 4e-06, + "output_cost_per_token_priority": 1.4e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, + "source": "https://developers.openai.com/api/docs/pricing", "supported_endpoints": [ + "/v1/responses", "/v1/chat/completions", - "/v1/batch", - "/v1/responses" + "/v1/completions", + "/v1/batch" ], "supported_modalities": [ "text", @@ -39900,13 +40587,11 @@ "text" ], "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, + "supports_parallel_function_calling": false, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true @@ -40062,59 +40747,17 @@ "supports_vision": true, "supports_web_search": true }, - "o4-mini-2025-04-16": { - "cache_read_input_token_cost": 2.75e-07, - "cache_read_input_token_cost_flex": 1.38e-07, - "cache_read_input_token_cost_priority": 5e-07, - "deprecation_date": "2026-10-23", - "input_cost_per_token": 1.1e-06, - "input_cost_per_token_batches": 5.5e-07, - "input_cost_per_token_flex": 5.5e-07, - "input_cost_per_token_priority": 2e-06, - "litellm_provider": "openai", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, - "mode": "chat", - "output_cost_per_token": 4.4e-06, - "output_cost_per_token_batches": 2.2e-06, - "output_cost_per_token_flex": 2.2e-06, - "output_cost_per_token_priority": 8e-06, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "source": "https://developers.openai.com/api/docs/pricing", - "supports_function_calling": true, - "supports_parallel_function_calling": false, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true - }, "o4-mini-deep-research": { "cache_read_input_token_cost": 5e-07, - "deprecation_date": "2026-07-23", "input_cost_per_token": 2e-06, - "input_cost_per_token_batches": 1e-06, "litellm_provider": "openai", "max_input_tokens": 200000, "max_output_tokens": 100000, "max_tokens": 100000, "mode": "responses", "output_cost_per_token": 8e-06, - "output_cost_per_token_batches": 4e-06, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, + "source": "https://developers.openai.com/api/docs/models/o4-mini-deep-research", "supported_endpoints": [ - "/v1/chat/completions", "/v1/batch", "/v1/responses" ], @@ -40125,55 +40768,47 @@ "supported_output_modalities": [ "text" ], - "supports_function_calling": true, + "supports_function_calling": false, "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, + "supports_parallel_function_calling": false, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, + "supports_response_schema": false, + "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": true + "supports_pdf_input": true, + "deprecation_date": "2026-07-23" }, - "o4-mini-deep-research-2025-06-26": { - "cache_read_input_token_cost": 5e-07, - "deprecation_date": "2026-07-23", - "input_cost_per_token": 2e-06, - "input_cost_per_token_batches": 1e-06, + "o4-mini-2025-04-16": { + "cache_read_input_token_cost": 2.75e-07, + "cache_read_input_token_cost_flex": 1.38e-07, + "cache_read_input_token_cost_priority": 5e-07, + "deprecation_date": "2026-10-23", + "input_cost_per_token": 1.1e-06, + "input_cost_per_token_batches": 5.5e-07, + "input_cost_per_token_flex": 5.5e-07, + "input_cost_per_token_priority": 2e-06, "litellm_provider": "openai", "max_input_tokens": 200000, "max_output_tokens": 100000, "max_tokens": 100000, - "mode": "responses", - "output_cost_per_token": 8e-06, - "output_cost_per_token_batches": 4e-06, + "mode": "chat", + "output_cost_per_token": 4.4e-06, + "output_cost_per_token_batches": 2.2e-06, + "output_cost_per_token_flex": 2.2e-06, + "output_cost_per_token_priority": 8e-06, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, "search_context_size_medium": 0.01 }, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/batch", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "source": "https://developers.openai.com/api/docs/pricing", "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, + "supports_parallel_function_calling": false, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true @@ -41049,6 +41684,7 @@ "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 6e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, @@ -41062,6 +41698,7 @@ "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 3e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, @@ -41071,21 +41708,31 @@ "input_cost_per_token": 1.5e-07, "litellm_provider": "bedrock_converse", "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", "output_cost_per_token": 6e-07, - "supports_system_messages": true + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_vision": false }, "openai.gpt-oss-safeguard-20b": { "input_cost_per_token": 7e-08, "litellm_provider": "bedrock_converse", "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", "output_cost_per_token": 2e-07, - "supports_system_messages": true + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_vision": false }, "openrouter/anthropic/claude-3-haiku": { "cache_creation_input_token_cost": 3e-07, @@ -41140,32 +41787,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "openrouter/anthropic/claude-opus-4": { - "input_cost_per_image": 0.0048, - "cache_creation_input_token_cost": 1.875e-05, - "cache_creation_input_token_cost_above_1hr": 3e-05, - "cache_read_input_token_cost": 1.5e-06, - "input_cost_per_token": 1.5e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 32000, - "max_tokens": 32000, - "mode": "chat", - "output_cost_per_token": 7.5e-05, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "supports_vision": true, - "prompt_cache_min_tokens": 1024, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_pdf_input": true, - "supports_response_schema": false, - "supports_web_search": true - }, "openrouter/anthropic/claude-opus-4.1": { "input_cost_per_image": 0.0048, "cache_creation_input_token_cost": 1.875e-05, @@ -41203,7 +41824,7 @@ "input_cost_per_token_above_200k_tokens": 6e-06, "output_cost_per_token_above_200k_tokens": 2.25e-05, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, + "max_input_tokens": 200000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", @@ -41419,6 +42040,28 @@ "supports_web_search": true, "supports_xhigh_reasoning_effort": true }, + "openrouter/anthropic/claude-opus-5.5": { + "cache_creation_input_token_cost": 5e-06, + "cache_creation_input_token_cost_above_1hr": 8e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 4e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, "openrouter/bytedance/ui-tars-1.5-7b": { "cache_read_input_token_cost": 1e-07, "input_cost_per_token": 1e-07, @@ -41440,13 +42083,13 @@ "supports_web_search": false }, "openrouter/deepseek/deepseek-chat": { - "input_cost_per_token": 3.2e-07, + "input_cost_per_token": 2.574e-07, "litellm_provider": "openrouter", "max_input_tokens": 163840, "max_output_tokens": 16384, "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 8.9e-07, + "output_cost_per_token": 1.0287e-06, "supports_prompt_caching": false, "supports_tool_choice": true, "source": "https://openrouter.ai/api/v1/models", @@ -41459,13 +42102,14 @@ "supports_web_search": false }, "openrouter/deepseek/deepseek-chat-v3-0324": { - "input_cost_per_token": 2.5e-07, + "cache_read_input_token_cost": 1.1e-07, + "input_cost_per_token": 2.9e-07, "litellm_provider": "openrouter", "max_input_tokens": 163840, "max_output_tokens": 147456, "max_tokens": 147456, "mode": "chat", - "output_cost_per_token": 1e-06, + "output_cost_per_token": 1.14e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -41500,16 +42144,16 @@ "supports_web_search": false }, "openrouter/deepseek/deepseek-v3.2": { - "cache_read_input_token_cost": 1.345e-07, + "cache_read_input_token_cost": 2.8e-08, "deprecation_date": "2026-09-28", - "input_cost_per_token": 2.69e-07, - "input_cost_per_token_cache_hit": 1.345e-07, + "input_cost_per_token": 2.8e-07, + "input_cost_per_token_cache_hit": 2.8e-08, "litellm_provider": "openrouter", "max_input_tokens": 163840, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 4e-07, + "output_cost_per_token": 4.2e-07, "supports_assistant_prefill": true, "supports_function_calling": true, "supports_prompt_caching": true, @@ -41529,8 +42173,8 @@ "input_cost_per_token_cache_hit": 2e-08, "litellm_provider": "openrouter", "max_input_tokens": 163840, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 147456, + "max_tokens": 147456, "mode": "chat", "output_cost_per_token": 4.1e-07, "source": "https://openrouter.ai/api/v1/models", @@ -41590,85 +42234,86 @@ "supports_web_search": false }, "openrouter/deepseek/deepseek-v4-pro": { - "input_cost_per_token": 9.42906e-07, - "input_cost_per_token_cache_hit": 4.4e-08, + "cache_read_input_token_cost": 1.74e-08, + "input_cost_per_token": 2.088e-07, "litellm_provider": "openrouter", "max_input_tokens": 1048576, "max_output_tokens": 384000, "max_tokens": 384000, "mode": "chat", - "output_cost_per_token": 1.885812e-06, + "output_cost_per_token": 4.176e-07, "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "cache_read_input_token_cost": 7.85755e-08, - "supports_audio_input": false, - "supports_pdf_input": false, "supports_vision": false, "supports_web_search": false }, "openrouter/deepseek/deepseek-v4.1-flash": { - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, - "cache_read_input_token_cost": 6e-09, + "cache_read_input_token_cost": 1e-08, + "input_cost_per_token": 3e-08, "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "max_output_tokens": 384000, - "max_tokens": 384000, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "off_peak_pricing": {"windows":[{"weekdays":["saturday","sunday"],"hours_utc":"00:00-00:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"00:00-01:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"04:00-06:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"10:00-00:00"}],"input_cost_per_token":1.5e-7,"output_cost_per_token":6e-7,"cache_read_input_token_cost":3e-9}, + "output_cost_per_token": 5e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_tool_choice": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_pdf_input": false, - "supports_prompt_caching": true, "supports_web_search": false }, "openrouter/deepseek/deepseek-v4-pro-0813": { - "input_cost_per_token": 5.7684e-07, - "input_cost_per_token_cache_hit": 1.9272e-08, + "cache_read_input_token_cost": 4.4e-08, + "input_cost_per_token": 1.32e-06, "litellm_provider": "openrouter", "max_input_tokens": 1048576, "max_output_tokens": 393216, "max_tokens": 393216, "mode": "chat", - "output_cost_per_token": 1.73052e-06, + "off_peak_pricing": {"input_cost_per_token":6.6e-7,"output_cost_per_token":0.00000198,"cache_read_input_token_cost":2.2e-8,"windows":[{"hours_utc":"00:00-00:00","weekdays":["saturday","sunday"]},{"hours_utc":"00:00-01:00","weekdays":["monday","tuesday","wednesday","thursday","friday"]},{"hours_utc":"04:00-06:00","weekdays":["monday","tuesday","wednesday","thursday","friday"]},{"hours_utc":"10:00-00:00","weekdays":["monday","tuesday","wednesday","thursday","friday"]}]}, + "output_cost_per_token": 3.96e-06, "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "cache_read_input_token_cost": 1.8354e-08, - "off_peak_pricing": {"windows":[{"weekdays":["saturday","sunday"],"hours_utc":"00:00-00:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"00:00-01:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"04:00-06:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"10:00-00:00"}],"input_cost_per_token":5.7684e-7,"output_cost_per_token":0.00000173052,"cache_read_input_token_cost":1.8354e-8}, - "supports_audio_input": false, - "supports_pdf_input": false, "supports_vision": false, "supports_web_search": false }, - "openrouter/google/gemini-2.0-flash-001": { - "deprecation_date": "2026-06-01", - "input_cost_per_audio_token": 7e-07, - "input_cost_per_token": 1e-07, + "openrouter/fireworks/ember-1": { + "input_cost_per_token": 3e-06, + "output_cost_per_token": 1.5e-05, + "cache_read_input_token_cost": 3e-07, "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 4e-07, - "supports_audio_output": true, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_reasoning": true, + "supports_response_schema": true, + "supports_parallel_function_calling": false, + "supports_pdf_input": false, + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": false }, "openrouter/google/gemini-2.5-flash": { "cache_creation_input_token_cost": 8.33333333333333e-08, @@ -41991,13 +42636,13 @@ "max_output_tokens": 8000 }, "openrouter/minimax/minimax-m2": { - "input_cost_per_token": 2.55e-07, + "input_cost_per_token": 3e-07, "litellm_provider": "openrouter", "max_input_tokens": 204800, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_output_tokens": 176947, + "max_tokens": 176947, "mode": "chat", - "output_cost_per_token": 1.02e-06, + "output_cost_per_token": 1.2e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -42093,27 +42738,6 @@ "supports_vision": true, "supports_web_search": false }, - "openrouter/mistralai/mistral-large-2512": { - "cache_read_input_token_cost": 5.5e-08, - "input_cost_per_image": 0, - "input_cost_per_token": 5.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 209715, - "max_tokens": 209715, - "mode": "chat", - "output_cost_per_token": 1.65e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false - }, "openrouter/mistralai/mistral-7b-instruct": { "input_cost_per_token": 1.3e-07, "litellm_provider": "openrouter", @@ -42224,14 +42848,14 @@ "supports_web_search": false }, "openrouter/nvidia/nemotron-3.5-lightning": { - "cache_read_input_token_cost": 4e-08, - "input_cost_per_token": 7e-08, + "cache_read_input_token_cost": 2.975e-08, + "input_cost_per_token": 5.95e-08, "litellm_provider": "openrouter", "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 2e-07, + "output_cost_per_token": 1.7e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -42684,14 +43308,14 @@ "supports_web_search": true }, "openrouter/openai/gpt-5.6-sol-pro": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 1e-05, - "cache_read_input_token_cost": 2e-07, - "cache_creation_input_token_cost": 2.5e-06, - "cache_creation_input_token_cost_above_272k_tokens": 5e-06, - "input_cost_per_token_above_272k_tokens": 4e-06, - "output_cost_per_token_above_272k_tokens": 1.5e-05, - "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "input_cost_per_token": 4e-06, + "output_cost_per_token": 2e-05, + "cache_read_input_token_cost": 4e-07, + "cache_creation_input_token_cost": 5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 1e-05, + "input_cost_per_token_above_272k_tokens": 8e-06, + "output_cost_per_token_above_272k_tokens": 3e-05, + "cache_read_input_token_cost_above_272k_tokens": 8e-07, "litellm_provider": "openrouter", "max_input_tokens": 1050000, "max_output_tokens": 128000, @@ -42709,14 +43333,13 @@ "supports_web_search": true }, "openrouter/openai/gpt-oss-120b": { - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_token": 1.5e-07, + "input_cost_per_token": 3.7e-08, "litellm_provider": "openrouter", "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 117964, + "max_tokens": 117964, "mode": "chat", - "output_cost_per_token": 6e-07, + "output_cost_per_token": 1.7e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -42729,21 +43352,40 @@ "supports_vision": false, "supports_web_search": false }, - "openrouter/openai/gpt-oss-20b": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token": 3e-08, + "openrouter/openai/gpt-oss-120b:batch": { + "input_cost_per_token": 2.96e-08, "litellm_provider": "openrouter", "max_input_tokens": 131072, "max_output_tokens": 117964, "max_tokens": 117964, "mode": "chat", - "output_cost_per_token": 1.3e-07, + "output_cost_per_token": 1.36e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/openai/gpt-oss-20b": { + "cache_read_input_token_cost": 9e-09, + "input_cost_per_token": 1.8e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 9e-08, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_parallel_function_calling": true, "supports_pdf_input": false, - "supports_prompt_caching": true, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, @@ -42866,9 +43508,15 @@ }, "openrouter/qwen/qwen3-coder-plus": { "cache_creation_input_token_cost": 8.125e-07, + "cache_creation_input_token_cost_above_128k_tokens": 2.4375e-06, + "cache_creation_input_token_cost_above_32k_tokens": 1.4625e-06, "cache_read_input_token_cost": 1.3e-07, + "cache_read_input_token_cost_above_128k_tokens": 3.9e-07, + "cache_read_input_token_cost_above_32k_tokens": 2.34e-07, + "deprecation_date": "2026-10-09", "input_cost_per_token": 6.5e-07, "input_cost_per_token_above_128k_tokens": 1.95e-06, + "input_cost_per_token_above_32k_tokens": 1.17e-06, "litellm_provider": "openrouter", "max_input_tokens": 1000000, "max_output_tokens": 65536, @@ -42876,6 +43524,7 @@ "mode": "chat", "output_cost_per_token": 3.25e-06, "output_cost_per_token_above_128k_tokens": 9.75e-06, + "output_cost_per_token_above_32k_tokens": 5.85e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -42908,6 +43557,7 @@ "supports_web_search": false }, "openrouter/qwen/qwen3-235b-a22b-thinking-2507": { + "deprecation_date": "2026-10-09", "input_cost_per_token": 2.3e-07, "litellm_provider": "openrouter", "max_input_tokens": 131072, @@ -42928,6 +43578,9 @@ }, "openrouter/qwen/qwen3.6-plus": { "cache_creation_input_token_cost": 4.0625e-07, + "input_cost_per_token_above_256k_tokens": 1.3e-06, + "cache_creation_input_token_cost_above_256k_tokens": 1.625e-06, + "output_cost_per_token_above_256k_tokens": 3.9e-06, "input_cost_per_token": 3.25e-07, "litellm_provider": "openrouter", "max_input_tokens": 1000000, @@ -42947,13 +43600,13 @@ "supports_web_search": false }, "openrouter/qwen/qwen3.5-35b-a3b": { - "input_cost_per_token": 3.125e-07, + "input_cost_per_token": 1.625e-07, "litellm_provider": "openrouter", "max_input_tokens": 262144, "max_output_tokens": 16384, "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1.25e-06, + "output_cost_per_token": 1.3e-06, "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_reasoning": true, @@ -42989,8 +43642,8 @@ "input_cost_per_token": 2.6e-07, "litellm_provider": "openrouter", "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", "output_cost_per_token": 2.08e-06, "source": "https://openrouter.ai/api/v1/models", @@ -43025,14 +43678,14 @@ }, "openrouter/qwen/qwen3.5-plus-02-15": { "input_cost_per_token": 2.6e-07, - "input_cost_per_token_above_256k_tokens": 5e-07, + "input_cost_per_token_above_256k_tokens": 3.25e-07, "litellm_provider": "openrouter", "max_input_tokens": 1000000, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", "output_cost_per_token": 1.56e-06, - "output_cost_per_token_above_256k_tokens": 3e-06, + "output_cost_per_token_above_256k_tokens": 1.95e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -43202,25 +43855,26 @@ "supports_web_search": false }, "openrouter/z-ai/glm-4.7": { - "input_cost_per_token": 4e-07, - "output_cost_per_token": 1.75e-06, "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 8e-08, + "cache_read_input_token_cost": 1.1e-07, + "deprecation_date": "2026-12-31", + "input_cost_per_token": 6e-07, "litellm_provider": "openrouter", "max_input_tokens": 204800, "max_output_tokens": 131072, "max_tokens": 131072, "mode": "chat", + "output_cost_per_token": 2.2e-06, "source": "https://openrouter.ai/api/v1/models", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_vision": false, - "supports_prompt_caching": true, "supports_assistant_prefill": true, "supports_audio_input": false, + "supports_function_calling": true, "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, "supports_web_search": false }, "openrouter/z-ai/glm-4.7-flash": { @@ -43265,15 +43919,15 @@ "supports_web_search": false }, "openrouter/z-ai/glm-5.1": { - "input_cost_per_token": 9.66e-07, - "output_cost_per_token": 3.036e-06, - "cache_read_input_token_cost": 1.794e-07, "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 1.7914e-07, + "input_cost_per_token": 9.646e-07, "litellm_provider": "openrouter", "max_input_tokens": 204800, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", + "output_cost_per_token": 3.0316e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -43365,26 +44019,6 @@ "max_tokens": 128000, "mode": "chat" }, - "openrouter/stealth/union-alpha": { - "deprecation_date": "2098-12-31", - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false - }, "ovhcloud/DeepSeek-R1-Distill-Llama-70B": { "input_cost_per_token": 6.7e-07, "litellm_provider": "ovhcloud", @@ -44291,14 +44925,18 @@ "qwen.qwen3-next-80b-a3b": { "input_cost_per_token": 1.5e-07, "litellm_provider": "bedrock_converse", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_input_tokens": 256000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "output_cost_per_token": 1.2e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, "supports_function_calling": true, "supports_system_messages": true, - "supports_native_structured_output": true + "supports_native_structured_output": true, + "supports_response_schema": true, + "supports_vision": false }, "bedrock/ap-northeast-1/qwen.qwen3-next-80b-a3b": { "input_cost_per_token": 1.8e-07, @@ -44311,7 +44949,10 @@ "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_native_structured_output": true, - "supports_system_messages": true + "supports_system_messages": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "bedrock/ap-south-1/qwen.qwen3-next-80b-a3b": { "input_cost_per_token": 1.8e-07, @@ -44324,7 +44965,10 @@ "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_native_structured_output": true, - "supports_system_messages": true + "supports_system_messages": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "bedrock/ap-southeast-2/qwen.qwen3-next-80b-a3b": { "input_cost_per_token": 1.545e-07, @@ -44337,7 +44981,10 @@ "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_native_structured_output": true, - "supports_system_messages": true + "supports_system_messages": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "bedrock/eu-west-1/qwen.qwen3-next-80b-a3b": { "input_cost_per_token": 1.8e-07, @@ -44350,7 +44997,10 @@ "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_native_structured_output": true, - "supports_system_messages": true + "supports_system_messages": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "bedrock/eu-west-2/qwen.qwen3-next-80b-a3b": { "input_cost_per_token": 2.3e-07, @@ -44363,7 +45013,10 @@ "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_native_structured_output": true, - "supports_system_messages": true + "supports_system_messages": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "bedrock/sa-east-1/qwen.qwen3-next-80b-a3b": { "input_cost_per_token": 1.8e-07, @@ -44376,33 +45029,42 @@ "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_native_structured_output": true, - "supports_system_messages": true + "supports_system_messages": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "qwen.qwen3-vl-235b-a22b": { "input_cost_per_token": 5.3e-07, "litellm_provider": "bedrock_converse", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_input_tokens": 256000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", "output_cost_per_token": 2.66e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, "supports_function_calling": true, "supports_system_messages": true, "supports_vision": true, - "supports_native_structured_output": true + "supports_native_structured_output": true, + "supports_response_schema": false }, "qwen.qwen3-coder-next": { "input_cost_per_token": 5e-07, "litellm_provider": "bedrock_converse", - "max_input_tokens": 262144, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_input_tokens": 256000, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", "output_cost_per_token": 1.2e-06, "supports_function_calling": true, "supports_system_messages": true, "supports_tool_choice": true, - "source": "https://aws.amazon.com/bedrock/pricing/" + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "reducto/parse-legacy": { "litellm_provider": "reducto", @@ -44874,17 +45536,6 @@ "supports_reasoning": true, "supports_system_messages": true }, - "rerank-english-v2.0": { - "input_cost_per_query": 0.002, - "input_cost_per_token": 0.0, - "litellm_provider": "cohere", - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "rerank", - "output_cost_per_token": 0.0, - "deprecation_date": "2025-04-30" - }, "rerank-english-v3.0": { "input_cost_per_query": 0.002, "input_cost_per_token": 0.0, @@ -44895,17 +45546,6 @@ "mode": "rerank", "output_cost_per_token": 0.0 }, - "rerank-multilingual-v2.0": { - "input_cost_per_query": 0.002, - "input_cost_per_token": 0.0, - "litellm_provider": "cohere", - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "rerank", - "output_cost_per_token": 0.0, - "deprecation_date": "2025-04-30" - }, "rerank-multilingual-v3.0": { "input_cost_per_query": 0.002, "input_cost_per_token": 0.0, @@ -45046,31 +45686,6 @@ "output_cost_per_token": 7e-06, "source": "https://cloud.sambanova.ai/plans/pricing" }, - "sambanova/DeepSeek-R1-Distill-Llama-70B": { - "deprecation_date": "2026-03-20", - "input_cost_per_token": 7e-07, - "litellm_provider": "sambanova", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 1.4e-06, - "source": "https://cloud.sambanova.ai/plans/pricing" - }, - "sambanova/DeepSeek-V3-0324": { - "deprecation_date": "2026-04-14", - "input_cost_per_token": 3e-06, - "litellm_provider": "sambanova", - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 4.5e-06, - "source": "https://cloud.sambanova.ai/plans/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_tool_choice": true - }, "sambanova/Llama-4-Maverick-17B-128E-Instruct": { "input_cost_per_token": 6.3e-07, "litellm_provider": "sambanova", @@ -45088,73 +45703,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "sambanova/Llama-4-Scout-17B-16E-Instruct": { - "deprecation_date": "2025-06-19", - "input_cost_per_token": 4e-07, - "litellm_provider": "sambanova", - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "metadata": { - "notes": "For vision models, images are converted to 6432 input tokens and are billed at that amount" - }, - "mode": "chat", - "output_cost_per_token": 7e-07, - "source": "https://cloud.sambanova.ai/plans/pricing", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "sambanova/Meta-Llama-3.1-405B-Instruct": { - "deprecation_date": "2025-06-25", - "input_cost_per_token": 5e-06, - "litellm_provider": "sambanova", - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1e-05, - "source": "https://cloud.sambanova.ai/plans/pricing", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "sambanova/Meta-Llama-3.1-8B-Instruct": { - "deprecation_date": "2026-04-14", - "input_cost_per_token": 1e-07, - "litellm_provider": "sambanova", - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 2e-07, - "source": "https://cloud.sambanova.ai/plans/pricing", - "supports_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "sambanova/Meta-Llama-3.2-1B-Instruct": { - "deprecation_date": "2025-06-25", - "input_cost_per_token": 4e-08, - "litellm_provider": "sambanova", - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 8e-08, - "source": "https://cloud.sambanova.ai/plans/pricing" - }, - "sambanova/Meta-Llama-3.2-3B-Instruct": { - "deprecation_date": "2025-06-25", - "input_cost_per_token": 8e-08, - "litellm_provider": "sambanova", - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.6e-07, - "source": "https://cloud.sambanova.ai/plans/pricing" - }, "sambanova/Meta-Llama-3.3-70B-Instruct": { "input_cost_per_token": 6e-07, "litellm_provider": "sambanova", @@ -45168,54 +45716,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "sambanova/Meta-Llama-Guard-3-8B": { - "deprecation_date": "2025-06-25", - "input_cost_per_token": 3e-07, - "litellm_provider": "sambanova", - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 3e-07, - "source": "https://cloud.sambanova.ai/plans/pricing" - }, - "sambanova/QwQ-32B": { - "deprecation_date": "2025-06-25", - "input_cost_per_token": 5e-07, - "litellm_provider": "sambanova", - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1e-06, - "source": "https://cloud.sambanova.ai/plans/pricing" - }, - "sambanova/Qwen2-Audio-7B-Instruct": { - "deprecation_date": "2025-06-19", - "input_cost_per_token": 5e-07, - "litellm_provider": "sambanova", - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 0.0001, - "source": "https://cloud.sambanova.ai/plans/pricing", - "supports_audio_input": true - }, - "sambanova/Qwen3-32B": { - "deprecation_date": "2026-04-06", - "input_cost_per_token": 4e-07, - "litellm_provider": "sambanova", - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 8e-07, - "source": "https://cloud.sambanova.ai/plans/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_tool_choice": true - }, "sambanova/DeepSeek-V3.1": { "max_tokens": 131072, "max_input_tokens": 131072, @@ -45808,27 +46308,6 @@ "mode": "image_generation", "output_cost_per_image": 0.14 }, - "standard/1024-x-1024/dall-e-3": { - "deprecation_date": "2026-05-12", - "input_cost_per_pixel": 3.81469e-08, - "litellm_provider": "openai", - "mode": "image_generation", - "output_cost_per_pixel": 0.0 - }, - "standard/1024-x-1792/dall-e-3": { - "deprecation_date": "2026-05-12", - "input_cost_per_pixel": 4.359e-08, - "litellm_provider": "openai", - "mode": "image_generation", - "output_cost_per_pixel": 0.0 - }, - "standard/1792-x-1024/dall-e-3": { - "deprecation_date": "2026-05-12", - "input_cost_per_pixel": 4.359e-08, - "litellm_provider": "openai", - "mode": "image_generation", - "output_cost_per_pixel": 0.0 - }, "linkup/search": { "input_cost_per_query": 0.00587, "litellm_provider": "linkup", @@ -45963,36 +46442,6 @@ "output_vector_size": 768, "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" }, - "text-moderation-007": { - "deprecation_date": "2025-10-27", - "input_cost_per_token": 0.0, - "litellm_provider": "openai", - "max_input_tokens": 32768, - "max_output_tokens": 0, - "max_tokens": 0, - "mode": "moderation", - "output_cost_per_token": 0.0 - }, - "text-moderation-latest": { - "deprecation_date": "2025-10-27", - "input_cost_per_token": 0.0, - "litellm_provider": "openai", - "max_input_tokens": 32768, - "max_output_tokens": 0, - "max_tokens": 0, - "mode": "moderation", - "output_cost_per_token": 0.0 - }, - "text-moderation-stable": { - "deprecation_date": "2025-10-27", - "input_cost_per_token": 0.0, - "litellm_provider": "openai", - "max_input_tokens": 32768, - "max_output_tokens": 0, - "max_tokens": 0, - "mode": "moderation", - "output_cost_per_token": 0.0 - }, "text-multilingual-embedding-002": { "deprecation_date": "2027-04-01", "input_cost_per_character": 2.5e-08, @@ -46090,19 +46539,6 @@ "mode": "chat", "output_cost_per_token": 1e-07 }, - "together_ai/Qwen/Qwen2.5-72B-Instruct-Turbo": { - "deprecation_date": "2026-02-06", - "litellm_provider": "together_ai", - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "input_cost_per_token": 1.2e-06, - "output_cost_per_token": 1.2e-06, - "max_input_tokens": 131072, - "source": "https://api.together.ai/v1/models" - }, "together_ai/Qwen/Qwen2.5-7B-Instruct-Turbo": { "litellm_provider": "together_ai", "mode": "chat", @@ -46115,87 +46551,6 @@ "max_input_tokens": 32768, "source": "https://api.together.ai/v1/models" }, - "together_ai/Qwen/Qwen3-235B-A22B-Instruct-2507-tput": { - "deprecation_date": "2026-07-10", - "input_cost_per_token": 2e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 262000, - "mode": "chat", - "output_cost_per_token": 6e-06, - "source": "https://www.together.ai/models/qwen3-235b-a22b-instruct-2507-fp8", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/Qwen/Qwen3-235B-A22B-Thinking-2507": { - "deprecation_date": "2026-04-16", - "input_cost_per_token": 6.5e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 256000, - "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://www.together.ai/models/qwen3-235b-a22b-thinking-2507", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/Qwen/Qwen3-235B-A22B-fp8-tput": { - "deprecation_date": "2026-02-06", - "input_cost_per_token": 2e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 40000, - "mode": "chat", - "output_cost_per_token": 6e-07, - "source": "https://www.together.ai/models/qwen3-235b-a22b-fp8-tput", - "supports_function_calling": false, - "supports_parallel_function_calling": false, - "supports_tool_choice": false - }, - "together_ai/Qwen/Qwen3-Coder-480B-A35B-Instruct-FP8": { - "deprecation_date": "2026-06-04", - "input_cost_per_token": 2e-06, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/deepseek-ai/DeepSeek-R1": { - "deprecation_date": "2026-05-14", - "input_cost_per_token": 3e-06, - "litellm_provider": "together_ai", - "max_input_tokens": 128000, - "max_output_tokens": 20480, - "max_tokens": 20480, - "metadata": { - "successor": "together_ai/deepseek-ai/DeepSeek-V4-Pro-0813" - }, - "mode": "chat", - "output_cost_per_token": 7e-06, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/deepseek-ai/DeepSeek-R1-0528-tput": { - "deprecation_date": "2026-02-03", - "input_cost_per_token": 5.5e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 2.19e-06, - "source": "https://www.together.ai/models/deepseek-r1-0528-throughput", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "together_ai/deepseek-ai/DeepSeek-V3": { "input_cost_per_token": 1.25e-06, "litellm_provider": "together_ai", @@ -46212,33 +46567,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "together_ai/deepseek-ai/DeepSeek-V3.1": { - "deprecation_date": "2026-05-14", - "input_cost_per_token": 6e-07, - "litellm_provider": "together_ai", - "max_tokens": 16384, - "metadata": { - "successor": "together_ai/deepseek-ai/DeepSeek-V4-Pro-0813" - }, - "mode": "chat", - "output_cost_per_token": 1.7e-06, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "max_input_tokens": 131072, - "max_output_tokens": 16384 - }, - "together_ai/meta-llama/Llama-3.2-3B-Instruct-Turbo": { - "deprecation_date": "2026-03-06", - "litellm_provider": "together_ai", - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "together_ai/meta-llama/Llama-3.3-70B-Instruct-Turbo": { "input_cost_per_token": 1.04e-06, "litellm_provider": "together_ai", @@ -46252,112 +46580,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "together_ai/meta-llama/Llama-3.3-70B-Instruct-Turbo-Free": { - "deprecation_date": "2025-11-13", - "input_cost_per_token": 0, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 0, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8": { - "deprecation_date": "2026-03-31", - "input_cost_per_token": 2.7e-07, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 8.5e-07, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/meta-llama/Llama-4-Scout-17B-16E-Instruct": { - "deprecation_date": "2026-02-06", - "input_cost_per_token": 1.8e-07, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 5.9e-07, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo": { - "deprecation_date": "2026-02-06", - "input_cost_per_token": 3.5e-06, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 3.5e-06, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo": { - "deprecation_date": "2026-02-25", - "input_cost_per_token": 8.8e-07, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 8.8e-07, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo": { - "deprecation_date": "2026-03-06", - "input_cost_per_token": 1.8e-07, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 1.8e-07, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/mistralai/Mistral-7B-Instruct-v0.1": { - "deprecation_date": "2025-11-13", - "litellm_provider": "together_ai", - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "max_input_tokens": 32768, - "source": "https://api.together.ai/v1/models" - }, - "together_ai/mistralai/Mistral-Small-24B-Instruct-2501": { - "deprecation_date": "2026-04-02", - "litellm_provider": "together_ai", - "mode": "chat", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 3e-07, - "max_input_tokens": 32768, - "source": "https://api.together.ai/v1/models" - }, - "together_ai/mistralai/Mixtral-8x7B-Instruct-v0.1": { - "deprecation_date": "2026-04-16", - "input_cost_per_token": 6e-07, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 6e-07, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "together_ai/moonshotai/Kimi-K2-Instruct": { "input_cost_per_token": 1e-06, "litellm_provider": "together_ai", @@ -46386,19 +46608,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "together_ai/openai/gpt-oss-20b": { - "deprecation_date": "2026-09-14", - "input_cost_per_token": 5e-08, - "litellm_provider": "together_ai", - "max_input_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 2e-07, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "together_ai/togethercomputer/CodeLlama-34b-Instruct": { "litellm_provider": "together_ai", "mode": "chat", @@ -46406,19 +46615,6 @@ "supports_parallel_function_calling": true, "supports_tool_choice": true }, - "together_ai/zai-org/GLM-4.5-Air-FP8": { - "deprecation_date": "2026-04-02", - "input_cost_per_token": 2e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 1.1e-06, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "together_ai/zai-org/GLM-4.6": { "input_cost_per_token": 6e-07, "litellm_provider": "together_ai", @@ -46435,102 +46631,6 @@ "supports_reasoning": true, "supports_tool_choice": true }, - "together_ai/zai-org/GLM-4.7": { - "deprecation_date": "2026-04-02", - "input_cost_per_token": 4.5e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 202752, - "max_tokens": 202752, - "metadata": { - "successor": "together_ai/zai-org/GLM-5.2" - }, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_reasoning": true, - "supports_tool_choice": true - }, - "together_ai/moonshotai/Kimi-K2.5": { - "deprecation_date": "2026-05-21", - "input_cost_per_token": 5e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 256000, - "max_tokens": 256000, - "metadata": { - "successor": "together_ai/moonshotai/Kimi-K3" - }, - "mode": "chat", - "output_cost_per_token": 2.8e-06, - "source": "https://www.together.ai/models/kimi-k2-5", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_reasoning": true - }, - "together_ai/moonshotai/Kimi-K2-Instruct-0905": { - "deprecation_date": "2026-03-06", - "input_cost_per_token": 1e-06, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, - "metadata": { - "successor": "together_ai/moonshotai/Kimi-K3" - }, - "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://www.together.ai/models/kimi-k2-0905", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true - }, - "together_ai/Qwen/Qwen3-Next-80B-A3B-Instruct": { - "deprecation_date": "2026-04-02", - "input_cost_per_token": 1.5e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, - "metadata": { - "successor": "together_ai/Qwen/Qwen3.7-Plus" - }, - "mode": "chat", - "output_cost_per_token": 1.5e-06, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/Qwen/Qwen3-Next-80B-A3B-Thinking": { - "deprecation_date": "2026-02-25", - "input_cost_per_token": 1.5e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, - "metadata": { - "successor": "together_ai/Qwen/Qwen3.6-Plus" - }, - "mode": "chat", - "output_cost_per_token": 1.5e-06, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/Qwen/Qwen3.5-397B-A17B": { - "cache_read_input_token_cost": 3.5e-07, - "deprecation_date": "2026-06-29", - "input_cost_per_token": 6e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 3.6e-06, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "together_ai/MiniMaxAI/MiniMax-M3": { "cache_read_input_token_cost": 6e-08, "input_cost_per_token": 3e-07, @@ -46583,13 +46683,13 @@ "supports_reasoning": true }, "together_ai/Qwen/Qwen3.7-Max": { - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 2.5e-06, + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 1.5e-06, "litellm_provider": "together_ai", "max_input_tokens": 1000000, "max_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 7.5e-06, + "output_cost_per_token": 4.5e-06, "source": "https://api.together.ai/v1/models", "supports_prompt_caching": true }, @@ -46652,23 +46752,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "together_ai/deepseek-ai/DeepSeek-V4-Pro": { - "deprecation_date": "2026-08-27", - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.74e-06, - "litellm_provider": "together_ai", - "max_input_tokens": 512000, - "max_tokens": 512000, - "mode": "chat", - "output_cost_per_token": 3.48e-06, - "source": "https://docs.together.ai/docs/serverless-models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, "together_ai/deepseek-ai/DeepSeek-V4-Pro-0813": { "cache_read_input_token_cost": 1.3e-07, "deprecation_date": "2026-09-29", @@ -46685,52 +46768,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "together_ai/google/gemma-3n-E4B-it": { - "deprecation_date": "2026-08-25", - "input_cost_per_token": 6e-08, - "litellm_provider": "together_ai", - "max_input_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 1.2e-07, - "source": "https://docs.together.ai/docs/serverless-models" - }, - "together_ai/google/gemma-4-31B-it": { - "deprecation_date": "2026-09-14", - "input_cost_per_token": 3.9e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, - "max_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 9.7e-07, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "together_ai/intfloat/multilingual-e5-large-instruct": { - "deprecation_date": "2026-09-14", - "input_cost_per_token": 2e-08, - "litellm_provider": "together_ai", - "max_input_tokens": 514, - "max_tokens": 514, - "mode": "embedding", - "output_cost_per_token": 2e-08, - "output_vector_size": 1024, - "source": "https://docs.together.ai/docs/serverless-models" - }, - "together_ai/meta-llama/Llama-Guard-4-12B": { - "deprecation_date": "2026-08-25", - "input_cost_per_token": 2e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 1048576, - "max_tokens": 1048576, - "mode": "chat", - "output_cost_per_token": 2e-07, - "source": "https://docs.together.ai/docs/serverless-models" - }, "together_ai/meta-models/Muse-Glimmer-30B": { "cache_read_input_token_cost": 4e-08, "input_cost_per_token": 3.5e-07, @@ -46742,23 +46779,6 @@ "source": "https://api.together.ai/v1/models", "supports_prompt_caching": true }, - "together_ai/moonshotai/Kimi-K2.7-Code": { - "deprecation_date": "2026-08-27", - "cache_read_input_token_cost": 1.9e-07, - "input_cost_per_token": 9.5e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, - "max_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 4e-06, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, "together_ai/moonshotai/Kimi-K3": { "cache_read_input_token_cost": 3e-07, "input_cost_per_token": 3e-06, @@ -46781,33 +46801,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "together_ai/nvidia/nemotron-3-ultra-550b-a55b": { - "deprecation_date": "2026-08-27", - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 6e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 512288, - "max_tokens": 512288, - "mode": "chat", - "output_cost_per_token": 3.6e-06, - "source": "https://api.together.ai/v1/models", - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true - }, - "together_ai/pearl-ai/gemma-4-31b-it": { - "deprecation_date": "2026-08-27", - "input_cost_per_token": 2.8e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, - "max_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 8.6e-07, - "source": "https://docs.together.ai/docs/serverless-models" - }, "together_ai/thinkingmachines/Inkling": { "cache_read_input_token_cost": 1.7e-07, "input_cost_per_token": 1e-06, @@ -46823,18 +46816,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "together_ai/thinkingmachines/Inkling-Small": { - "deprecation_date": "2026-09-14", - "cache_read_input_token_cost": 1e-07, - "input_cost_per_token": 5e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 524288, - "max_tokens": 524288, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://api.together.ai/v1/models", - "supports_prompt_caching": true - }, "together_ai/zai-org/GLM-5.2": { "cache_read_input_token_cost": 2.6e-07, "input_cost_per_token": 1.4e-06, @@ -46981,22 +46962,6 @@ "supports_response_schema": true, "supports_tool_choice": true }, - "us.amazon.nova-premier-v1:0": { - "deprecation_date": "2026-09-14", - "input_cost_per_token": 2.5e-06, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 1000000, - "max_output_tokens": 10000, - "max_tokens": 10000, - "mode": "chat", - "output_cost_per_token": 1.25e-05, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_vision": true, - "cache_read_input_token_cost": 6.25e-07 - }, "us.amazon.nova-pro-v1:0": { "cache_read_input_token_cost": 2e-07, "input_cost_per_token": 8e-07, @@ -47043,7 +47008,7 @@ "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 5.5e-06, - "source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock", + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_assistant_prefill": true, "supports_computer_use": true, "supports_function_calling": true, @@ -47114,23 +47079,6 @@ "supports_tool_choice": true, "supports_vision": true }, - "us.anthropic.claude-3-haiku-20240307-v1:0": { - "deprecation_date": "2026-09-10", - "input_cost_per_token": 2.5e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.25e-06, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 2.5e-08, - "cache_creation_input_token_cost": 3.125e-07 - }, "us.anthropic.claude-3-opus-20240229-v1:0": { "input_cost_per_token": 1.5e-05, "litellm_provider": "bedrock", @@ -47146,23 +47094,6 @@ "cache_read_input_token_cost": 1.5e-06, "cache_creation_input_token_cost": 1.875e-05 }, - "us.anthropic.claude-3-sonnet-20240229-v1:0": { - "deprecation_date": "2026-07-30", - "input_cost_per_token": 3e-06, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 3e-07, - "cache_creation_input_token_cost": 3.75e-06 - }, "us.anthropic.claude-opus-4-1-20250805-v1:0": { "cache_creation_input_token_cost": 1.875e-05, "cache_read_input_token_cost": 1.5e-06, @@ -47188,7 +47119,8 @@ "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us.anthropic.claude-sonnet-4-5-20250929-v1:0": { "cache_creation_input_token_cost": 4.125e-06, @@ -47225,24 +47157,8 @@ "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 1024, "input_cost_per_token_batches": 1.65e-06, - "output_cost_per_token_batches": 8.25e-06 - }, - "us-gov.anthropic.claude-3-haiku-20240307-v1:0": { - "deprecation_date": "2026-09-10", - "input_cost_per_token": 3e-07, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 200000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.5e-06, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "cache_read_input_token_cost": 3e-08, - "cache_creation_input_token_cost": 3.75e-07 + "output_cost_per_token_batches": 8.25e-06, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us-gov.anthropic.claude-sonnet-4-5-20250929-v1:0": { "cache_creation_input_token_cost": 4.5e-06, @@ -47272,7 +47188,8 @@ "supports_vision": true, "supports_native_structured_output": true, "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us-gov.anthropic.claude-sonnet-5": { "bedrock_converse_supports_strict_tools": false, @@ -47289,7 +47206,7 @@ "mode": "chat", "output_cost_per_token": 1.2e-05, "prompt_cache_min_tokens": 1024, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json", + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_adaptive_thinking": true, "supports_assistant_prefill": false, "supports_computer_use": true, @@ -47323,14 +47240,14 @@ "mode": "chat", "output_cost_per_token": 3e-05, "prompt_cache_min_tokens": 1024, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json", + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_adaptive_thinking": true, "supports_assistant_prefill": false, "supports_computer_use": true, "supports_function_calling": true, "supports_max_reasoning_effort": true, "supports_mid_conversation_system": true, - "supports_native_structured_output": true, + "supports_native_structured_output": false, "supports_output_config": true, "supports_parallel_tool_use_config": true, "supports_pdf_input": true, @@ -47356,7 +47273,7 @@ "mode": "chat", "output_cost_per_token": 3e-05, "prompt_cache_min_tokens": 512, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json", + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_adaptive_thinking": true, "supports_assistant_prefill": false, "supports_computer_use": true, @@ -47375,6 +47292,41 @@ "supports_vision": true, "supports_xhigh_reasoning_effort": true }, + "us-gov.anthropic.claude-opus-5-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 6e-06, + "cache_creation_input_token_cost_above_1hr": 9.6e-06, + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 4.8e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2.4e-05, + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "thinking_always_on": true, + "supports_forced_tool_use": false + }, "us-gov.anthropic.claude-fable-5-1": { "cache_creation_input_token_cost": 1.5e-05, "cache_creation_input_token_cost_above_1hr": 2.4e-05, @@ -47407,7 +47359,7 @@ "bedrock_output_config_effort_ceiling": "xhigh", "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 512, - "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us-gov.nvidia.nemotron-nano-3-30b": { "input_cost_per_token": 7.2e-08, @@ -47421,7 +47373,10 @@ "supports_function_calling": true, "supports_native_structured_output": true, "supports_system_messages": true, - "supports_tool_choice": true + "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "us-gov.nvidia.nemotron-nano-12b-v2": { "input_cost_per_token": 2.4e-07, @@ -47432,7 +47387,10 @@ "mode": "chat", "output_cost_per_token": 7.2e-07, "supports_system_messages": true, - "supports_vision": true + "supports_vision": true, + "supports_audio_input": false, + "supports_function_calling": true, + "supports_response_schema": true }, "us-gov.nvidia.nemotron-nano-9b-v2": { "input_cost_per_token": 7.2e-08, @@ -47442,7 +47400,11 @@ "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 2.76e-07, - "supports_system_messages": true + "supports_system_messages": true, + "supports_audio_input": false, + "supports_function_calling": true, + "supports_response_schema": true, + "supports_vision": false }, "us-gov.nvidia.nemotron-super-3-120b": { "input_cost_per_token": 1.8e-07, @@ -47456,7 +47418,10 @@ "supports_function_calling": true, "supports_reasoning": true, "supports_system_messages": true, - "supports_tool_choice": true + "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "us-gov.openai.gpt-oss-20b-1:0": { "input_cost_per_token": 8.4e-08, @@ -47524,7 +47489,8 @@ "supports_parallel_tool_use_config": true, "prompt_cache_min_tokens": 4096, "input_cost_per_token_batches": 5.5e-07, - "output_cost_per_token_batches": 2.75e-06 + "output_cost_per_token_batches": 2.75e-06, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us.anthropic.claude-opus-4-20250514-v1:0": { "cache_creation_input_token_cost": 1.875e-05, @@ -47582,7 +47548,8 @@ "supports_output_config": true, "bedrock_output_config_effort_ceiling": "high", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "global.anthropic.claude-opus-4-5-20251101-v1:0": { "cache_creation_input_token_cost": 6.25e-06, @@ -47614,19 +47581,21 @@ "supports_output_config": true, "bedrock_output_config_effort_ceiling": "high", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "eu.anthropic.claude-opus-4-5-20251101-v1:0": { - "cache_creation_input_token_cost": 6.25e-06, - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 5e-06, + "cache_creation_input_token_cost": 6.875e-06, + "cache_creation_input_token_cost_above_1hr": 1.1e-05, + "cache_read_input_token_cost": 5.5e-07, + "input_cost_per_token": 5.5e-06, "litellm_provider": "bedrock_converse", "supports_tool_search": true, "max_input_tokens": 200000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 2.5e-05, + "output_cost_per_token": 2.75e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -47645,7 +47614,8 @@ "supports_output_config": true, "bedrock_output_config_effort_ceiling": "high", "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us.anthropic.claude-sonnet-4-20250514-v1:0": { "cache_creation_input_token_cost": 3.75e-06, @@ -47677,7 +47647,8 @@ "supports_tool_choice": true, "supports_vision": true, "bedrock_converse_supports_strict_tools": false, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://aws.amazon.com/bedrock/pricing/" }, "us.deepseek.r1-v1:0": { "input_cost_per_token": 1.35e-06, @@ -47687,6 +47658,7 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 5.4e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": false, "supports_reasoning": true, "supports_tool_choice": false @@ -47702,7 +47674,10 @@ "supports_function_calling": true, "supports_reasoning": true, "supports_native_structured_output": true, - "supports_tool_choice": true + "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "eu.deepseek.v3.2": { "input_cost_per_token": 7.4e-07, @@ -47715,27 +47690,32 @@ "supports_function_calling": true, "supports_reasoning": true, "supports_native_structured_output": true, - "supports_tool_choice": true + "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, "us.meta.llama3-1-405b-instruct-v1:0": { - "input_cost_per_token": 5.32e-06, + "input_cost_per_token": 2.4e-06, "litellm_provider": "bedrock", "max_input_tokens": 128000, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 1.6e-05, + "output_cost_per_token": 2.4e-06, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, "supports_tool_choice": false }, "us.meta.llama3-1-70b-instruct-v1:0": { - "input_cost_per_token": 9.9e-07, + "input_cost_per_token": 7.2e-07, "litellm_provider": "bedrock", "max_input_tokens": 128000, "max_output_tokens": 2048, "max_tokens": 2048, "mode": "chat", - "output_cost_per_token": 9.9e-07, + "output_cost_per_token": 7.2e-07, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, "supports_tool_choice": false }, @@ -47751,13 +47731,14 @@ "supports_tool_choice": false }, "us.meta.llama3-2-11b-instruct-v1:0": { - "input_cost_per_token": 3.5e-07, + "input_cost_per_token": 1.6e-07, "litellm_provider": "bedrock", "max_input_tokens": 128000, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 3.5e-07, + "output_cost_per_token": 1.6e-07, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, "supports_tool_choice": false, "supports_vision": true @@ -47785,13 +47766,14 @@ "supports_tool_choice": false }, "us.meta.llama3-2-90b-instruct-v1:0": { - "input_cost_per_token": 2e-06, + "input_cost_per_token": 7.2e-07, "litellm_provider": "bedrock", "max_input_tokens": 128000, "max_output_tokens": 4096, "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 2e-06, + "output_cost_per_token": 7.2e-07, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, "supports_tool_choice": false, "supports_vision": true @@ -47857,6 +47839,7 @@ "max_tokens": 4096, "mode": "chat", "output_cost_per_token": 6e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_tool_choice": false }, @@ -48371,34 +48354,6 @@ "output_cost_per_token": 9e-07, "supports_tool_choice": true }, - "vercel_ai_gateway/google/gemini-2.0-flash": { - "deprecation_date": "2026-06-01", - "input_cost_per_token": 1.5e-07, - "litellm_provider": "vercel_ai_gateway", - "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 6e-07, - "supports_vision": true, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true - }, - "vercel_ai_gateway/google/gemini-2.0-flash-lite": { - "deprecation_date": "2026-06-01", - "input_cost_per_token": 7.5e-08, - "litellm_provider": "vercel_ai_gateway", - "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 3e-07, - "supports_vision": true, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true - }, "vercel_ai_gateway/google/gemini-2.5-flash": { "input_cost_per_token": 3e-07, "litellm_provider": "vercel_ai_gateway", @@ -49177,7 +49132,22 @@ "/v1/realtime" ] }, + "vertex_ai/chirp_2": { + "input_cost_per_second": 0.00026667, + "litellm_provider": "vertex_ai", + "metadata": { + "calculation": "$0.016/60 seconds = $0.00026667 per second", + "original_pricing_per_minute": 0.016 + }, + "mode": "audio_transcription", + "source": "https://cloud.google.com/speech-to-text/pricing", + "supported_endpoints": [ + "/v1/audio/transcriptions", + "/v1/realtime" + ] + }, "vertex_ai/claude-3-5-haiku": { + "deprecation_date": "2026-07-05", "input_cost_per_token": 1e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, @@ -49191,6 +49161,7 @@ "supports_tool_choice": true }, "vertex_ai/claude-3-5-haiku@20241022": { + "deprecation_date": "2026-07-05", "input_cost_per_token": 1e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, @@ -49207,16 +49178,20 @@ "deprecation_date": "2026-10-15", "cache_creation_input_token_cost": 1.25e-06, "cache_creation_input_token_cost_above_1hr": 2e-06, + "cache_creation_input_token_cost_batches": 6.25e-07, "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_batches": 5e-08, "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 5e-07, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 5e-06, + "output_cost_per_token_batches": 2.5e-06, "regional_endpoint_uplift_multiplier": 1.1, - "source": "https://cloud.google.com/vertex-ai/generative-ai/docs/partner-models/claude/haiku-4-5", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_assistant_prefill": true, "supports_function_calling": true, "supports_pdf_input": true, @@ -49232,16 +49207,20 @@ "deprecation_date": "2026-10-15", "cache_creation_input_token_cost": 1.25e-06, "cache_creation_input_token_cost_above_1hr": 2e-06, + "cache_creation_input_token_cost_batches": 6.25e-07, "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_batches": 5e-08, "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 5e-07, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 5e-06, + "output_cost_per_token_batches": 2.5e-06, "regional_endpoint_uplift_multiplier": 1.1, - "source": "https://cloud.google.com/vertex-ai/generative-ai/docs/partner-models/claude/haiku-4-5", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_assistant_prefill": true, "supports_function_calling": true, "supports_pdf_input": true, @@ -49254,6 +49233,7 @@ "prompt_cache_min_tokens": 4096 }, "vertex_ai/claude-3-5-sonnet": { + "deprecation_date": "2026-02-19", "input_cost_per_token": 3e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, @@ -49269,6 +49249,7 @@ "supports_vision": true }, "vertex_ai/claude-3-5-sonnet@20240620": { + "deprecation_date": "2026-02-19", "input_cost_per_token": 3e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, @@ -49282,29 +49263,8 @@ "supports_tool_choice": true, "supports_vision": true }, - "vertex_ai/claude-3-7-sonnet@20250219": { - "cache_creation_input_token_cost": 3.75e-06, - "cache_creation_input_token_cost_above_1hr": 6e-06, - "cache_read_input_token_cost": 3e-07, - "deprecation_date": "2026-05-11", - "input_cost_per_token": 3e-06, - "litellm_provider": "vertex_ai-anthropic_models", - "max_input_tokens": 200000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, "vertex_ai/claude-3-haiku": { + "deprecation_date": "2026-08-23", "input_cost_per_token": 2.5e-07, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, @@ -49318,6 +49278,7 @@ "supports_vision": true }, "vertex_ai/claude-3-haiku@20240307": { + "deprecation_date": "2026-08-23", "input_cost_per_token": 2.5e-07, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, @@ -49331,6 +49292,7 @@ "supports_vision": true }, "vertex_ai/claude-3-opus": { + "deprecation_date": "2025-08-01", "input_cost_per_token": 1.5e-05, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, @@ -49344,6 +49306,7 @@ "supports_vision": true }, "vertex_ai/claude-3-opus@20240229": { + "deprecation_date": "2025-08-01", "input_cost_per_token": 1.5e-05, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, @@ -49382,84 +49345,22 @@ "supports_tool_choice": true, "supports_vision": true }, - "vertex_ai/claude-opus-4": { - "deprecation_date": "2026-05-14", - "cache_creation_input_token_cost": 1.875e-05, - "cache_creation_input_token_cost_above_1hr": 3e-05, - "cache_read_input_token_cost": 1.5e-06, - "input_cost_per_token": 1.5e-05, - "litellm_provider": "vertex_ai-anthropic_models", - "max_input_tokens": 200000, - "max_output_tokens": 32000, - "max_tokens": 32000, - "mode": "chat", - "output_cost_per_token": 7.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "prompt_cache_min_tokens": 1024 - }, - "vertex_ai/claude-opus-4-1": { - "deprecation_date": "2026-08-05", - "cache_creation_input_token_cost": 1.875e-05, - "cache_creation_input_token_cost_above_1hr": 3e-05, - "cache_read_input_token_cost": 1.5e-06, - "input_cost_per_token": 1.5e-05, - "input_cost_per_token_batches": 7.5e-06, - "litellm_provider": "vertex_ai-anthropic_models", - "max_input_tokens": 200000, - "max_output_tokens": 32000, - "max_tokens": 32000, - "mode": "chat", - "output_cost_per_token": 7.5e-05, - "output_cost_per_token_batches": 3.75e-05, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "vertex_ai/claude-opus-4-1@20250805": { - "deprecation_date": "2026-08-05", - "cache_creation_input_token_cost": 1.875e-05, - "cache_creation_input_token_cost_above_1hr": 3e-05, - "cache_read_input_token_cost": 1.5e-06, - "input_cost_per_token": 1.5e-05, - "input_cost_per_token_batches": 7.5e-06, - "litellm_provider": "vertex_ai-anthropic_models", - "max_input_tokens": 200000, - "max_output_tokens": 32000, - "max_tokens": 32000, - "mode": "chat", - "output_cost_per_token": 7.5e-05, - "output_cost_per_token_batches": 3.75e-05, - "supports_assistant_prefill": true, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true - }, "vertex_ai/claude-opus-4-5": { "deprecation_date": "2026-11-24", "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "regional_endpoint_uplift_multiplier": 1.1, "search_context_cost_per_query": { "search_context_size_high": 0.01, @@ -49476,20 +49377,25 @@ "supports_tool_choice": true, "supports_vision": true, "supports_output_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-opus-4-5@20251101": { "deprecation_date": "2026-11-24", "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "regional_endpoint_uplift_multiplier": 1.1, "search_context_cost_per_query": { "search_context_size_high": 0.01, @@ -49507,7 +49413,8 @@ "supports_vision": true, "supports_native_streaming": true, "supports_output_config": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-opus-4-6": { "deprecation_date": "2027-02-05", @@ -49516,14 +49423,18 @@ "supports_legacy_thinking": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -49540,7 +49451,8 @@ "supports_vision": true, "supports_output_config": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-opus-4-6@default": { "deprecation_date": "2027-02-05", @@ -49549,14 +49461,18 @@ "supports_legacy_thinking": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -49573,7 +49489,8 @@ "supports_vision": true, "supports_output_config": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 4096 + "prompt_cache_min_tokens": 4096, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-opus-4-7": { "deprecation_date": "2027-04-16", @@ -49581,14 +49498,18 @@ "supports_adaptive_thinking": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -49606,7 +49527,8 @@ "supports_vision": true, "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 2048 + "prompt_cache_min_tokens": 2048, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-opus-4-7@default": { "deprecation_date": "2027-04-16", @@ -49614,14 +49536,18 @@ "supports_adaptive_thinking": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -49639,7 +49565,8 @@ "supports_vision": true, "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 2048 + "prompt_cache_min_tokens": 2048, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-fable-5": { "deprecation_date": "2027-06-08", @@ -49647,14 +49574,18 @@ "supports_mid_conversation_system": true, "cache_creation_input_token_cost": 1.25e-05, "cache_creation_input_token_cost_above_1hr": 2e-05, + "cache_creation_input_token_cost_batches": 6.25e-06, "cache_read_input_token_cost": 1e-06, + "cache_read_input_token_cost_batches": 5e-07, "input_cost_per_token": 1e-05, + "input_cost_per_token_batches": 5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 5e-05, + "output_cost_per_token_batches": 2.5e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -49674,14 +49605,17 @@ "supports_vision": true, "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 512 + "prompt_cache_min_tokens": 512, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-fable-5-1": { "regional_endpoint_uplift_multiplier": 1.1, "supports_mid_conversation_system": true, "cache_creation_input_token_cost": 1.25e-05, "cache_creation_input_token_cost_above_1hr": 2e-05, + "cache_creation_input_token_cost_batches": 6.25e-06, "cache_read_input_token_cost": 2.5e-07, + "cache_read_input_token_cost_batches": 1.25e-07, "input_cost_per_token": 1e-05, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, @@ -49711,7 +49645,10 @@ "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, "prompt_cache_min_tokens": 512, - "deprecation_date": "2027-03-01" + "deprecation_date": "2027-03-01", + "input_cost_per_token_batches": 5e-06, + "output_cost_per_token_batches": 2.5e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-fable-5@default": { "deprecation_date": "2027-06-08", @@ -49719,14 +49656,18 @@ "supports_mid_conversation_system": true, "cache_creation_input_token_cost": 1.25e-05, "cache_creation_input_token_cost_above_1hr": 2e-05, + "cache_creation_input_token_cost_batches": 6.25e-06, "cache_read_input_token_cost": 1e-06, + "cache_read_input_token_cost_batches": 5e-07, "input_cost_per_token": 1e-05, + "input_cost_per_token_batches": 5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 5e-05, + "output_cost_per_token_batches": 2.5e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -49746,14 +49687,17 @@ "supports_vision": true, "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 512 + "prompt_cache_min_tokens": 512, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-fable-5-1@default": { "regional_endpoint_uplift_multiplier": 1.1, "supports_mid_conversation_system": true, "cache_creation_input_token_cost": 1.25e-05, "cache_creation_input_token_cost_above_1hr": 2e-05, + "cache_creation_input_token_cost_batches": 6.25e-06, "cache_read_input_token_cost": 2.5e-07, + "cache_read_input_token_cost_batches": 1.25e-07, "input_cost_per_token": 1e-05, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, @@ -49783,7 +49727,10 @@ "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, "prompt_cache_min_tokens": 512, - "deprecation_date": "2027-03-01" + "deprecation_date": "2027-03-01", + "input_cost_per_token_batches": 5e-06, + "output_cost_per_token_batches": 2.5e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-opus-5": { "deprecation_date": "2027-01-24", @@ -49792,14 +49739,18 @@ "supports_adaptive_thinking": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -49817,7 +49768,8 @@ "supports_vision": true, "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 512 + "prompt_cache_min_tokens": 512, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-opus-5@default": { "deprecation_date": "2027-01-24", @@ -49826,14 +49778,18 @@ "supports_adaptive_thinking": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -49851,7 +49807,90 @@ "supports_vision": true, "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 512 + "prompt_cache_min_tokens": 512, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "vertex_ai/claude-opus-5-5": { + "regional_endpoint_uplift_multiplier": 1.1, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 5e-06, + "cache_creation_input_token_cost_above_1hr": 8e-06, + "cache_creation_input_token_cost_batches": 2.5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1e-07, + "input_cost_per_token": 4e-06, + "input_cost_per_token_batches": 2.5e-06, + "litellm_provider": "vertex_ai-anthropic_models", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2e-05, + "output_cost_per_token_batches": 1.25e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_forced_tool_use": false, + "supports_function_calling": true, + "supports_native_structured_output": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_max_reasoning_effort": true, + "prompt_cache_min_tokens": 512, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "vertex_ai/claude-opus-5-5@default": { + "regional_endpoint_uplift_multiplier": 1.1, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 5e-06, + "cache_creation_input_token_cost_above_1hr": 8e-06, + "cache_creation_input_token_cost_batches": 2.5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1e-07, + "input_cost_per_token": 4e-06, + "input_cost_per_token_batches": 2.5e-06, + "litellm_provider": "vertex_ai-anthropic_models", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 2e-05, + "output_cost_per_token_batches": 1.25e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_forced_tool_use": false, + "supports_function_calling": true, + "supports_native_structured_output": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_max_reasoning_effort": true, + "prompt_cache_min_tokens": 512, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-opus-4-8": { "deprecation_date": "2027-05-28", @@ -49860,14 +49899,18 @@ "supports_adaptive_thinking": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -49885,7 +49928,8 @@ "supports_vision": true, "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-opus-4-8@default": { "deprecation_date": "2027-05-28", @@ -49894,14 +49938,18 @@ "supports_adaptive_thinking": true, "cache_creation_input_token_cost": 6.25e-06, "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_creation_input_token_cost_batches": 3.125e-06, "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_batches": 2.5e-07, "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.5e-05, + "output_cost_per_token_batches": 1.25e-05, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -49919,18 +49967,21 @@ "supports_vision": true, "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-sonnet-4-5": { "deprecation_date": "2026-09-29", "cache_creation_input_token_cost": 3.75e-06, "cache_creation_input_token_cost_above_1hr": 6e-06, + "cache_creation_input_token_cost_above_1hr_above_200k_tokens": 1.2e-05, "cache_read_input_token_cost": 3e-07, "input_cost_per_token": 3e-06, "input_cost_per_token_above_200k_tokens": 6e-06, "output_cost_per_token_above_200k_tokens": 2.25e-05, "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "cache_read_input_token_cost_batches": 1.5e-07, "input_cost_per_token_batches": 1.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, @@ -49949,7 +50000,9 @@ "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "cache_creation_input_token_cost_batches": 1.88e-06 }, "vertex_ai/claude-sonnet-5": { "deprecation_date": "2026-12-24", @@ -49959,12 +50012,14 @@ "cache_creation_input_token_cost_above_1hr": 4e-06, "cache_read_input_token_cost": 2e-07, "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 1e-05, + "output_cost_per_token_batches": 5e-06, "search_context_cost_per_query": { "search_context_size_high": 0.01, "search_context_size_low": 0.01, @@ -49983,7 +50038,8 @@ "supports_vision": true, "supports_xhigh_reasoning_effort": true, "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-sonnet-4-6": { "regional_endpoint_uplift_multiplier": 1.1, @@ -49991,14 +50047,18 @@ "supports_legacy_thinking": true, "cache_creation_input_token_cost": 3.75e-06, "cache_creation_input_token_cost_above_1hr": 6e-06, + "cache_creation_input_token_cost_batches": 1.88e-06, "cache_read_input_token_cost": 3e-07, + "cache_read_input_token_cost_batches": 1.5e-07, "input_cost_per_token": 3e-06, + "input_cost_per_token_batches": 1.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 1000000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", "output_cost_per_token": 1.5e-05, + "output_cost_per_token_batches": 7.5e-06, "supports_assistant_prefill": true, "supports_computer_use": true, "supports_function_calling": true, @@ -50015,18 +50075,21 @@ "search_context_size_medium": 0.01 }, "supports_output_config": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/claude-sonnet-4-5@20250929": { "deprecation_date": "2026-09-29", "cache_creation_input_token_cost": 3.75e-06, "cache_creation_input_token_cost_above_1hr": 6e-06, + "cache_creation_input_token_cost_above_1hr_above_200k_tokens": 1.2e-05, "cache_read_input_token_cost": 3e-07, "input_cost_per_token": 3e-06, "input_cost_per_token_above_200k_tokens": 6e-06, "output_cost_per_token_above_200k_tokens": 2.25e-05, "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "cache_read_input_token_cost_batches": 1.5e-07, "input_cost_per_token_batches": 1.5e-06, "litellm_provider": "vertex_ai-anthropic_models", "max_input_tokens": 200000, @@ -50046,99 +50109,9 @@ "supports_tool_choice": true, "supports_vision": true, "supports_native_streaming": true, - "prompt_cache_min_tokens": 1024 - }, - "vertex_ai/claude-opus-4@20250514": { - "deprecation_date": "2026-05-14", - "cache_creation_input_token_cost": 1.875e-05, - "cache_creation_input_token_cost_above_1hr": 3e-05, - "cache_read_input_token_cost": 1.5e-06, - "input_cost_per_token": 1.5e-05, - "litellm_provider": "vertex_ai-anthropic_models", - "max_input_tokens": 200000, - "max_output_tokens": 32000, - "max_tokens": 32000, - "mode": "chat", - "output_cost_per_token": 7.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "prompt_cache_min_tokens": 1024 - }, - "vertex_ai/claude-sonnet-4": { - "deprecation_date": "2026-05-14", - "cache_creation_input_token_cost": 3.75e-06, - "cache_creation_input_token_cost_above_1hr": 6e-06, - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 3e-06, - "input_cost_per_token_above_200k_tokens": 6e-06, - "output_cost_per_token_above_200k_tokens": 2.25e-05, - "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, - "cache_read_input_token_cost_above_200k_tokens": 6e-07, - "litellm_provider": "vertex_ai-anthropic_models", - "max_input_tokens": 1000000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "prompt_cache_min_tokens": 1024 - }, - "vertex_ai/claude-sonnet-4@20250514": { - "deprecation_date": "2026-05-14", - "cache_creation_input_token_cost": 3.75e-06, - "cache_creation_input_token_cost_above_1hr": 6e-06, - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 3e-06, - "input_cost_per_token_above_200k_tokens": 6e-06, - "output_cost_per_token_above_200k_tokens": 2.25e-05, - "cache_creation_input_token_cost_above_200k_tokens": 7.5e-06, - "cache_read_input_token_cost_above_200k_tokens": 6e-07, - "litellm_provider": "vertex_ai-anthropic_models", - "max_input_tokens": 1000000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_assistant_prefill": true, - "supports_computer_use": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "prompt_cache_min_tokens": 1024 + "prompt_cache_min_tokens": 1024, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "cache_creation_input_token_cost_batches": 1.88e-06 }, "vertex_ai/mistralai/codestral-2@001": { "input_cost_per_token": 3e-07, @@ -50148,6 +50121,7 @@ "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 9e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_tool_choice": true }, @@ -50159,6 +50133,7 @@ "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 9e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_tool_choice": true }, @@ -50170,6 +50145,7 @@ "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 9e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_tool_choice": true }, @@ -50181,6 +50157,7 @@ "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 9e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_tool_choice": true }, @@ -50218,14 +50195,18 @@ "supports_tool_choice": true }, "vertex_ai/deepseek-ai/deepseek-v3.1-maas": { + "cache_read_input_token_cost": 6e-08, + "deprecation_date": "2026-10-21", "input_cost_per_token": 6e-07, + "input_cost_per_token_batches": 3e-07, "litellm_provider": "vertex_ai-deepseek_models", "max_input_tokens": 163840, "max_output_tokens": 32768, "max_tokens": 32768, "mode": "chat", "output_cost_per_token": 1.7e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#partner-models", + "output_cost_per_token_batches": 8.5e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_regions": [ "us-central1" ], @@ -50236,6 +50217,8 @@ "supports_tool_choice": true }, "vertex_ai/deepseek-ai/deepseek-v3.2-maas": { + "cache_read_input_token_cost": 5.6e-08, + "deprecation_date": "2026-10-21", "input_cost_per_token": 5.6e-07, "input_cost_per_token_batches": 2.8e-07, "litellm_provider": "vertex_ai-deepseek_models", @@ -50245,7 +50228,7 @@ "mode": "chat", "output_cost_per_token": 1.68e-06, "output_cost_per_token_batches": 8.4e-07, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#partner-models", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_regions": [ "global" ], @@ -50256,14 +50239,17 @@ "supports_tool_choice": true }, "vertex_ai/deepseek-ai/deepseek-r1-0528-maas": { + "deprecation_date": "2026-10-21", "input_cost_per_token": 1.35e-06, + "input_cost_per_token_batches": 6.75e-07, "litellm_provider": "vertex_ai-deepseek_models", "max_input_tokens": 65336, "max_output_tokens": 8192, "max_tokens": 8192, "mode": "chat", "output_cost_per_token": 5.4e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#partner-models", + "output_cost_per_token_batches": 2.7e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_regions": [ "us-central1" ], @@ -50274,13 +50260,11 @@ "supports_tool_choice": true }, "vertex_ai/gemini-2.5-flash-image": { - "deprecation_date": "2026-10-02", - "cache_read_input_token_cost": 3e-08, + "deprecation_date": "2027-03-15", "input_cost_per_audio_token": 1e-06, "input_cost_per_token": 3e-07, "input_cost_per_token_batches": 1.5e-07, "input_cost_per_token_flex": 1.5e-07, - "input_cost_per_token_priority": 5.4e-07, "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 32768, "max_output_tokens": 32768, @@ -50328,6 +50312,7 @@ "cache_read_input_token_cost": 2e-07, "cache_read_input_token_cost_above_200k_tokens": 4e-07, "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, + "cache_read_input_token_cost_batches": 1e-07, "cache_read_input_token_cost_flex": 1e-07, "cache_read_input_token_cost_priority": 3.6e-07, "deprecation_date": "2027-05-28", @@ -50356,7 +50341,15 @@ }, "vertex_ai/gemini-3-pro-image-preview": { "input_cost_per_image": 0.0011, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_priority": 3.6e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, + "cache_read_input_token_cost_batches": 1e-07, "input_cost_per_token": 2e-06, + "input_cost_per_token_priority": 3.6e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, "input_cost_per_token_batches": 1e-06, "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 65536, @@ -50366,12 +50359,16 @@ "output_cost_per_image": 0.134, "output_cost_per_image_token": 0.00012, "output_cost_per_token": 1.2e-05, + "output_cost_per_token_priority": 2.16e-05, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, "output_cost_per_token_batches": 6e-06, "supports_reasoning": false, "source": "https://docs.cloud.google.com/vertex-ai/generative-ai/docs/models/gemini/3-pro-image" }, "vertex_ai/gemini-3.1-flash-image": { "cache_read_input_token_cost": 5e-08, + "cache_read_input_token_cost_batches": 2.5e-08, "cache_read_input_token_cost_flex": 2.5e-08, "deprecation_date": "2027-05-28", "input_cost_per_image": 0.00056, @@ -50393,7 +50390,10 @@ }, "vertex_ai/gemini-3.1-flash-image-preview": { "input_cost_per_image": 0.00056, + "cache_read_input_token_cost": 5e-08, + "cache_read_input_token_cost_batches": 2.5e-08, "input_cost_per_token": 5e-07, + "input_cost_per_token_batches": 2.5e-07, "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 65536, "max_output_tokens": 32768, @@ -50402,11 +50402,13 @@ "output_cost_per_image": 0.0672, "output_cost_per_image_token": 6e-05, "output_cost_per_token": 3e-06, + "output_cost_per_token_batches": 1.5e-06, "supports_reasoning": false, "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#gemini-models" }, "vertex_ai/gemini-3.1-flash-lite-image": { "cache_read_input_token_cost": 2.5e-08, + "cache_read_input_token_cost_batches": 1.25e-08, "cache_read_input_token_cost_flex": 1.25e-08, "input_cost_per_image": 0.00028, "input_cost_per_token": 2.5e-07, @@ -50499,6 +50501,7 @@ "cache_read_input_audio_token_cost": 5e-08, "deprecation_date": "2027-05-07", "cache_read_input_token_cost": 2.5e-08, + "cache_read_input_token_cost_batches": 1.25e-08, "cache_read_input_token_cost_flex": 1.25e-08, "cache_read_input_token_cost_priority": 4.5e-08, "input_cost_per_audio_token": 5e-07, @@ -50506,6 +50509,7 @@ "input_cost_per_token_batches": 1.25e-07, "input_cost_per_token_flex": 1.25e-07, "input_cost_per_token_priority": 4.5e-07, + "input_cost_per_audio_token_priority": 9e-07, "litellm_provider": "vertex_ai-language-models", "max_input_tokens": 1048576, "max_output_tokens": 65536, @@ -50559,6 +50563,7 @@ "vertex_ai/gemini-3.5-flash-lite": { "deprecation_date": "2027-07-21", "cache_read_input_token_cost": 3e-08, + "cache_read_input_token_cost_batches": 1.5e-08, "cache_read_input_token_cost_flex": 1.5e-08, "cache_read_input_token_cost_priority": 5.4e-08, "input_cost_per_token": 3e-07, @@ -50616,6 +50621,7 @@ }, "vertex_ai/deep-research-pro-preview-12-2025": { "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1e-07, "input_cost_per_image": 0.0011, "input_cost_per_token": 2e-06, "input_cost_per_token_batches": 1e-06, @@ -50630,63 +50636,8 @@ "output_cost_per_token_batches": 6e-06, "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, - "vertex_ai/imagegeneration@006": { - "deprecation_date": "2025-09-24", - "litellm_provider": "vertex_ai-image-models", - "mode": "image_generation", - "output_cost_per_image": 0.02, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" - }, - "vertex_ai/imagen-3.0-fast-generate-001": { - "deprecation_date": "2026-06-30", - "litellm_provider": "vertex_ai-image-models", - "mode": "image_generation", - "output_cost_per_image": 0.02, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" - }, - "vertex_ai/imagen-3.0-generate-001": { - "deprecation_date": "2026-06-30", - "litellm_provider": "vertex_ai-image-models", - "mode": "image_generation", - "output_cost_per_image": 0.04, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" - }, - "vertex_ai/imagen-3.0-generate-002": { - "deprecation_date": "2026-06-30", - "litellm_provider": "vertex_ai-image-models", - "mode": "image_generation", - "output_cost_per_image": 0.04, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" - }, - "vertex_ai/imagen-3.0-capability-001": { - "deprecation_date": "2026-06-30", - "litellm_provider": "vertex_ai-image-models", - "mode": "image_generation", - "output_cost_per_image": 0.04, - "source": "https://cloud.google.com/vertex-ai/generative-ai/docs/image/edit-insert-objects" - }, - "vertex_ai/imagen-4.0-fast-generate-001": { - "deprecation_date": "2026-06-30", - "litellm_provider": "vertex_ai-image-models", - "mode": "image_generation", - "output_cost_per_image": 0.02, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" - }, - "vertex_ai/imagen-4.0-generate-001": { - "deprecation_date": "2026-06-30", - "litellm_provider": "vertex_ai-image-models", - "mode": "image_generation", - "output_cost_per_image": 0.04, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" - }, - "vertex_ai/imagen-4.0-ultra-generate-001": { - "deprecation_date": "2026-06-30", - "litellm_provider": "vertex_ai-image-models", - "mode": "image_generation", - "output_cost_per_image": 0.06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" - }, "vertex_ai/jamba-1.5": { + "deprecation_date": "2026-02-27", "input_cost_per_token": 2e-07, "litellm_provider": "vertex_ai-ai21_models", "max_input_tokens": 256000, @@ -50697,6 +50648,7 @@ "supports_tool_choice": true }, "vertex_ai/jamba-1.5-large": { + "deprecation_date": "2026-02-27", "input_cost_per_token": 2e-06, "litellm_provider": "vertex_ai-ai21_models", "max_input_tokens": 256000, @@ -50707,6 +50659,7 @@ "supports_tool_choice": true }, "vertex_ai/jamba-1.5-large@001": { + "deprecation_date": "2026-02-27", "input_cost_per_token": 2e-06, "litellm_provider": "vertex_ai-ai21_models", "max_input_tokens": 256000, @@ -50717,6 +50670,7 @@ "supports_tool_choice": true }, "vertex_ai/jamba-1.5-mini": { + "deprecation_date": "2026-02-27", "input_cost_per_token": 2e-07, "litellm_provider": "vertex_ai-ai21_models", "max_input_tokens": 256000, @@ -50727,6 +50681,7 @@ "supports_tool_choice": true }, "vertex_ai/jamba-1.5-mini@001": { + "deprecation_date": "2026-02-27", "input_cost_per_token": 2e-07, "litellm_provider": "vertex_ai-ai21_models", "max_input_tokens": 256000, @@ -50889,13 +50844,15 @@ }, "vertex_ai/meta/llama-4-maverick-17b-128e-instruct-maas": { "input_cost_per_token": 3.5e-07, + "input_cost_per_token_batches": 1.75e-07, "litellm_provider": "vertex_ai-llama_models", "max_input_tokens": 1000000, "max_output_tokens": 1000000, "max_tokens": 1000000, "mode": "chat", "output_cost_per_token": 1.15e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#partner-models", + "output_cost_per_token_batches": 5.75e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_modalities": [ "text", "image" @@ -50949,13 +50906,15 @@ }, "vertex_ai/meta/llama-4-scout-17b-16e-instruct-maas": { "input_cost_per_token": 2.5e-07, + "input_cost_per_token_batches": 1.25e-07, "litellm_provider": "vertex_ai-llama_models", "max_input_tokens": 10000000, "max_output_tokens": 10000000, "max_tokens": 10000000, "mode": "chat", "output_cost_per_token": 7e-07, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#partner-models", + "output_cost_per_token_batches": 3.5e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_modalities": [ "text", "image" @@ -51001,6 +50960,8 @@ "supports_tool_choice": true }, "vertex_ai/minimaxai/minimax-m2-maas": { + "cache_read_input_token_cost": 3e-08, + "deprecation_date": "2026-10-21", "input_cost_per_token": 3e-07, "litellm_provider": "vertex_ai-minimax_models", "max_input_tokens": 196608, @@ -51008,11 +50969,13 @@ "max_tokens": 196608, "mode": "chat", "output_cost_per_token": 1.2e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#partner-models", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_tool_choice": true }, "vertex_ai/moonshotai/kimi-k2-thinking-maas": { + "cache_read_input_token_cost": 6e-08, + "deprecation_date": "2026-10-21", "input_cost_per_token": 6e-07, "litellm_provider": "vertex_ai-moonshot_models", "max_input_tokens": 256000, @@ -51020,12 +50983,14 @@ "max_tokens": 256000, "mode": "chat", "output_cost_per_token": 2.5e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#partner-models", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_tool_choice": true, "supports_web_search": true }, "vertex_ai/zai-org/glm-4.7-maas": { + "cache_read_input_token_cost": 6e-08, + "deprecation_date": "2026-10-21", "input_cost_per_token": 6e-07, "litellm_provider": "vertex_ai-zai_models", "max_input_tokens": 200000, @@ -51033,7 +50998,7 @@ "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 2.2e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#partner-models", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_regions": [ "global" ], @@ -51043,6 +51008,7 @@ }, "vertex_ai/zai-org/glm-5-maas": { "cache_read_input_token_cost": 1e-07, + "deprecation_date": "2026-10-21", "input_cost_per_token": 1e-06, "litellm_provider": "vertex_ai-zai_models", "max_input_tokens": 200000, @@ -51050,7 +51016,7 @@ "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 3.2e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#glm-models", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_regions": [ "global" ], @@ -51067,6 +51033,7 @@ "max_tokens": 8191, "mode": "chat", "output_cost_per_token": 2e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_tool_choice": true }, @@ -51078,6 +51045,7 @@ "max_tokens": 8191, "mode": "chat", "output_cost_per_token": 2e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_tool_choice": true }, @@ -51089,6 +51057,7 @@ "max_tokens": 8191, "mode": "chat", "output_cost_per_token": 2e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_tool_choice": true }, @@ -51100,6 +51069,7 @@ "max_tokens": 8191, "mode": "chat", "output_cost_per_token": 2e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_tool_choice": true }, @@ -51180,7 +51150,7 @@ "supports_function_calling": true, "supports_tool_choice": true, "supports_vision": true, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/mistral-small-2503@001": { "input_cost_per_token": 1e-07, @@ -51192,7 +51162,7 @@ "output_cost_per_token": 3e-07, "supports_function_calling": true, "supports_tool_choice": true, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing" + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, "vertex_ai/mistral-ocr-2505": { "litellm_provider": "vertex_ai", @@ -51204,17 +51174,19 @@ "source": "https://cloud.google.com/generative-ai-app-builder/pricing" }, "vertex_ai/deepseek-ai/deepseek-ocr-maas": { + "deprecation_date": "2026-10-21", "litellm_provider": "vertex_ai", "mode": "ocr", "input_cost_per_token": 3e-07, "output_cost_per_token": 1.2e-06, "ocr_cost_per_page": 0.0003, - "source": "https://cloud.google.com/vertex-ai/pricing", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_regions": [ "us-central1" ] }, "vertex_ai/google/gemma-4-26b-a4b-it-maas": { + "cache_read_input_token_cost": 1.5e-08, "input_cost_per_token": 1.5e-07, "litellm_provider": "vertex_ai-openai_models", "max_input_tokens": 262144, @@ -51232,16 +51204,19 @@ }, "vertex_ai/openai/gpt-oss-120b-maas": { "input_cost_per_token": 9e-08, + "input_cost_per_token_batches": 4.5e-08, "litellm_provider": "vertex_ai-openai_models", "max_input_tokens": 131072, "max_output_tokens": 32768, "max_tokens": 32768, "mode": "chat", "output_cost_per_token": 3.6e-07, - "source": "https://console.cloud.google.com/vertex-ai/publishers/openai/model-garden/gpt-oss-120b-maas", + "output_cost_per_token_batches": 1.8e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_reasoning": true }, "vertex_ai/openai/gpt-oss-20b-maas": { + "deprecation_date": "2026-10-21", "input_cost_per_token": 7e-08, "litellm_provider": "vertex_ai-openai_models", "max_input_tokens": 131072, @@ -51249,9 +51224,11 @@ "max_tokens": 32768, "mode": "chat", "output_cost_per_token": 2.5e-07, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_reasoning": true, - "cache_read_input_token_cost": 7e-09 + "cache_read_input_token_cost": 7e-09, + "input_cost_per_token_batches": 3.5e-08, + "output_cost_per_token_batches": 1.25e-07 }, "vertex_ai/xai/grok-4.1-fast-non-reasoning": { "cache_read_input_token_cost": 5e-08, @@ -51262,7 +51239,7 @@ "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 5e-07, - "source": "https://docs.x.ai/developers/models", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_prompt_caching": true, "supports_response_schema": true, @@ -51279,7 +51256,7 @@ "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 5e-07, - "source": "https://docs.x.ai/developers/models", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, @@ -51370,14 +51347,17 @@ "supports_vision": true }, "vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maas": { + "deprecation_date": "2026-10-21", "input_cost_per_token": 2.2e-07, + "input_cost_per_token_batches": 1.1e-07, "litellm_provider": "vertex_ai-qwen_models", "max_input_tokens": 262144, "max_output_tokens": 16384, "max_tokens": 16384, "mode": "chat", "output_cost_per_token": 8.8e-07, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", + "output_cost_per_token_batches": 4.4e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_regions": [ "global", "us-south1" @@ -51386,14 +51366,18 @@ "supports_tool_choice": true }, "vertex_ai/qwen/qwen3-coder-480b-a35b-instruct-maas": { + "cache_read_input_token_cost": 2.2e-08, + "deprecation_date": "2026-10-21", "input_cost_per_token": 2.2e-07, + "input_cost_per_token_batches": 1.1e-07, "litellm_provider": "vertex_ai-qwen_models", "max_input_tokens": 262144, "max_output_tokens": 32768, "max_tokens": 32768, "mode": "chat", "output_cost_per_token": 1.8e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", + "output_cost_per_token_batches": 9e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_regions": [ "global" ], @@ -51401,6 +51385,7 @@ "supports_tool_choice": true }, "vertex_ai/qwen/qwen3-next-80b-a3b-instruct-maas": { + "deprecation_date": "2026-10-21", "input_cost_per_token": 1.5e-07, "litellm_provider": "vertex_ai-qwen_models", "max_input_tokens": 262144, @@ -51408,7 +51393,7 @@ "max_tokens": 262144, "mode": "chat", "output_cost_per_token": 1.2e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_regions": [ "global" ], @@ -51416,6 +51401,7 @@ "supports_tool_choice": true }, "vertex_ai/qwen/qwen3-next-80b-a3b-thinking-maas": { + "deprecation_date": "2026-10-21", "input_cost_per_token": 1.5e-07, "litellm_provider": "vertex_ai-qwen_models", "max_input_tokens": 262144, @@ -51423,58 +51409,13 @@ "max_tokens": 262144, "mode": "chat", "output_cost_per_token": 1.2e-06, - "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing", + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", "supported_regions": [ "global" ], "supports_function_calling": true, "supports_tool_choice": true }, - "vertex_ai/veo-2.0-generate-001": { - "deprecation_date": "2026-06-30", - "litellm_provider": "vertex_ai-video-models", - "max_input_tokens": 1024, - "max_tokens": 1024, - "mode": "video_generation", - "output_cost_per_second": 0.35, - "source": "https://ai.google.dev/gemini-api/docs/video", - "supported_modalities": [ - "text" - ], - "supported_output_modalities": [ - "video" - ] - }, - "vertex_ai/veo-3.0-fast-generate-001": { - "deprecation_date": "2026-06-30", - "litellm_provider": "vertex_ai-video-models", - "max_input_tokens": 1024, - "max_tokens": 1024, - "mode": "video_generation", - "output_cost_per_second": 0.15, - "source": "https://ai.google.dev/gemini-api/docs/video", - "supported_modalities": [ - "text" - ], - "supported_output_modalities": [ - "video" - ] - }, - "vertex_ai/veo-3.0-generate-001": { - "deprecation_date": "2026-06-30", - "litellm_provider": "vertex_ai-video-models", - "max_input_tokens": 1024, - "max_tokens": 1024, - "mode": "video_generation", - "output_cost_per_second": 0.4, - "source": "https://ai.google.dev/gemini-api/docs/video", - "supported_modalities": [ - "text" - ], - "supported_output_modalities": [ - "video" - ] - }, "vertex_ai/veo-3.1-generate-preview": { "litellm_provider": "vertex_ai-video-models", "max_input_tokens": 1024, @@ -51573,6 +51514,26 @@ "mode": "rerank", "output_cost_per_token": 0.0 }, + "voyage/rerank-1": { + "input_cost_per_token": 5e-08, + "litellm_provider": "voyage", + "max_input_tokens": 8000, + "max_output_tokens": 8000, + "max_tokens": 8000, + "mode": "rerank", + "output_cost_per_token": 0.0, + "source": "https://docs.voyageai.com/docs/pricing" + }, + "voyage/rerank-lite-1": { + "input_cost_per_token": 2e-08, + "litellm_provider": "voyage", + "max_input_tokens": 4000, + "max_output_tokens": 4000, + "max_tokens": 4000, + "mode": "rerank", + "output_cost_per_token": 0.0, + "source": "https://docs.voyageai.com/docs/pricing" + }, "voyage/rerank-2.5": { "input_cost_per_token": 5e-08, "litellm_provider": "voyage", @@ -51709,6 +51670,16 @@ "mode": "embedding", "output_cost_per_token": 0.0 }, + "voyage/voyage-large-2-instruct": { + "input_cost_per_token": 1.2e-07, + "litellm_provider": "voyage", + "max_input_tokens": 16000, + "max_tokens": 16000, + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 1024, + "source": "https://docs.voyageai.com/docs/pricing" + }, "voyage/voyage-law-2": { "input_cost_per_token": 1.2e-07, "litellm_provider": "voyage", @@ -51763,59 +51734,6 @@ "mode": "chat", "source": "https://wandb.ai/site/pricing/tokens/" }, - "wandb/zai-org/GLM-4.5": { - "deprecation_date": "2026-03-04", - "supports_reasoning": true, - "max_tokens": 131072, - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "input_cost_per_token": 0.055, - "output_cost_per_token": 0.2, - "litellm_provider": "wandb", - "mode": "chat" - }, - "wandb/Qwen/Qwen3-235B-A22B-Instruct-2507": { - "deprecation_date": "2026-08-04", - "max_tokens": 262144, - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 1e-07, - "litellm_provider": "wandb", - "mode": "chat" - }, - "wandb/Qwen/Qwen3-Coder-480B-A35B-Instruct": { - "deprecation_date": "2026-08-25", - "max_tokens": 262144, - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "input_cost_per_token": 1e-06, - "output_cost_per_token": 1.5e-06, - "litellm_provider": "wandb", - "mode": "chat", - "source": "https://wandb.ai/site/pricing/tokens/" - }, - "wandb/Qwen/Qwen3-235B-A22B-Thinking-2507": { - "deprecation_date": "2026-08-04", - "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 1e-07, - "litellm_provider": "wandb", - "mode": "chat" - }, - "wandb/moonshotai/Kimi-K2-Instruct": { - "deprecation_date": "2026-03-04", - "max_tokens": 128000, - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.5e-06, - "litellm_provider": "wandb", - "mode": "chat" - }, "wandb/moonshotai/Kimi-K2.5": { "max_tokens": 262144, "max_input_tokens": 262144, @@ -51831,20 +51749,6 @@ "supports_response_schema": true, "supports_vision": true }, - "wandb/MiniMaxAI/MiniMax-M2.5": { - "deprecation_date": "2026-08-25", - "max_tokens": 197000, - "max_input_tokens": 197000, - "max_output_tokens": 197000, - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, - "litellm_provider": "wandb", - "mode": "chat", - "source": "https://wandb.ai/inference/coreweave/cw_MiniMaxAI_MiniMax-M2.5", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true - }, "wandb/meta-llama/Llama-3.1-8B-Instruct": { "max_tokens": 128000, "max_input_tokens": 131000, @@ -51866,27 +51770,6 @@ "mode": "chat", "source": "https://wandb.ai/site/pricing/tokens/" }, - "wandb/deepseek-ai/DeepSeek-R1-0528": { - "deprecation_date": "2026-03-04", - "supports_reasoning": true, - "max_tokens": 161000, - "max_input_tokens": 161000, - "max_output_tokens": 161000, - "input_cost_per_token": 1.35e-06, - "output_cost_per_token": 5.4e-06, - "litellm_provider": "wandb", - "mode": "chat" - }, - "wandb/deepseek-ai/DeepSeek-V3-0324": { - "deprecation_date": "2026-03-04", - "max_tokens": 161000, - "max_input_tokens": 161000, - "max_output_tokens": 161000, - "input_cost_per_token": 1.14e-06, - "output_cost_per_token": 2.75e-06, - "litellm_provider": "wandb", - "mode": "chat" - }, "wandb/meta-llama/Llama-3.3-70B-Instruct": { "max_tokens": 128000, "max_input_tokens": 128000, @@ -51897,26 +51780,6 @@ "mode": "chat", "source": "https://wandb.ai/site/pricing/tokens/" }, - "wandb/meta-llama/Llama-4-Scout-17B-16E-Instruct": { - "deprecation_date": "2026-04-21", - "max_tokens": 64000, - "max_input_tokens": 64000, - "max_output_tokens": 64000, - "input_cost_per_token": 1.7e-07, - "output_cost_per_token": 6.6e-07, - "litellm_provider": "wandb", - "mode": "chat" - }, - "wandb/microsoft/Phi-4-mini-instruct": { - "deprecation_date": "2026-08-04", - "max_tokens": 128000, - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "input_cost_per_token": 0.008, - "output_cost_per_token": 0.035, - "litellm_provider": "wandb", - "mode": "chat" - }, "watsonx/ibm/granite-3-8b-instruct": { "input_cost_per_token": 2e-07, "litellm_provider": "watsonx", @@ -52317,787 +52180,349 @@ "deprecation_date": "2027-02-26", "source": "https://developers.openai.com/api/docs/pricing" }, - "xai/grok-3": { + "xai/grok-4.20-multi-agent-beta-0309": { "cache_read_input_token_cost": 2e-07, "input_cost_per_token": 1.25e-06, "litellm_provider": "xai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "responses", "output_cost_per_token": 2.5e-06, - "source": "https://x.ai/api#pricing", + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, "supports_prompt_caching": true, - "supports_response_schema": false, + "supports_reasoning": true, "supports_tool_choice": true, + "supports_vision": true, "supports_web_search": true, - "deprecation_date": "2026-05-15", "input_cost_per_token_above_200k_tokens": 2.5e-06, "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true, + "supported_endpoints": [ + "/v1/responses" + ] }, - "xai/grok-3-beta": { + "xai/grok-4.20-beta-0309-reasoning": { "cache_read_input_token_cost": 2e-07, "input_cost_per_token": 1.25e-06, "litellm_provider": "xai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", "output_cost_per_token": 2.5e-06, - "source": "https://x.ai/api#pricing", + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, "supports_prompt_caching": true, - "supports_response_schema": false, + "supports_reasoning": true, "supports_tool_choice": true, + "supports_vision": true, "supports_web_search": true, - "deprecation_date": "2026-05-15", "input_cost_per_token_above_200k_tokens": 2.5e-06, "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true }, - "xai/grok-3-fast-beta": { + "xai/grok-4.20-0309-reasoning": { "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, "input_cost_per_token": 1.25e-06, + "input_cost_per_token_batches": 1e-06, "litellm_provider": "xai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", "output_cost_per_token": 2.5e-06, - "source": "https://x.ai/api#pricing", + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": false, + "supports_reasoning": true, "supports_tool_choice": true, + "supports_vision": true, "supports_web_search": true, - "deprecation_date": "2026-05-15", "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "output_cost_per_token_above_200k_tokens_batches": 4e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true }, - "xai/grok-3-fast-latest": { + "xai/grok-4.20-beta-0309-non-reasoning": { "cache_read_input_token_cost": 2e-07, "input_cost_per_token": 1.25e-06, "litellm_provider": "xai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", "output_cost_per_token": 2.5e-06, - "source": "https://x.ai/api#pricing", + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, "supports_prompt_caching": true, - "supports_response_schema": false, "supports_tool_choice": true, + "supports_vision": true, "supports_web_search": true, - "deprecation_date": "2026-05-15", "input_cost_per_token_above_200k_tokens": 2.5e-06, "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true }, - "xai/grok-3-latest": { + "xai/grok-4.3": { "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, + "input_cost_per_image_token": 1.25e-06, "input_cost_per_token": 1.25e-06, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, + "input_cost_per_token_batches": 1e-06, "litellm_provider": "xai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", "output_cost_per_token": 2.5e-06, - "source": "https://x.ai/api#pricing", + "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, "supports_prompt_caching": true, - "supports_response_schema": false, + "supports_reasoning": true, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_web_search": true, - "deprecation_date": "2026-05-15", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "supports_vision": true, + "supports_web_search": true }, - "xai/grok-3-mini": { + "xai/grok-4.3-latest": { "cache_read_input_token_cost": 2e-07, - "deprecation_date": "2026-02-28", + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, + "input_cost_per_image_token": 1.25e-06, "input_cost_per_token": 1.25e-06, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, + "input_cost_per_token_batches": 1e-06, "litellm_provider": "xai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", "output_cost_per_token": 2.5e-06, - "source": "https://x.ai/api#pricing", + "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_web_search": true, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "supports_vision": true, + "supports_web_search": true }, - "xai/grok-3-mini-beta": { - "cache_read_input_token_cost": 2e-07, - "deprecation_date": "2026-02-28", - "input_cost_per_token": 1.25e-06, + "xai/grok-4.5": { + "cache_read_input_token_cost": 3e-07, + "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "input_cost_per_image_token": 2e-06, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, "litellm_provider": "xai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://x.ai/api#pricing", + "output_cost_per_token": 6e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_web_search": true, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "supports_vision": true, + "supports_web_search": true }, - "xai/grok-3-mini-fast": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, + "xai/grok-4.5-latest": { + "cache_read_input_token_cost": 3e-07, + "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "input_cost_per_image_token": 2e-06, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, "litellm_provider": "xai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://x.ai/api#pricing", + "output_cost_per_token": 6e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_web_search": true, - "deprecation_date": "2026-02-28", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "supports_vision": true, + "supports_web_search": true }, - "xai/grok-3-mini-fast-beta": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, + "xai/grok-build-latest": { + "cache_read_input_token_cost": 3e-07, + "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "input_cost_per_image_token": 2e-06, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, "litellm_provider": "xai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://x.ai/api#pricing", + "output_cost_per_token": 6e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_web_search": true, - "deprecation_date": "2026-02-28", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "supports_vision": true, + "supports_web_search": true }, - "xai/grok-3-mini-fast-latest": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, + "xai/grok-4.6": { + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_200k_tokens": 1e-06, + "input_cost_per_image_token": 2e-06, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, "litellm_provider": "xai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://x.ai/api#pricing", + "output_cost_per_token": 6e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_web_search": true, - "deprecation_date": "2026-02-28", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "supports_vision": true, + "supports_web_search": true }, - "xai/grok-3-mini-latest": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, + "xai/grok-4.7": { + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_200k_tokens": 1e-06, + "input_cost_per_image_token": 2e-06, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, "litellm_provider": "xai", - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://x.ai/api#pricing", + "output_cost_per_token": 6e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_web_search": true, - "deprecation_date": "2026-02-28", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "supports_vision": true, + "supports_web_search": true }, - "xai/grok-4": { - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, + "zai.glm-4.7": { + "input_cost_per_token": 6e-07, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 203000, + "max_output_tokens": 4000, + "max_tokens": 4000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", + "output_cost_per_token": 2.2e-06, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_system_messages": true, "supports_tool_choice": true, - "supports_web_search": true, - "deprecation_date": "2026-05-15", - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, - "xai/grok-4-fast-reasoning": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 2000000.0, - "max_output_tokens": 2000000.0, - "max_tokens": 2000000.0, + "zai.glm-5": { + "input_cost_per_token": 1e-06, + "output_cost_per_token": 3.2e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 200000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_native_structured_output": true, + "supports_system_messages": true, "supports_tool_choice": true, - "supports_web_search": true, - "deprecation_date": "2026-05-15", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, - "xai/grok-4-fast-non-reasoning": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 2000000.0, - "max_output_tokens": 2000000.0, - "max_tokens": 2000000.0, + "zai.glm-4.7-flash": { + "input_cost_per_token": 7e-08, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 203000, + "max_output_tokens": 4000, + "max_tokens": 4000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", + "output_cost_per_token": 4e-07, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_system_messages": true, "supports_tool_choice": true, - "supports_web_search": true, - "deprecation_date": "2026-05-15", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, - "xai/grok-4-0709": { - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, + "zai/glm-5": { + "cache_creation_input_token_cost": 0, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1e-06, + "output_cost_per_token": 3.2e-06, + "litellm_provider": "zai", + "max_input_tokens": 200000, + "max_output_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", "supports_function_calling": true, "supports_prompt_caching": true, + "supports_reasoning": true, "supports_tool_choice": true, - "supports_web_search": true, - "deprecation_date": "2026-05-15", - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 + "source": "https://docs.z.ai/guides/overview/pricing" }, - "xai/grok-4-latest": { - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, + "zai/glm-5.3": { + "cache_creation_input_token_cost": 0, + "cache_read_input_token_cost": 2.6e-07, + "input_cost_per_token": 1.4e-06, + "litellm_provider": "zai", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", + "output_cost_per_token": 4.4e-06, + "source": "https://docs.z.ai/guides/overview/pricing", "supports_function_calling": true, "supports_prompt_caching": true, - "supports_tool_choice": true, - "supports_web_search": true, - "deprecation_date": "2026-05-15", - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 - }, - "xai/grok-4-1-fast": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 2000000.0, - "max_output_tokens": 2000000.0, - "max_tokens": 2000000.0, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models/grok-4-1-fast-reasoning", - "supports_audio_input": true, - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "deprecation_date": "2026-05-15", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 - }, - "xai/grok-4-1-fast-reasoning": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 2000000.0, - "max_output_tokens": 2000000.0, - "max_tokens": 2000000.0, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models/grok-4-1-fast-reasoning", - "supports_audio_input": true, - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "deprecation_date": "2026-05-15", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 - }, - "xai/grok-4-1-fast-reasoning-latest": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 2000000.0, - "max_output_tokens": 2000000.0, - "max_tokens": 2000000.0, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models/grok-4-1-fast-reasoning", - "supports_audio_input": true, - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "deprecation_date": "2026-05-15", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 - }, - "xai/grok-4-1-fast-non-reasoning": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 2000000.0, - "max_output_tokens": 2000000.0, - "max_tokens": 2000000.0, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models/grok-4-1-fast-non-reasoning", - "supports_audio_input": true, - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "deprecation_date": "2026-05-15", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 - }, - "xai/grok-4-1-fast-non-reasoning-latest": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 2000000.0, - "max_output_tokens": 2000000.0, - "max_tokens": 2000000.0, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models/grok-4-1-fast-non-reasoning", - "supports_audio_input": true, - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "deprecation_date": "2026-05-15", - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07 - }, - "xai/grok-4.20-multi-agent-beta-0309": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, - "mode": "responses", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true, - "supported_endpoints": [ - "/v1/responses" - ] - }, - "xai/grok-4.20-beta-0309-reasoning": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true - }, - "xai/grok-4.20-0309-reasoning": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_prompt_caching": true, - "supports_response_schema": true - }, - "xai/grok-4.20-beta-0309-non-reasoning": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true - }, - "xai/grok-4.3": { - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "input_cost_per_token": 1.25e-06, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true - }, - "xai/grok-4.3-latest": { - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "input_cost_per_token": 1.25e-06, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, - "mode": "chat", - "output_cost_per_token": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true - }, - "xai/grok-4.5": { - "cache_read_input_token_cost": 3e-07, - "cache_read_input_token_cost_above_200k_tokens": 6e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "litellm_provider": "xai", - "max_input_tokens": 500000, - "max_output_tokens": 500000, - "max_tokens": 500000, - "mode": "chat", - "output_cost_per_token": 6e-06, - "output_cost_per_token_above_200k_tokens": 1.2e-05, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true - }, - "xai/grok-4.5-latest": { - "cache_read_input_token_cost": 3e-07, - "cache_read_input_token_cost_above_200k_tokens": 6e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "litellm_provider": "xai", - "max_input_tokens": 500000, - "max_output_tokens": 500000, - "max_tokens": 500000, - "mode": "chat", - "output_cost_per_token": 6e-06, - "output_cost_per_token_above_200k_tokens": 1.2e-05, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true - }, - "xai/grok-build-latest": { - "cache_read_input_token_cost": 3e-07, - "cache_read_input_token_cost_above_200k_tokens": 6e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "litellm_provider": "xai", - "max_input_tokens": 500000, - "max_output_tokens": 500000, - "max_tokens": 500000, - "mode": "chat", - "output_cost_per_token": 6e-06, - "output_cost_per_token_above_200k_tokens": 1.2e-05, - "source": "https://docs.x.ai/developers/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true - }, - "xai/grok-4.6": { - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_above_200k_tokens": 1e-06, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "litellm_provider": "xai", - "max_input_tokens": 500000, - "max_output_tokens": 500000, - "max_tokens": 500000, - "mode": "chat", - "output_cost_per_token": 6e-06, - "output_cost_per_token_above_200k_tokens": 1.2e-05, - "source": "https://docs.x.ai/developers/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true - }, - "xai/grok-code-fast": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1e-06, - "litellm_provider": "xai", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "input_cost_per_token_above_200k_tokens": 2e-06, - "output_cost_per_token_above_200k_tokens": 4e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true, - "supports_vision": true, - "deprecation_date": "2026-05-15" - }, - "xai/grok-code-fast-1": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1e-06, - "litellm_provider": "xai", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "input_cost_per_token_above_200k_tokens": 2e-06, - "output_cost_per_token_above_200k_tokens": 4e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true, - "supports_vision": true, - "deprecation_date": "2026-05-15" - }, - "xai/grok-code-fast-1-0825": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1e-06, - "litellm_provider": "xai", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "input_cost_per_token_above_200k_tokens": 2e-06, - "output_cost_per_token_above_200k_tokens": 4e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true, - "supports_vision": true, - "deprecation_date": "2026-05-15" - }, - "zai.glm-4.7": { - "input_cost_per_token": 6e-07, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 200000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 2.2e-06, - "supports_function_calling": true, - "supports_reasoning": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "source": "https://aws.amazon.com/bedrock/pricing/" - }, - "zai.glm-5": { - "input_cost_per_token": 1e-06, - "output_cost_per_token": 3.2e-06, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 200000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_native_structured_output": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "source": "https://aws.amazon.com/bedrock/pricing/" - }, - "zai.glm-4.7-flash": { - "input_cost_per_token": 7e-08, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 200000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 4e-07, - "supports_function_calling": true, - "supports_reasoning": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "source": "https://aws.amazon.com/bedrock/pricing/" - }, - "zai/glm-5": { - "cache_creation_input_token_cost": 0, - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1e-06, - "output_cost_per_token": 3.2e-06, - "litellm_provider": "zai", - "max_input_tokens": 200000, - "max_output_tokens": 128000, - "mode": "chat", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "source": "https://docs.z.ai/guides/overview/pricing" - }, - "zai/glm-5.3": { - "cache_creation_input_token_cost": 0, - "cache_read_input_token_cost": 2.6e-07, - "input_cost_per_token": 1.4e-06, - "litellm_provider": "zai", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 4.4e-06, - "source": "https://docs.z.ai/guides/overview/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_tool_choice": true + "supports_reasoning": true, + "supports_tool_choice": true }, "zai/glm-5.3-flash": { "cache_creation_input_token_cost": 0, @@ -53308,6 +52733,7 @@ }, "openai/sora-2-pro-high-res": { "litellm_provider": "openai", + "deprecation_date": "2026-09-24", "mode": "video_generation", "output_cost_per_video_per_second": 0.5, "source": "https://platform.openai.com/docs/api-reference/videos", @@ -55463,5027 +54889,9237 @@ "litellm_provider": "fireworks_ai", "mode": "chat" }, - "fireworks_ai/accounts/fireworks/models/qwen3-vl-8b-instruct": { - "max_tokens": 4096, - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" + "fireworks_ai/accounts/fireworks/models/qwen3-vl-8b-instruct": { + "max_tokens": 4096, + "max_input_tokens": 4096, + "max_output_tokens": 4096, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/qwen3p7-plus": { + "cache_read_input_token_cost": 8e-08, + "input_cost_per_token": 4e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 1.6e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "fireworks_ai/accounts/fireworks/models/qwq-32b": { + "max_tokens": 131072, + "max_input_tokens": 131072, + "max_output_tokens": 131072, + "input_cost_per_token": 9e-07, + "output_cost_per_token": 9e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/rolm-ocr": { + "max_tokens": 128000, + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/snorkel-mistral-7b-pairrm-dpo": { + "max_tokens": 32768, + "max_input_tokens": 32768, + "max_output_tokens": 32768, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/stable-diffusion-xl-1024-v1-0": { + "max_tokens": 4096, + "max_input_tokens": 4096, + "max_output_tokens": 4096, + "input_cost_per_token": 1.3e-10, + "output_cost_per_token": 1.3e-10, + "litellm_provider": "fireworks_ai", + "mode": "image_generation" + }, + "fireworks_ai/accounts/fireworks/models/stablecode-3b": { + "max_tokens": 4096, + "max_input_tokens": 4096, + "max_output_tokens": 4096, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 1e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/starcoder-16b": { + "max_tokens": 8192, + "max_input_tokens": 8192, + "max_output_tokens": 8192, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/starcoder-7b": { + "max_tokens": 8192, + "max_input_tokens": 8192, + "max_output_tokens": 8192, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/starcoder2-15b": { + "max_tokens": 16384, + "max_input_tokens": 16384, + "max_output_tokens": 16384, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/starcoder2-3b": { + "max_tokens": 16384, + "max_input_tokens": 16384, + "max_output_tokens": 16384, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 1e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/starcoder2-7b": { + "max_tokens": 16384, + "max_input_tokens": 16384, + "max_output_tokens": 16384, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/toppy-m-7b": { + "max_tokens": 32768, + "max_input_tokens": 32768, + "max_output_tokens": 32768, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/yi-34b": { + "max_tokens": 4096, + "max_input_tokens": 4096, + "max_output_tokens": 4096, + "input_cost_per_token": 9e-07, + "output_cost_per_token": 9e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/yi-34b-200k-capybara": { + "max_tokens": 200000, + "max_input_tokens": 200000, + "max_output_tokens": 200000, + "input_cost_per_token": 9e-07, + "output_cost_per_token": 9e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/yi-34b-chat": { + "max_tokens": 4096, + "max_input_tokens": 4096, + "max_output_tokens": 4096, + "input_cost_per_token": 9e-07, + "output_cost_per_token": 9e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/yi-6b": { + "max_tokens": 4096, + "max_input_tokens": 4096, + "max_output_tokens": 4096, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/models/zephyr-7b-beta": { + "max_tokens": 32768, + "max_input_tokens": 32768, + "max_output_tokens": 32768, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "fireworks_ai", + "mode": "chat" + }, + "fireworks_ai/accounts/fireworks/routers/glm-5p1-fast": { + "cache_read_input_token_cost": 5.2e-07, + "input_cost_per_token": 2.8e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 202800, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 8.8e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false + }, + "fireworks_ai/accounts/fireworks/routers/kimi-k2p6-fast": { + "cache_read_input_token_cost": 3e-07, + "deprecation_date": "2026-08-27", + "input_cost_per_token": 2e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 8e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "fireworks_ai/accounts/fireworks/routers/kimi-k2p7-code-fast": { + "cache_read_input_token_cost": 3.8e-07, + "deprecation_date": "2026-08-27", + "input_cost_per_token": 1.9e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 8e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "scaleway/qwen/qwen3.5-397b-a17b": { + "input_cost_per_token": 6e-07, + "litellm_provider": "scaleway", + "max_input_tokens": 256000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 3.6e-06, + "supports_function_calling": true, + "supports_reasoning": true, + "supports_vision": true + }, + "scaleway/qwen/qwen3.6-35b-a3b": { + "input_cost_per_token": 2.5e-07, + "litellm_provider": "scaleway", + "max_input_tokens": 256000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 1.5e-06, + "supports_function_calling": true, + "supports_vision": true, + "supports_reasoning": true + }, + "scaleway/qwen/qwen3-235b-a22b-instruct-2507": { + "input_cost_per_token": 7.5e-07, + "litellm_provider": "scaleway", + "max_input_tokens": 256000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 2.25e-06, + "supports_function_calling": true + }, + "scaleway/qwen/qwen3-embedding-8b": { + "input_cost_per_token": 1e-07, + "litellm_provider": "scaleway", + "mode": "embedding", + "output_cost_per_token": 0.0 + }, + "scaleway/qwen/qwen3-coder-30b-a3b-instruct": { + "input_cost_per_token": 2e-07, + "litellm_provider": "scaleway", + "max_input_tokens": 128000, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 8e-07, + "supports_function_calling": true, + "deprecation_date": "2026-10-01" + }, + "scaleway/openai/gpt-oss-120b": { + "input_cost_per_token": 1.5e-07, + "litellm_provider": "scaleway", + "max_input_tokens": 128000, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 6e-07, + "supports_function_calling": true + }, + "scaleway/openai/whisper-large-v3": { + "input_cost_per_audio_token": 0.0, + "litellm_provider": "scaleway", + "mode": "audio_transcription", + "output_cost_per_token": 0.0 + }, + "scaleway/google/gemma-4-26b-a4b-it": { + "input_cost_per_token": 2.5e-07, + "litellm_provider": "scaleway", + "max_input_tokens": 256000, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 5e-07, + "supports_function_calling": true, + "supports_reasoning": true, + "supports_vision": true + }, + "scaleway/mistralai/mistral-medium-3.5-128b": { + "input_cost_per_token": 1.5e-06, + "litellm_provider": "scaleway", + "max_input_tokens": 256000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 7.5e-06, + "supports_reasoning": true, + "supports_function_calling": true, + "supports_vision": true, + "supports_tool_choice": true + }, + "scaleway/mistralai/mistral-small-3.2-24b-instruct-2506": { + "input_cost_per_token": 1.5e-07, + "litellm_provider": "scaleway", + "max_input_tokens": 128000, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 3.5e-07, + "supports_function_calling": true, + "supports_vision": true + }, + "scaleway/mistralai/pixtral-12b-2409": { + "input_cost_per_token": 2e-07, + "litellm_provider": "scaleway", + "max_input_tokens": 128000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 2e-07, + "supports_vision": true, + "supports_function_calling": true, + "deprecation_date": "2026-10-01" + }, + "scaleway/BAAI/bge-multilingual-gemma2": { + "input_cost_per_token": 1e-07, + "litellm_provider": "scaleway", + "mode": "embedding", + "output_cost_per_token": 0.0 + }, + "scaleway/meta/llama-3.3-70b-instruct": { + "input_cost_per_token": 9e-07, + "litellm_provider": "scaleway", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 9e-07, + "supports_function_calling": true + }, + "novita/deepseek/deepseek-v3.2": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2.69e-07, + "output_cost_per_token": 4e-07, + "max_input_tokens": 163840, + "max_output_tokens": 65536, + "max_tokens": 65536, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 1.345e-07, + "input_cost_per_token_cache_hit": 1.345e-07, + "supports_reasoning": true + }, + "novita/minimax/minimax-m2.1": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3e-07, + "output_cost_per_token": 1.2e-06, + "max_input_tokens": 204800, + "max_output_tokens": 131072, + "max_tokens": 131072, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token_cache_hit": 3e-08 + }, + "novita/zai-org/glm-4.7": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 6e-07, + "output_cost_per_token": 2.2e-06, + "max_input_tokens": 204800, + "max_output_tokens": 131072, + "max_tokens": 131072, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 1.1e-07, + "input_cost_per_token_cache_hit": 1.1e-07, + "supports_reasoning": true + }, + "novita/xiaomimimo/mimo-v2-flash": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.1e-07, + "output_cost_per_token": 3.3e-07, + "max_input_tokens": 262144, + "max_output_tokens": 32000, + "max_tokens": 32000, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 2.4e-08, + "input_cost_per_token_cache_hit": 2.4e-08, + "supports_reasoning": true + }, + "novita/zai-org/autoglm-phone-9b-multilingual": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3.5e-08, + "output_cost_per_token": 1.38e-07, + "max_input_tokens": 65536, + "max_output_tokens": 65536, + "max_tokens": 65536, + "supports_vision": true, + "supports_system_messages": true + }, + "novita/moonshotai/kimi-k2-thinking": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 6e-07, + "output_cost_per_token": 2.5e-06, + "max_input_tokens": 262144, + "max_output_tokens": 100352, + "max_tokens": 100352, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_reasoning": true, + "cache_read_input_token_cost": 1.5e-07, + "supports_prompt_caching": true + }, + "novita/minimax/minimax-m2": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3e-07, + "output_cost_per_token": 1.2e-06, + "max_input_tokens": 204800, + "max_output_tokens": 131072, + "max_tokens": 131072, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token_cache_hit": 3e-08, + "supports_reasoning": true, + "supports_response_schema": true + }, + "novita/paddlepaddle/paddleocr-vl": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2e-08, + "output_cost_per_token": 2e-08, + "max_input_tokens": 16384, + "max_output_tokens": 16384, + "max_tokens": 16384, + "supports_vision": true, + "supports_system_messages": true + }, + "novita/deepseek/deepseek-v3.2-exp": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2.7e-07, + "output_cost_per_token": 4.1e-07, + "max_input_tokens": 163840, + "max_output_tokens": 65536, + "max_tokens": 65536, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "novita/qwen/qwen3-vl-235b-a22b-thinking": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 9.8e-07, + "output_cost_per_token": 3.95e-06, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_vision": true, + "supports_system_messages": true, + "supports_reasoning": true, + "supports_function_calling": true, + "supports_tool_choice": true + }, + "novita/zai-org/glm-4.6v": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3e-07, + "output_cost_per_token": 9e-07, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 5.5e-08, + "input_cost_per_token_cache_hit": 5.5e-08, + "supports_reasoning": true + }, + "novita/zai-org/glm-4.6": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 5.5e-07, + "output_cost_per_token": 2.2e-06, + "max_input_tokens": 204800, + "max_output_tokens": 131072, + "max_tokens": 131072, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 1.1e-07, + "input_cost_per_token_cache_hit": 1.1e-07, + "supports_reasoning": true + }, + "novita/kwaipilot/kat-coder-pro": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3e-07, + "output_cost_per_token": 1.2e-06, + "max_input_tokens": 256000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 6e-08, + "input_cost_per_token_cache_hit": 6e-08 + }, + "novita/qwen/qwen3-next-80b-a3b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 1.5e-06, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "novita/qwen/qwen3-next-80b-a3b-thinking": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 1.5e-06, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "novita/deepseek/deepseek-ocr": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3e-08, + "output_cost_per_token": 3e-08, + "max_input_tokens": 8192, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/deepseek/deepseek-v3.1-terminus": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2.7e-07, + "output_cost_per_token": 1e-06, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 1.35e-07, + "input_cost_per_token_cache_hit": 1.35e-07, + "supports_reasoning": true + }, + "novita/qwen/qwen3-vl-235b-a22b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3e-07, + "output_cost_per_token": 1.5e-06, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/qwen/qwen3-max": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2.11e-06, + "output_cost_per_token": 8.45e-06, + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/skywork/r1v4-lite": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2e-07, + "output_cost_per_token": 6e-07, + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/deepseek/deepseek-v3.1": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2.7e-07, + "output_cost_per_token": 1e-06, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 1.35e-07, + "input_cost_per_token_cache_hit": 1.35e-07, + "supports_reasoning": true + }, + "novita/moonshotai/kimi-k2-0905": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 6e-07, + "output_cost_per_token": 2.5e-06, + "max_input_tokens": 262144, + "max_output_tokens": 100352, + "max_tokens": 100352, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/qwen/qwen3-coder-480b-a35b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3.8e-07, + "output_cost_per_token": 1.55e-06, + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/qwen/qwen3-coder-30b-a3b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 7e-08, + "output_cost_per_token": 2.7e-07, + "max_input_tokens": 160000, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/openai/gpt-oss-120b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 5e-08, + "output_cost_per_token": 2.5e-07, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "novita/moonshotai/kimi-k2-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 5.7e-07, + "output_cost_per_token": 2.3e-06, + "max_input_tokens": 131072, + "max_output_tokens": 100352, + "max_tokens": 100352, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/deepseek/deepseek-v3-0324": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2.7e-07, + "output_cost_per_token": 1.12e-06, + "max_input_tokens": 163840, + "max_output_tokens": 65536, + "max_tokens": 65536, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 1.35e-07, + "input_cost_per_token_cache_hit": 1.35e-07 + }, + "novita/zai-org/glm-4.5": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 6e-07, + "output_cost_per_token": 2.2e-06, + "max_input_tokens": 131072, + "max_output_tokens": 98304, + "max_tokens": 98304, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "cache_read_input_token_cost": 1.1e-07, + "input_cost_per_token_cache_hit": 1.1e-07, + "supports_reasoning": true + }, + "novita/qwen/qwen3-235b-a22b-thinking-2507": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3e-07, + "output_cost_per_token": 3e-06, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_reasoning": true + }, + "novita/meta-llama/llama-3.1-8b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2e-08, + "output_cost_per_token": 5e-08, + "max_input_tokens": 16384, + "max_output_tokens": 16384, + "max_tokens": 16384, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/google/gemma-3-12b-it": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 5e-08, + "output_cost_per_token": 1e-07, + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/zai-org/glm-4.5v": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 6e-07, + "output_cost_per_token": 1.8e-06, + "max_input_tokens": 65536, + "max_output_tokens": 16384, + "max_tokens": 16384, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 1.1e-07, + "input_cost_per_token_cache_hit": 1.1e-07, + "supports_reasoning": true + }, + "novita/openai/gpt-oss-20b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 4e-08, + "output_cost_per_token": 1.5e-07, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_tool_choice": true, + "supports_vision": false, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "novita/qwen/qwen3-235b-a22b-instruct-2507": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 9e-08, + "output_cost_per_token": 5.8e-07, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/deepseek/deepseek-r1-distill-qwen-14b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 1.5e-07, + "max_input_tokens": 32768, + "max_output_tokens": 16384, + "max_tokens": 16384, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "novita/meta-llama/llama-3.3-70b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.35e-07, + "output_cost_per_token": 4e-07, + "max_input_tokens": 12288, + "max_output_tokens": 12288, + "max_tokens": 12288, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/qwen/qwen-2.5-72b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3.8e-07, + "output_cost_per_token": 4e-07, + "max_input_tokens": 32000, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/mistralai/mistral-nemo": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 4e-08, + "output_cost_per_token": 1.7e-07, + "max_input_tokens": 60288, + "max_output_tokens": 16000, + "max_tokens": 16000, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/minimaxai/minimax-m1-80k": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 5.5e-07, + "output_cost_per_token": 2.2e-06, + "max_input_tokens": 1000000, + "max_output_tokens": 40000, + "max_tokens": 40000, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_reasoning": true, + "supports_response_schema": true + }, + "novita/deepseek/deepseek-r1-0528": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 7e-07, + "output_cost_per_token": 2.5e-06, + "max_input_tokens": 163840, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "cache_read_input_token_cost": 3.5e-07, + "input_cost_per_token_cache_hit": 3.5e-07, + "supports_reasoning": true + }, + "novita/deepseek/deepseek-r1-distill-qwen-32b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3e-07, + "output_cost_per_token": 3e-07, + "max_input_tokens": 64000, + "max_output_tokens": 32000, + "max_tokens": 32000, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "novita/meta-llama/llama-3-8b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 4e-08, + "output_cost_per_token": 4e-08, + "max_input_tokens": 8192, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/microsoft/wizardlm-2-8x22b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 6.2e-07, + "output_cost_per_token": 6.2e-07, + "max_input_tokens": 65535, + "max_output_tokens": 8000, + "max_tokens": 8000, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/deepseek/deepseek-r1-0528-qwen3-8b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 6e-08, + "output_cost_per_token": 9e-08, + "max_input_tokens": 128000, + "max_output_tokens": 32000, + "max_tokens": 32000, + "supports_system_messages": true, + "supports_reasoning": true + }, + "novita/deepseek/deepseek-r1-distill-llama-70b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 8e-07, + "output_cost_per_token": 8e-07, + "max_input_tokens": 8192, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "novita/meta-llama/llama-3-70b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 5.1e-07, + "output_cost_per_token": 7.4e-07, + "max_input_tokens": 8192, + "max_output_tokens": 8000, + "max_tokens": 8000, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/qwen/qwen3-235b-a22b-fp8": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2e-07, + "output_cost_per_token": 8e-07, + "max_input_tokens": 40960, + "max_output_tokens": 20000, + "max_tokens": 20000, + "supports_system_messages": true, + "supports_reasoning": true, + "supports_response_schema": true + }, + "novita/meta-llama/llama-4-maverick-17b-128e-instruct-fp8": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2.7e-07, + "output_cost_per_token": 8.5e-07, + "max_input_tokens": 1048576, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/meta-llama/llama-4-scout-17b-16e-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.8e-07, + "output_cost_per_token": 5.9e-07, + "max_input_tokens": 131072, + "max_output_tokens": 131072, + "max_tokens": 131072, + "supports_vision": true, + "supports_system_messages": true + }, + "novita/nousresearch/hermes-2-pro-llama-3-8b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.4e-07, + "output_cost_per_token": 1.4e-07, + "max_input_tokens": 8192, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/qwen/qwen2.5-vl-72b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 8e-07, + "output_cost_per_token": 8e-07, + "max_input_tokens": 32768, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_vision": true, + "supports_system_messages": true + }, + "novita/sao10k/l3-70b-euryale-v2.1": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.48e-06, + "output_cost_per_token": 1.48e-06, + "max_input_tokens": 8192, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true + }, + "novita/baidu/ernie-4.5-21B-a3b-thinking": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 7e-08, + "output_cost_per_token": 2.8e-07, + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "supports_system_messages": true, + "supports_reasoning": true + }, + "novita/sao10k/l3-8b-lunaris": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 5e-08, + "output_cost_per_token": 5e-08, + "max_input_tokens": 8192, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/baichuan/baichuan-m2-32b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 7e-08, + "output_cost_per_token": 7e-08, + "max_input_tokens": 131072, + "max_output_tokens": 131072, + "max_tokens": 131072, + "supports_system_messages": true + }, + "novita/baidu/ernie-4.5-vl-424b-a47b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 4.2e-07, + "output_cost_per_token": 1.25e-06, + "max_input_tokens": 123000, + "max_output_tokens": 16000, + "max_tokens": 16000, + "supports_vision": true, + "supports_system_messages": true, + "supports_reasoning": true + }, + "novita/baidu/ernie-4.5-300b-a47b-paddle": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2.8e-07, + "output_cost_per_token": 1.1e-06, + "max_input_tokens": 123000, + "max_output_tokens": 12000, + "max_tokens": 12000, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/deepseek/deepseek-prover-v2-671b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 7e-07, + "output_cost_per_token": 2.5e-06, + "max_input_tokens": 160000, + "max_output_tokens": 160000, + "max_tokens": 160000, + "supports_system_messages": true + }, + "novita/qwen/qwen3-32b-fp8": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1e-07, + "output_cost_per_token": 4.5e-07, + "max_input_tokens": 40960, + "max_output_tokens": 20000, + "max_tokens": 20000, + "supports_system_messages": true, + "supports_reasoning": true + }, + "novita/qwen/qwen3-30b-a3b-fp8": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 9e-08, + "output_cost_per_token": 4.5e-07, + "max_input_tokens": 40960, + "max_output_tokens": 20000, + "max_tokens": 20000, + "supports_system_messages": true, + "supports_reasoning": true, + "supports_function_calling": true, + "supports_tool_choice": true + }, + "novita/google/gemma-3-27b-it": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.19e-07, + "output_cost_per_token": 2e-07, + "max_input_tokens": 98304, + "max_output_tokens": 16384, + "max_tokens": 16384, + "supports_vision": true, + "supports_system_messages": true + }, + "novita/deepseek/deepseek-v3-turbo": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 4e-07, + "output_cost_per_token": 1.3e-06, + "max_input_tokens": 64000, + "max_output_tokens": 16000, + "max_tokens": 16000, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true + }, + "novita/deepseek/deepseek-r1-turbo": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 7e-07, + "output_cost_per_token": 2.5e-06, + "max_input_tokens": 64000, + "max_output_tokens": 16000, + "max_tokens": 16000, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_reasoning": true, + "supports_response_schema": true + }, + "novita/Sao10K/L3-8B-Stheno-v3.2": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 5e-08, + "output_cost_per_token": 5e-08, + "max_input_tokens": 8192, + "max_output_tokens": 32000, + "max_tokens": 32000, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true + }, + "novita/gryphe/mythomax-l2-13b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 9e-08, + "output_cost_per_token": 9e-08, + "max_input_tokens": 4096, + "max_output_tokens": 3200, + "max_tokens": 3200, + "supports_system_messages": true + }, + "novita/baidu/ernie-4.5-vl-28b-a3b-thinking": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3.9e-07, + "output_cost_per_token": 3.9e-07, + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "novita/qwen/qwen3-vl-8b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 8e-08, + "output_cost_per_token": 5e-07, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/zai-org/glm-4.5-air": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.3e-07, + "output_cost_per_token": 8.5e-07, + "max_input_tokens": 131072, + "max_output_tokens": 98304, + "max_tokens": 98304, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_reasoning": true, + "cache_read_input_token_cost": 2.5e-08, + "supports_prompt_caching": true + }, + "novita/qwen/qwen3-vl-30b-a3b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2e-07, + "output_cost_per_token": 7e-07, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/qwen/qwen3-vl-30b-a3b-thinking": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2e-07, + "output_cost_per_token": 1e-06, + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/qwen/qwen3-omni-30b-a3b-thinking": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 9.7e-07, + "max_input_tokens": 65536, + "max_output_tokens": 16384, + "max_tokens": 16384, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_audio_input": true + }, + "novita/qwen/qwen3-omni-30b-a3b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 9.7e-07, + "max_input_tokens": 65536, + "max_output_tokens": 16384, + "max_tokens": 16384, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_response_schema": true, + "supports_audio_input": true, + "supports_audio_output": true + }, + "novita/qwen/qwen-mt-plus": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 7.5e-07, + "max_input_tokens": 16384, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_system_messages": true + }, + "novita/baidu/ernie-4.5-vl-28b-a3b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.4e-07, + "output_cost_per_token": 5.6e-07, + "max_input_tokens": 30000, + "max_output_tokens": 8000, + "max_tokens": 8000, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_system_messages": true, + "supports_reasoning": true + }, + "novita/baidu/ernie-4.5-21B-a3b": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 7e-08, + "output_cost_per_token": 2.8e-07, + "max_input_tokens": 120000, + "max_output_tokens": 8000, + "max_tokens": 8000, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true + }, + "novita/qwen/qwen3-8b-fp8": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3.5e-08, + "output_cost_per_token": 1.38e-07, + "max_input_tokens": 128000, + "max_output_tokens": 20000, + "max_tokens": 20000, + "supports_system_messages": true, + "supports_reasoning": true + }, + "novita/qwen/qwen3-4b-fp8": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3e-08, + "output_cost_per_token": 3e-08, + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_system_messages": true, + "supports_reasoning": true, + "supports_function_calling": true, + "supports_tool_choice": true + }, + "novita/qwen/qwen2.5-7b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 7e-08, + "output_cost_per_token": 7e-08, + "max_input_tokens": 32000, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_response_schema": true + }, + "novita/meta-llama/llama-3.2-3b-instruct": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 3e-08, + "output_cost_per_token": 5e-08, + "max_input_tokens": 32768, + "max_output_tokens": 32000, + "max_tokens": 32000, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true + }, + "novita/sao10k/l31-70b-euryale-v2.2": { + "litellm_provider": "novita", + "mode": "chat", + "input_cost_per_token": 1.48e-06, + "output_cost_per_token": 1.48e-06, + "max_input_tokens": 8192, + "max_output_tokens": 8192, + "max_tokens": 8192, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true + }, + "novita/qwen/qwen3-embedding-0.6b": { + "litellm_provider": "novita", + "mode": "embedding", + "input_cost_per_token": 7e-08, + "output_cost_per_token": 0, + "max_input_tokens": 32768, + "max_output_tokens": 32768, + "max_tokens": 32768 + }, + "novita/qwen/qwen3-embedding-8b": { + "litellm_provider": "novita", + "mode": "embedding", + "input_cost_per_token": 7e-08, + "output_cost_per_token": 0, + "max_input_tokens": 32768, + "max_output_tokens": 4096, + "max_tokens": 4096 + }, + "novita/baai/bge-m3": { + "litellm_provider": "novita", + "mode": "embedding", + "input_cost_per_token": 1e-08, + "output_cost_per_token": 1e-08, + "max_input_tokens": 8192, + "max_output_tokens": 96000, + "max_tokens": 96000 + }, + "novita/qwen/qwen3-reranker-8b": { + "litellm_provider": "novita", + "mode": "rerank", + "input_cost_per_token": 5e-08, + "output_cost_per_token": 5e-08, + "max_input_tokens": 32768, + "max_output_tokens": 4096, + "max_tokens": 4096 + }, + "novita/baai/bge-reranker-v2-m3": { + "litellm_provider": "novita", + "mode": "rerank", + "input_cost_per_token": 1e-08, + "output_cost_per_token": 1e-08, + "max_input_tokens": 8000, + "max_output_tokens": 8000, + "max_tokens": 8000 + }, + "llamagate/llama-3.1-8b": { + "max_tokens": 8192, + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "input_cost_per_token": 3e-08, + "output_cost_per_token": 5e-08, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true + }, + "llamagate/llama-3.2-3b": { + "max_tokens": 8192, + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "input_cost_per_token": 4e-08, + "output_cost_per_token": 8e-08, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true + }, + "llamagate/mistral-7b-v0.3": { + "max_tokens": 8192, + "max_input_tokens": 32768, + "max_output_tokens": 8192, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 1.5e-07, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true + }, + "llamagate/qwen3-8b": { + "max_tokens": 8192, + "max_input_tokens": 32768, + "max_output_tokens": 8192, + "input_cost_per_token": 4e-08, + "output_cost_per_token": 1.4e-07, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true + }, + "llamagate/dolphin3-8b": { + "max_tokens": 8192, + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "input_cost_per_token": 8e-08, + "output_cost_per_token": 1.5e-07, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true + }, + "llamagate/deepseek-r1-8b": { + "max_tokens": 16384, + "max_input_tokens": 65536, + "max_output_tokens": 16384, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "llamagate/deepseek-r1-7b-qwen": { + "max_tokens": 16384, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "input_cost_per_token": 8e-08, + "output_cost_per_token": 1.5e-07, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "llamagate/openthinker-7b": { + "max_tokens": 8192, + "max_input_tokens": 32768, + "max_output_tokens": 8192, + "input_cost_per_token": 8e-08, + "output_cost_per_token": 1.5e-07, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true, + "supports_reasoning": true + }, + "llamagate/qwen2.5-coder-7b": { + "max_tokens": 8192, + "max_input_tokens": 32768, + "max_output_tokens": 8192, + "input_cost_per_token": 6e-08, + "output_cost_per_token": 1.2e-07, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true + }, + "llamagate/deepseek-coder-6.7b": { + "max_tokens": 4096, + "max_input_tokens": 16384, + "max_output_tokens": 4096, + "input_cost_per_token": 6e-08, + "output_cost_per_token": 1.2e-07, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true + }, + "llamagate/codellama-7b": { + "max_tokens": 4096, + "max_input_tokens": 16384, + "max_output_tokens": 4096, + "input_cost_per_token": 6e-08, + "output_cost_per_token": 1.2e-07, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true + }, + "llamagate/qwen3-vl-8b": { + "max_tokens": 8192, + "max_input_tokens": 32768, + "max_output_tokens": 8192, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 5.5e-07, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true, + "supports_vision": true + }, + "llamagate/llava-7b": { + "max_tokens": 2048, + "max_input_tokens": 4096, + "max_output_tokens": 2048, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_response_schema": true, + "supports_vision": true + }, + "llamagate/gemma3-4b": { + "max_tokens": 8192, + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "input_cost_per_token": 3e-08, + "output_cost_per_token": 8e-08, + "litellm_provider": "llamagate", + "mode": "chat", + "supports_function_calling": true, + "supports_response_schema": true, + "supports_vision": true + }, + "llamagate/nomic-embed-text": { + "max_tokens": 8192, + "max_input_tokens": 8192, + "input_cost_per_token": 2e-08, + "output_cost_per_token": 0, + "litellm_provider": "llamagate", + "mode": "embedding" + }, + "llamagate/qwen3-embedding-8b": { + "max_tokens": 40960, + "max_input_tokens": 40960, + "input_cost_per_token": 2e-08, + "output_cost_per_token": 0, + "litellm_provider": "llamagate", + "mode": "embedding" + }, + "libertai/hermes-3-8b-tee": { + "max_tokens": 16000, + "max_input_tokens": 16000, + "max_output_tokens": 16000, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "litellm_provider": "libertai", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": false, + "source": "https://docs.libertai.io/apis/text/" + }, + "libertai/gemma-4-31b-it": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 4e-07, + "litellm_provider": "libertai", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": true, + "source": "https://docs.libertai.io/apis/text/" + }, + "libertai/gemma-4-31b-it-thinking": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 4e-07, + "litellm_provider": "libertai", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": true, + "supports_reasoning": true, + "source": "https://docs.libertai.io/apis/text/" + }, + "libertai/qwen3.6-27b": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 5e-07, + "litellm_provider": "libertai", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": true, + "source": "https://docs.libertai.io/apis/text/" + }, + "libertai/qwen3.6-27b-thinking": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 5e-07, + "litellm_provider": "libertai", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": true, + "supports_reasoning": true, + "source": "https://docs.libertai.io/apis/text/" + }, + "libertai/qwen3.6-35b-a3b": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 5e-07, + "litellm_provider": "libertai", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": true, + "source": "https://docs.libertai.io/apis/text/" + }, + "libertai/qwen3.6-35b-a3b-thinking": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 5e-07, + "litellm_provider": "libertai", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": true, + "supports_reasoning": true, + "source": "https://docs.libertai.io/apis/text/" + }, + "libertai/qwen3.5-122b-a10b": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 1.75e-06, + "litellm_provider": "libertai", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": true, + "source": "https://docs.libertai.io/apis/text/" + }, + "libertai/qwen3.5-122b-a10b-thinking": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 1.75e-06, + "litellm_provider": "libertai", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": true, + "supports_reasoning": true, + "source": "https://docs.libertai.io/apis/text/" + }, + "libertai/deepseek-v4-flash": { + "max_tokens": 200000, + "max_input_tokens": 200000, + "max_output_tokens": 200000, + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 1.75e-06, + "litellm_provider": "libertai", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": false, + "source": "https://docs.libertai.io/apis/text/" + }, + "libertai/deepseek-v4-flash-thinking": { + "max_tokens": 200000, + "max_input_tokens": 200000, + "max_output_tokens": 200000, + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 1.75e-06, + "litellm_provider": "libertai", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": false, + "supports_reasoning": true, + "source": "https://docs.libertai.io/apis/text/" + }, + "libertai/bge-m3": { + "max_tokens": 8192, + "max_input_tokens": 8192, + "input_cost_per_token": 1e-08, + "output_cost_per_token": 0.0, + "litellm_provider": "libertai", + "mode": "embedding", + "source": "https://docs.libertai.io/apis/text/" + }, + "sarvam/sarvam-m": { + "cache_creation_input_token_cost": 0, + "cache_creation_input_token_cost_above_1hr": 0, + "cache_read_input_token_cost": 0, + "input_cost_per_token": 0, + "litellm_provider": "sarvam", + "max_input_tokens": 8192, + "max_output_tokens": 32000, + "max_tokens": 32000, + "mode": "chat", + "output_cost_per_token": 0, + "supports_reasoning": true + }, + "tts-1-1106": { + "input_cost_per_character": 1.5e-05, + "litellm_provider": "openai", + "mode": "audio_speech", + "supported_endpoints": [ + "/v1/audio/speech" + ] + }, + "tts-1-hd-1106": { + "input_cost_per_character": 3e-05, + "litellm_provider": "openai", + "mode": "audio_speech", + "supported_endpoints": [ + "/v1/audio/speech" + ] + }, + "gpt-4o-mini-tts-2025-12-15": { + "input_cost_per_token": 6e-07, + "litellm_provider": "openai", + "mode": "audio_speech", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_second": 0.00025, + "output_cost_per_token": 1e-05, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/audio/speech" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "audio" + ] + }, + "gpt-4o-mini-transcribe-2025-03-20": { + "deprecation_date": "2027-01-20", + "input_cost_per_audio_token": 1.25e-06, + "input_cost_per_second": 5e-05, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "openai", + "max_input_tokens": 16000, + "max_output_tokens": 2000, + "mode": "audio_transcription", + "output_cost_per_token": 5e-06, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ] + }, + "gpt-4o-mini-transcribe-2025-12-15": { + "input_cost_per_audio_token": 1.25e-06, + "input_cost_per_second": 5e-05, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "openai", + "max_input_tokens": 16000, + "max_output_tokens": 2000, + "mode": "audio_transcription", + "output_cost_per_token": 5e-06, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ] + }, + "gpt-5-search-api": { + "cache_read_input_token_cost": 1.25e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "openai", + "max_input_tokens": 272000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 1e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_none_reasoning_effort": false, + "supports_xhigh_reasoning_effort": false, + "supports_minimal_reasoning_effort": true + }, + "gpt-5-search-api-2025-10-14": { + "cache_read_input_token_cost": 1.25e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "openai", + "max_input_tokens": 272000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 1e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_none_reasoning_effort": false, + "supports_xhigh_reasoning_effort": false + }, + "gpt-realtime-mini-2025-12-15": { + "cache_creation_input_audio_token_cost": 3e-07, + "cache_read_input_audio_token_cost": 3e-07, + "cache_read_input_image_token_cost": 8e-08, + "cache_read_input_token_cost": 6e-08, + "input_cost_per_audio_token": 1e-05, + "input_cost_per_image_token": 8e-07, + "input_cost_per_token": 6e-07, + "litellm_provider": "openai", + "max_input_tokens": 128000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "realtime", + "output_cost_per_audio_token": 2e-05, + "output_cost_per_token": 2.4e-06, + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "image", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "deprecation_date": "2027-01-20", + "source": "https://developers.openai.com/api/docs/pricing" + }, + "gpt-realtime-whisper": { + "input_cost_per_second": 0.000283333333333, + "litellm_provider": "openai", + "mode": "audio_transcription", + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime", + "/v1/realtime/transcription_sessions" + ], + "supported_modalities": [ + "audio" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true + }, + "sora-2": { + "deprecation_date": "2026-09-24", + "litellm_provider": "openai", + "mode": "video_generation", + "output_cost_per_video_per_second": 0.1, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "video" + ] + }, + "sora-2-pro": { + "deprecation_date": "2026-09-24", + "litellm_provider": "openai", + "mode": "video_generation", + "output_cost_per_video_per_second": 0.3, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "video" + ] + }, + "sora-2-pro-high-res": { + "litellm_provider": "openai", + "deprecation_date": "2026-09-24", + "mode": "video_generation", + "output_cost_per_video_per_second": 0.5, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "video" + ] + }, + "chatgpt-image-latest": { + "cache_read_input_image_token_cost": 2e-06, + "cache_read_input_token_cost": 1.25e-06, + "cache_read_input_token_cost_batches": 6.3e-07, + "deprecation_date": "2026-12-01", + "input_cost_per_image_token": 8e-06, + "input_cost_per_image_token_batches": 4e-06, + "input_cost_per_token": 5e-06, + "input_cost_per_token_batches": 2.5e-06, + "litellm_provider": "openai", + "mode": "image_generation", + "output_cost_per_image_token": 3.2e-05, + "output_cost_per_token": 1e-05, + "output_cost_per_token_batches": 5e-06, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/images/generations", + "/v1/images/edits" + ] + }, + "gemini-2.0-flash-exp-image-generation": { + "input_cost_per_token": 0.0, + "litellm_provider": "gemini", + "max_input_tokens": 32768, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "image_generation", + "output_cost_per_image": 0.039, + "output_cost_per_token": 0.0, + "source": "https://ai.google.dev/pricing", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text", + "image" + ], + "supports_vision": true + }, + "gemini/gemini-2.0-flash-exp-image-generation": { + "input_cost_per_token": 0.0, + "litellm_provider": "gemini", + "max_input_tokens": 32768, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "image_generation", + "output_cost_per_image": 0.039, + "output_cost_per_token": 0.0, + "source": "https://ai.google.dev/pricing", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text", + "image" + ], + "supports_vision": true, + "tpm": 250000, + "rpm": 10 + }, + "gemini-2.5-flash-native-audio-latest": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_token": 5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 2e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "gemini_native_audio": true + }, + "gemini-2.5-flash-native-audio-preview-09-2025": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_token": 5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 2e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "gemini_native_audio": true + }, + "gemini-2.5-flash-native-audio-preview-12-2025": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_token": 5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 2e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "gemini_native_audio": true, + "supports_function_calling": true, + "supports_response_schema": false, + "supports_vision": true, + "supports_web_search": true + }, + "gemini-3.1-flash-live-preview": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_image_token": 1e-06, + "input_cost_per_token": 7.5e-07, + "input_cost_per_video_per_second": 3.3333333333333335e-05, + "input_cost_per_video_token": 1e-06, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 4.5e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "supports_function_calling": true, + "supports_vision": true, + "supports_web_search": true, + "gemini_audio_only_live": true, + "input_cost_per_second": 8.33333333333e-05, + "supports_response_schema": false + }, + "gemini-3.8-live": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_image_token": 1e-06, + "input_cost_per_token": 7.5e-07, + "input_cost_per_video_per_second": 3.3333333333333335e-05, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 4.5e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "supports_function_calling": true, + "supports_vision": true, + "supports_web_search": true, + "gemini_audio_only_live": true, + "supports_response_schema": false + }, + "gemini-3.8-live-extended-thinking": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_image_token": 1e-06, + "input_cost_per_token": 7.5e-07, + "input_cost_per_video_per_second": 3.3333333333333335e-05, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 4.5e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "supports_function_calling": true, + "supports_vision": true, + "supports_web_search": true, + "gemini_audio_only_live": true, + "supports_reasoning": true, + "supports_response_schema": false + }, + "gemini/gemini-2.5-flash-native-audio-latest": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_token": 5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 2e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "tpm": 250000, + "rpm": 10, + "gemini_native_audio": true + }, + "gemini/gemini-2.5-flash-native-audio-preview-09-2025": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_token": 5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 2e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "tpm": 250000, + "rpm": 10, + "gemini_native_audio": true + }, + "gemini/gemini-2.5-flash-native-audio-preview-12-2025": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_token": 5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 2e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "tpm": 250000, + "rpm": 10, + "gemini_native_audio": true, + "supports_function_calling": true, + "supports_response_schema": false, + "supports_vision": true, + "supports_web_search": true, + "supports_reasoning": true + }, + "gemini/gemini-3.1-flash-live-preview": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_image_token": 1e-06, + "input_cost_per_token": 7.5e-07, + "input_cost_per_video_per_second": 3.3333333333333335e-05, + "input_cost_per_video_token": 1e-06, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 4.5e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "supports_function_calling": true, + "supports_vision": true, + "supports_web_search": true, + "tpm": 250000, + "rpm": 10, + "gemini_audio_only_live": true, + "input_cost_per_second": 8.33333333333e-05, + "supports_response_schema": false, + "supports_reasoning": true + }, + "gemini/gemini-3.1-flash-tts-preview": { + "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 8192, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "audio_speech", + "output_cost_per_audio_token": 2e-05, + "output_cost_per_token": 2e-05, + "output_cost_per_token_batches": 1e-05, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/audio/speech" + ], + "tpm": 4000000, + "rpm": 10, + "supports_function_calling": false, + "supports_response_schema": false, + "supports_web_search": false + }, + "gemini/gemini-3.8-flash-tts": { + "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_batches": 6.25e-08, + "cache_read_input_token_cost_flex": 2.5e-08, + "cache_read_input_token_cost_priority": 2.25e-07, + "input_cost_per_token": 5e-07, + "input_cost_per_token_batches": 2.5e-07, + "input_cost_per_token_flex": 2.5e-07, + "input_cost_per_token_priority": 9e-07, + "litellm_provider": "gemini", + "max_input_tokens": 8192, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "audio_speech", + "output_cost_per_audio_token": 9e-06, + "output_cost_per_token": 9e-06, + "output_cost_per_token_batches": 4.5e-06, + "output_cost_per_token_flex": 4.5e-06, + "output_cost_per_token_priority": 1.62e-05, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/audio/speech" + ], + "supports_prompt_caching": true + }, + "gemini/gemini-3.8-flash-lite-tts": { + "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_batches": 6.25e-08, + "cache_read_input_token_cost_flex": 2.5e-08, + "cache_read_input_token_cost_priority": 2.25e-07, + "input_cost_per_token": 5e-07, + "input_cost_per_token_batches": 2.5e-07, + "input_cost_per_token_flex": 2.5e-07, + "input_cost_per_token_priority": 9e-07, + "litellm_provider": "gemini", + "max_input_tokens": 8192, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "audio_speech", + "output_cost_per_audio_token": 6e-06, + "output_cost_per_token": 6e-06, + "output_cost_per_token_batches": 3e-06, + "output_cost_per_token_flex": 3e-06, + "output_cost_per_token_priority": 1.08e-05, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/audio/speech" + ], + "supports_prompt_caching": true + }, + "gemini-2.5-flash-preview-tts": { + "input_cost_per_token": 5e-07, + "input_cost_per_token_batches": 2.5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 8192, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "audio_speech", + "output_cost_per_audio_token": 1e-05, + "output_cost_per_token": 1e-05, + "output_cost_per_token_batches": 5e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/audio/speech" + ], + "supports_audio_input": false, + "supports_function_calling": false, + "supports_response_schema": false, + "supports_web_search": false + }, + "gemini-flash-latest": { + "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_token": 7.5e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 3.75e-06, + "output_cost_per_token": 3.75e-06, + "rpm": 100000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_output": false, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_vision": true, + "supports_web_search": true, + "tpm": 8000000, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "google_maps_grounding_cost_per_query": 0.014, + "cache_read_input_token_cost_flex": 3.75e-08, + "cache_read_input_token_cost_priority": 1.35e-07, + "input_cost_per_token_batches": 3.75e-07, + "input_cost_per_token_flex": 3.75e-07, + "input_cost_per_token_priority": 1.35e-06, + "output_cost_per_token_batches": 1.875e-06, + "output_cost_per_token_flex": 1.875e-06, + "output_cost_per_token_priority": 6.75e-06, + "prompt_cache_min_tokens": 4096, + "supports_audio_input": true, + "supports_native_streaming": true, + "supports_video_input": true, + "web_search_billing_unit": "per_query" + }, + "gemini-flash-lite-latest": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 3e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 2.5e-06, + "output_cost_per_token": 2.5e-06, + "rpm": 15, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_output": false, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_vision": true, + "supports_web_search": true, + "tpm": 250000, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "google_maps_grounding_cost_per_query": 0.014, + "cache_read_input_token_cost_flex": 2e-08, + "cache_read_input_token_cost_priority": 5e-08, + "input_cost_per_token_batches": 1.5e-07, + "input_cost_per_token_flex": 1.5e-07, + "input_cost_per_token_priority": 5.4e-07, + "output_cost_per_token_batches": 1.25e-06, + "output_cost_per_token_flex": 1.25e-06, + "output_cost_per_token_priority": 4.5e-06, + "supports_audio_input": true, + "supports_native_streaming": true, + "supports_video_input": true, + "web_search_billing_unit": "per_query" + }, + "gemini-pro-latest": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "tpm": 800000, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "google_maps_grounding_cost_per_query": 0.014, + "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, + "cache_read_input_token_cost_priority": 3.6e-07, + "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, + "input_cost_per_token_batches": 1e-06, + "input_cost_per_token_priority": 3.6e-06, + "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, + "output_cost_per_token_batches": 6e-06, + "output_cost_per_token_priority": 2.16e-05, + "prompt_cache_min_tokens": 4096, + "supports_native_streaming": true, + "supports_url_context": true, + "web_search_billing_unit": "per_query", + "cache_read_input_token_cost_flex": 2e-07, + "input_cost_per_token_flex": 1e-06, + "output_cost_per_token_flex": 6e-06 + }, + "gemini/gemini-pro-latest": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_video_input": true, + "supports_vision": true, + "supports_web_search": true, + "tpm": 800000, + "search_context_cost_per_query": { + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014, + "search_context_size_high": 0.014 + }, + "google_maps_grounding_cost_per_query": 0.014, + "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, + "cache_read_input_token_cost_priority": 3.6e-07, + "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, + "input_cost_per_token_batches": 1e-06, + "input_cost_per_token_priority": 3.6e-06, + "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, + "output_cost_per_token_batches": 6e-06, + "output_cost_per_token_priority": 2.16e-05, + "prompt_cache_min_tokens": 4096, + "supports_native_streaming": true, + "supports_url_context": true, + "web_search_billing_unit": "per_query", + "cache_read_input_token_cost_flex": 2e-07, + "input_cost_per_token_flex": 1e-06, + "output_cost_per_token_flex": 6e-06 + }, + "gemini-exp-1206": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_audio_token": 1e-06, + "input_cost_per_token": 3e-07, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65535, + "max_tokens": 65535, + "mode": "chat", + "output_cost_per_reasoning_token": 2.5e-06, + "output_cost_per_token": 2.5e-06, + "rpm": 100000, + "source": "https://ai.google.dev/gemini-api/docs/models#gemini-2.5-flash-preview", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/completions", + "/v1/batch" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_output": false, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_url_context": true, + "supports_vision": true, + "supports_web_search": true, + "tpm": 8000000, + "search_context_cost_per_query": { + "search_context_size_low": 0.035, + "search_context_size_medium": 0.035, + "search_context_size_high": 0.035 + } + }, + "vertex_ai/claude-sonnet-5@default": { + "deprecation_date": "2026-12-24", + "regional_endpoint_uplift_multiplier": 1.1, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_1hr": 4e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "vertex_ai-anthropic_models", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 1e-05, + "output_cost_per_token_batches": 5e-06, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_max_reasoning_effort": true, + "prompt_cache_min_tokens": 1024, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "vertex_ai/claude-sonnet-4-6@default": { + "regional_endpoint_uplift_multiplier": 1.1, + "supports_adaptive_thinking": true, + "supports_legacy_thinking": true, + "cache_creation_input_token_cost": 3.75e-06, + "cache_creation_input_token_cost_above_1hr": 6e-06, + "cache_creation_input_token_cost_batches": 1.88e-06, + "cache_read_input_token_cost": 3e-07, + "cache_read_input_token_cost_batches": 1.5e-07, + "input_cost_per_token": 3e-06, + "input_cost_per_token_batches": 1.5e-06, + "litellm_provider": "vertex_ai-anthropic_models", + "max_input_tokens": 1000000, + "max_output_tokens": 64000, + "max_tokens": 64000, + "mode": "chat", + "output_cost_per_token": 1.5e-05, + "output_cost_per_token_batches": 7.5e-06, + "supports_assistant_prefill": true, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_max_reasoning_effort": true, + "supports_tool_choice": true, + "supports_vision": true, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_output_config": true, + "prompt_cache_min_tokens": 1024, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "duckduckgo/search": { + "litellm_provider": "duckduckgo", + "mode": "search", + "input_cost_per_query": 0.0, + "metadata": { + "notes": "DuckDuckGo Instant Answer API is free and does not require an API key." + } + }, + "bedrock_mantle/openai.gpt-oss-120b": { + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "bedrock_mantle/openai.gpt-oss-20b": { + "input_cost_per_token": 7e-08, + "output_cost_per_token": 3e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "bedrock_mantle/openai.gpt-oss-safeguard-120b": { + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "bedrock_mantle/openai.gpt-oss-safeguard-20b": { + "input_cost_per_token": 7e-08, + "output_cost_per_token": 2e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "bedrock_mantle/openai.gpt-5.6-sol": { + "input_cost_per_token": 4.4e-06, + "input_cost_per_token_above_272k_tokens": 8.8e-06, + "cache_creation_input_token_cost": 5.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 1.1e-05, + "cache_read_input_token_cost": 4.4e-07, + "cache_read_input_token_cost_above_272k_tokens": 8.8e-07, + "output_cost_per_token": 2.2e-05, + "output_cost_per_token_above_272k_tokens": 3.3e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.012, + "search_context_size_low": 0.012, + "search_context_size_medium": 0.012 + }, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_web_search": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-56-sol.html" + }, + "bedrock_mantle/openai.gpt-5.6-terra": { + "input_cost_per_token": 2.2e-06, + "input_cost_per_token_above_272k_tokens": 4.4e-06, + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5.5e-06, + "cache_read_input_token_cost": 2.2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4.4e-07, + "output_cost_per_token": 1.32e-05, + "output_cost_per_token_above_272k_tokens": 1.98e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.012, + "search_context_size_low": 0.012, + "search_context_size_medium": 0.012 + }, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_web_search": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-56-terra.html" + }, + "bedrock_mantle/openai.gpt-5.6-cyber": { + "input_cost_per_token": 1.375e-05, + "cache_creation_input_token_cost": 1.71875e-05, + "cache_read_input_token_cost": 1.375e-06, + "output_cost_per_token": 8.25e-05, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 272000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_minimal_reasoning_effort": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true + }, + "bedrock_mantle/openai.gpt-daybreak-blue-5.6-sol": { + "input_cost_per_token": 4.4e-06, + "input_cost_per_token_above_272k_tokens": 8.8e-06, + "cache_creation_input_token_cost": 5.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 1.1e-05, + "cache_read_input_token_cost": 4.4e-07, + "cache_read_input_token_cost_above_272k_tokens": 8.8e-07, + "output_cost_per_token": 2.2e-05, + "output_cost_per_token_above_272k_tokens": 3.3e-05, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_minimal_reasoning_effort": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-daybreak-blue-56-sol.html" + }, + "bedrock_mantle/openai.gpt-5.6-luna": { + "input_cost_per_token": 2.2e-07, + "input_cost_per_token_above_272k_tokens": 4.4e-07, + "cache_creation_input_token_cost": 2.75e-07, + "cache_creation_input_token_cost_above_272k_tokens": 5.5e-07, + "cache_read_input_token_cost": 2.2e-08, + "cache_read_input_token_cost_above_272k_tokens": 4.4e-08, + "output_cost_per_token": 1.32e-06, + "output_cost_per_token_above_272k_tokens": 1.98e-06, + "search_context_cost_per_query": { + "search_context_size_high": 0.012, + "search_context_size_low": 0.012, + "search_context_size_medium": 0.012 + }, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_web_search": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-56-luna.html" + }, + "us.openai.gpt-5.6-sol": { + "input_cost_per_token": 4.4e-06, + "input_cost_per_token_above_272k_tokens": 8.8e-06, + "cache_creation_input_token_cost": 5.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 1.1e-05, + "cache_read_input_token_cost": 4.4e-07, + "cache_read_input_token_cost_above_272k_tokens": 8.8e-07, + "output_cost_per_token": 2.2e-05, + "output_cost_per_token_above_272k_tokens": 3.3e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "supports_sampling_params": false, + "supported_endpoints": [ + "/v1/responses" + ] + }, + "global.openai.gpt-5.6-sol": { + "input_cost_per_token": 4e-06, + "input_cost_per_token_above_272k_tokens": 8e-06, + "cache_creation_input_token_cost": 5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 1e-05, + "cache_read_input_token_cost": 4e-07, + "cache_read_input_token_cost_above_272k_tokens": 8e-07, + "output_cost_per_token": 2e-05, + "output_cost_per_token_above_272k_tokens": 3e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "supports_sampling_params": false, + "supported_endpoints": [ + "/v1/responses" + ] + }, + "us.openai.gpt-5.6-terra": { + "input_cost_per_token": 2.2e-06, + "input_cost_per_token_above_272k_tokens": 4.4e-06, + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5.5e-06, + "cache_read_input_token_cost": 2.2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4.4e-07, + "output_cost_per_token": 1.32e-05, + "output_cost_per_token_above_272k_tokens": 1.98e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "supports_sampling_params": false, + "supported_endpoints": [ + "/v1/responses" + ] + }, + "global.openai.gpt-5.6-terra": { + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_above_272k_tokens": 1.8e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "supports_sampling_params": false, + "supported_endpoints": [ + "/v1/responses" + ] + }, + "us.openai.gpt-5.6-luna": { + "input_cost_per_token": 2.2e-07, + "input_cost_per_token_above_272k_tokens": 4.4e-07, + "cache_creation_input_token_cost": 2.75e-07, + "cache_creation_input_token_cost_above_272k_tokens": 5.5e-07, + "cache_read_input_token_cost": 2.2e-08, + "cache_read_input_token_cost_above_272k_tokens": 4.4e-08, + "output_cost_per_token": 1.32e-06, + "output_cost_per_token_above_272k_tokens": 1.98e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "supports_sampling_params": false, + "supported_endpoints": [ + "/v1/responses" + ] + }, + "us.openai.gpt-5.4": { + "input_cost_per_token": 2.75e-06, + "input_cost_per_token_above_272k_tokens": 5.5e-06, + "cache_read_input_token_cost": 2.75e-07, + "cache_read_input_token_cost_above_272k_tokens": 5.5e-07, + "output_cost_per_token": 1.65e-05, + "output_cost_per_token_above_272k_tokens": 2.475e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-54.html", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_minimal_reasoning_effort": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "supports_sampling_params": false, + "supported_endpoints": [ + "/v1/responses" + ] + }, + "global.openai.gpt-5.4": { + "input_cost_per_token": 2.5e-06, + "input_cost_per_token_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 2.5e-07, + "cache_read_input_token_cost_above_272k_tokens": 5e-07, + "output_cost_per_token": 1.5e-05, + "output_cost_per_token_above_272k_tokens": 2.25e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-54.html", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_minimal_reasoning_effort": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "supports_sampling_params": false, + "supported_endpoints": [ + "/v1/responses" + ] + }, + "us.openai.gpt-5.5": { + "input_cost_per_token": 5.5e-06, + "input_cost_per_token_above_272k_tokens": 1.1e-05, + "cache_read_input_token_cost": 5.5e-07, + "cache_read_input_token_cost_above_272k_tokens": 1.1e-06, + "output_cost_per_token": 3.3e-05, + "output_cost_per_token_above_272k_tokens": 4.95e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-55.html", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_minimal_reasoning_effort": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "supports_sampling_params": false, + "supported_endpoints": [ + "/v1/responses" + ] + }, + "global.openai.gpt-5.5": { + "input_cost_per_token": 5e-06, + "input_cost_per_token_above_272k_tokens": 1e-05, + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_272k_tokens": 1e-06, + "output_cost_per_token": 3e-05, + "output_cost_per_token_above_272k_tokens": 4.5e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-55.html", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_minimal_reasoning_effort": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "supports_sampling_params": false, + "supported_endpoints": [ + "/v1/responses" + ] + }, + "global.openai.gpt-5.6-luna": { + "input_cost_per_token": 2e-07, + "input_cost_per_token_above_272k_tokens": 4e-07, + "cache_creation_input_token_cost": 2.5e-07, + "cache_creation_input_token_cost_above_272k_tokens": 5e-07, + "cache_read_input_token_cost": 2e-08, + "cache_read_input_token_cost_above_272k_tokens": 4e-08, + "output_cost_per_token": 1.2e-06, + "output_cost_per_token_above_272k_tokens": 1.8e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "supports_sampling_params": false, + "supported_endpoints": [ + "/v1/responses" + ] + }, + "bedrock_mantle/openai.gpt-6-astra": { + "input_cost_per_token": 1.1e-05, + "input_cost_per_token_above_272k_tokens": 2.2e-05, + "cache_creation_input_token_cost": 1.375e-05, + "cache_creation_input_token_cost_above_272k_tokens": 2.75e-05, + "cache_read_input_token_cost": 1.1e-06, + "cache_read_input_token_cost_above_272k_tokens": 2.2e-06, + "output_cost_per_token": 5.5e-05, + "output_cost_per_token_above_272k_tokens": 8.25e-05, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-6-astra.html" + }, + "bedrock_mantle/openai.gpt-6-sol": { + "input_cost_per_token": 2.2e-06, + "input_cost_per_token_above_272k_tokens": 4.4e-06, + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5.5e-06, + "cache_read_input_token_cost": 2.2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4.4e-07, + "output_cost_per_token": 1.1e-05, + "output_cost_per_token_above_272k_tokens": 1.65e-05, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards-openai.html" + }, + "bedrock_mantle/openai.gpt-6-luna": { + "input_cost_per_token": 1.1e-07, + "input_cost_per_token_above_272k_tokens": 2.2e-07, + "cache_creation_input_token_cost": 1.375e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.75e-07, + "cache_read_input_token_cost": 1.1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2.2e-08, + "output_cost_per_token": 5.5e-07, + "output_cost_per_token_above_272k_tokens": 8.25e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-cards-openai.html" + }, + "us.openai.gpt-6-astra": { + "input_cost_per_token": 1.1e-05, + "input_cost_per_token_above_272k_tokens": 2.2e-05, + "cache_creation_input_token_cost": 1.375e-05, + "cache_creation_input_token_cost_above_272k_tokens": 2.75e-05, + "cache_read_input_token_cost": 1.1e-06, + "cache_read_input_token_cost_above_272k_tokens": 2.2e-06, + "output_cost_per_token": 5.5e-05, + "output_cost_per_token_above_272k_tokens": 8.25e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_endpoints": [ + "/v1/responses" + ] + }, + "us.openai.gpt-6-sol": { + "input_cost_per_token": 2.2e-06, + "input_cost_per_token_above_272k_tokens": 4.4e-06, + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5.5e-06, + "cache_read_input_token_cost": 2.2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4.4e-07, + "output_cost_per_token": 1.1e-05, + "output_cost_per_token_above_272k_tokens": 1.65e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_endpoints": [ + "/v1/responses" + ] + }, + "us.openai.gpt-6-luna": { + "input_cost_per_token": 1.1e-07, + "input_cost_per_token_above_272k_tokens": 2.2e-07, + "cache_creation_input_token_cost": 1.375e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.75e-07, + "cache_read_input_token_cost": 1.1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2.2e-08, + "output_cost_per_token": 5.5e-07, + "output_cost_per_token_above_272k_tokens": 8.25e-07, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_endpoints": [ + "/v1/responses" + ] + }, + "global.openai.gpt-6-astra": { + "input_cost_per_token": 1e-05, + "input_cost_per_token_above_272k_tokens": 2e-05, + "cache_creation_input_token_cost": 1.25e-05, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-05, + "cache_read_input_token_cost": 1e-06, + "cache_read_input_token_cost_above_272k_tokens": 2e-06, + "output_cost_per_token": 5e-05, + "output_cost_per_token_above_272k_tokens": 7.5e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_endpoints": [ + "/v1/responses" + ] + }, + "openai.gpt-6-sol": { + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://aws.amazon.com/bedrock/pricing/" + }, + "global.openai.gpt-6-sol": { + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_endpoints": [ + "/v1/responses" + ] + }, + "openai.gpt-6-luna": { + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_272k_tokens": 2e-07, + "cache_creation_input_token_cost": 1.25e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-07, + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "output_cost_per_token": 5e-07, + "output_cost_per_token_above_272k_tokens": 7.5e-07, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://aws.amazon.com/bedrock/pricing/" + }, + "global.openai.gpt-6-luna": { + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_272k_tokens": 2e-07, + "cache_creation_input_token_cost": 1.25e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-07, + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "output_cost_per_token": 5e-07, + "output_cost_per_token_above_272k_tokens": 7.5e-07, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_xhigh_reasoning_effort": true, + "supports_vision": true, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supported_endpoints": [ + "/v1/responses" + ] + }, + "bedrock_mantle/openai.gpt-5.5": { + "input_cost_per_token": 5.5e-06, + "input_cost_per_token_above_272k_tokens": 1.1e-05, + "cache_read_input_token_cost": 5.5e-07, + "cache_read_input_token_cost_above_272k_tokens": 1.1e-06, + "output_cost_per_token": 3.3e-05, + "output_cost_per_token_above_272k_tokens": 4.95e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.012, + "search_context_size_low": 0.012, + "search_context_size_medium": 0.012 + }, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_minimal_reasoning_effort": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_web_search": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-55.html" + }, + "bedrock_mantle/openai.gpt-5.4": { + "input_cost_per_token": 2.75e-06, + "input_cost_per_token_above_272k_tokens": 5.5e-06, + "cache_read_input_token_cost": 2.75e-07, + "cache_read_input_token_cost_above_272k_tokens": 5.5e-07, + "output_cost_per_token": 1.65e-05, + "output_cost_per_token_above_272k_tokens": 2.475e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.012, + "search_context_size_low": 0.012, + "search_context_size_medium": 0.012 + }, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_minimal_reasoning_effort": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_web_search": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-54.html" }, - "fireworks_ai/accounts/fireworks/models/qwen3p7-plus": { - "cache_read_input_token_cost": 8e-08, - "input_cost_per_token": 4e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "bedrock_mantle/google.gemma-4-31b": { + "input_cost_per_token": 1.4e-07, + "output_cost_per_token": 4e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, "mode": "chat", - "output_cost_per_token": 1.6e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], "supports_function_calling": true, + "supports_parallel_function_calling": false, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/qwq-32b": { - "max_tokens": 131072, - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "input_cost_per_token": 9e-07, - "output_cost_per_token": 9e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" + "bedrock_mantle/google.gemma-4-26b-a4b": { + "input_cost_per_token": 1.3e-07, + "output_cost_per_token": 4e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, + "mode": "chat", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": false, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/rolm-ocr": { - "max_tokens": 128000, + "bedrock_mantle/google.gemma-4-e2b": { + "input_cost_per_token": 4e-08, + "output_cost_per_token": 8e-08, + "litellm_provider": "bedrock_mantle", "max_input_tokens": 128000, "max_output_tokens": 128000, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/snorkel-mistral-7b-pairrm-dpo": { - "max_tokens": 32768, - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/stable-diffusion-xl-1024-v1-0": { - "max_tokens": 4096, - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "input_cost_per_token": 1.3e-10, - "output_cost_per_token": 1.3e-10, - "litellm_provider": "fireworks_ai", - "mode": "image_generation" - }, - "fireworks_ai/accounts/fireworks/models/stablecode-3b": { - "max_tokens": 4096, - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 1e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/starcoder-16b": { - "max_tokens": 8192, - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/starcoder-7b": { - "max_tokens": 8192, - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/starcoder2-15b": { - "max_tokens": 16384, - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" + "max_tokens": 128000, + "mode": "chat", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": false, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true }, - "fireworks_ai/accounts/fireworks/models/starcoder2-3b": { - "max_tokens": 16384, - "max_input_tokens": 16384, + "bedrock_mantle/xai.grok-4.3": { + "use_openai_responses_path": true, + "input_cost_per_token": 1.25e-06, + "output_cost_per_token": 2.5e-06, + "cache_read_input_token_cost": 2e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1048576, "max_output_tokens": 16384, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 1e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/starcoder2-7b": { "max_tokens": 16384, - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/toppy-m-7b": { - "max_tokens": 32768, - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/yi-34b": { - "max_tokens": 4096, - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "input_cost_per_token": 9e-07, - "output_cost_per_token": 9e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/yi-34b-200k-capybara": { - "max_tokens": 200000, - "max_input_tokens": 200000, - "max_output_tokens": 200000, - "input_cost_per_token": 9e-07, - "output_cost_per_token": 9e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/yi-34b-chat": { - "max_tokens": 4096, - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "input_cost_per_token": 9e-07, - "output_cost_per_token": 9e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/yi-6b": { - "max_tokens": 4096, - "max_input_tokens": 4096, - "max_output_tokens": 4096, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/models/zephyr-7b-beta": { - "max_tokens": 32768, - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "fireworks_ai", - "mode": "chat" - }, - "fireworks_ai/accounts/fireworks/routers/glm-5p1-fast": { - "cache_read_input_token_cost": 5.2e-07, - "input_cost_per_token": 2.8e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 202800, - "max_output_tokens": 131072, - "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 8.8e-06, - "source": "https://docs.fireworks.ai/serverless/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], "supports_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false + "supports_vision": true, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "fireworks_ai/accounts/fireworks/routers/kimi-k2p6-fast": { - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 2e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "bedrock_mantle/xai.grok-4.6": { + "use_openai_responses_path": true, + "input_cost_per_token": 2.2e-06, + "output_cost_per_token": 6.6e-06, + "cache_read_input_token_cost": 5.5e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://docs.fireworks.ai/serverless/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], "supports_function_calling": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-xai-grok-4-6.html" }, - "fireworks_ai/accounts/fireworks/routers/kimi-k2p7-code-fast": { - "cache_read_input_token_cost": 3.8e-07, - "input_cost_per_token": 1.9e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "bedrock_mantle/anthropic.claude-haiku-4-5": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_creation_input_token_cost_above_1hr": 2e-06, + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 1e-06, + "litellm_provider": "bedrock_mantle", + "supports_tool_search": true, + "max_input_tokens": 200000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://docs.fireworks.ai/serverless/pricing", + "output_cost_per_token": 5e-06, + "source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock", + "supports_assistant_prefill": true, + "supports_computer_use": true, "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "supports_native_structured_output": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 4096, + "input_cost_per_token_batches": 5e-07, + "output_cost_per_token_batches": 2.5e-06 }, - "scaleway/qwen/qwen3.5-397b-a17b": { - "input_cost_per_token": 6e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 256000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "bedrock_mantle/anthropic.claude-opus-5-5": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 5.5e-06, + "cache_creation_input_token_cost_above_1hr": 8.8e-06, + "cache_read_input_token_cost": 2.2e-07, + "input_cost_per_token": 4.4e-06, + "litellm_provider": "bedrock_mantle", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3.6e-06, + "output_cost_per_token": 2.2e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_vision": true + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-anthropic-claude-opus-5-5.html", + "thinking_always_on": true, + "supports_forced_tool_use": false }, - "scaleway/qwen/qwen3.6-35b-a3b": { - "input_cost_per_token": 2.5e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 256000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "bedrock_mantle/anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_1hr": 4.4e-06, + "cache_read_input_token_cost": 2.2e-07, + "input_cost_per_token": 2.2e-06, + "litellm_provider": "bedrock_mantle", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.5e-06, + "output_cost_per_token": 1.1e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, "supports_vision": true, - "supports_reasoning": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-anthropic-claude-sonnet-5-5.html" }, - "scaleway/qwen/qwen3-235b-a22b-instruct-2507": { - "input_cost_per_token": 7.5e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 256000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "us.xai.grok-4.6": { + "input_cost_per_token": 2.2e-06, + "output_cost_per_token": 6.6e-06, + "cache_read_input_token_cost": 5.5e-07, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 2.25e-06, - "supports_function_calling": true - }, - "scaleway/qwen/qwen3-embedding-8b": { - "input_cost_per_token": 1e-07, - "litellm_provider": "scaleway", - "mode": "embedding", - "output_cost_per_token": 0.0 + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_function_calling": true, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true }, - "scaleway/qwen/qwen3-coder-30b-a3b-instruct": { - "input_cost_per_token": 2e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 128000, - "max_output_tokens": 32768, - "max_tokens": 32768, + "global.xai.grok-4.6": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 6e-06, + "cache_read_input_token_cost": 5e-07, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 8e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, - "deprecation_date": "2026-10-01" + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true }, - "scaleway/openai/gpt-oss-120b": { - "input_cost_per_token": 1.5e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 128000, - "max_output_tokens": 32768, - "max_tokens": 32768, + "volcengine/doubao-seed-2-0-pro-260215": { + "litellm_provider": "volcengine", + "max_input_tokens": 256000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6e-07, - "supports_function_calling": true - }, - "scaleway/openai/whisper-large-v3": { - "input_cost_per_audio_token": 0.0, - "litellm_provider": "scaleway", - "mode": "audio_transcription", - "output_cost_per_token": 0.0 + "source": "https://docs.volcengine.com/docs/82379/1330310", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": false, + "supports_vision": true, + "tiered_pricing": [ + { + "input_cost_per_token": 4.6e-07, + "output_cost_per_token": 2.3e-06, + "range": [ + 0, + 32000.0 + ] + }, + { + "input_cost_per_token": 7e-07, + "output_cost_per_token": 3.5e-06, + "range": [ + 32000.0, + 128000.0 + ] + }, + { + "input_cost_per_token": 1.4e-06, + "output_cost_per_token": 7e-06, + "range": [ + 128000.0, + 256000.0 + ] + } + ] }, - "scaleway/google/gemma-4-26b-a4b-it": { - "input_cost_per_token": 2.5e-07, - "litellm_provider": "scaleway", + "volcengine/doubao-seed-2-1-pro-260628": { + "cache_read_input_token_cost": 1.725e-07, + "input_cost_per_token": 8.625e-07, + "litellm_provider": "volcengine", "max_input_tokens": 256000, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_output_tokens": 256000, + "max_tokens": 256000, "mode": "chat", - "output_cost_per_token": 5e-07, + "output_cost_per_token": 4.3125e-06, + "source": "https://www.volcengine.com/docs/82379/1544106", "supports_function_calling": true, + "supports_prompt_caching": true, "supports_reasoning": true, + "supports_tool_choice": false, "supports_vision": true }, - "scaleway/google/gemma-3-27b-it": { - "input_cost_per_token": 2.5e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 40000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "volcengine/doubao-seed-2-1-turbo-260628": { + "cache_read_input_token_cost": 8.625e-08, + "input_cost_per_token": 4.3125e-07, + "litellm_provider": "volcengine", + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, "mode": "chat", - "output_cost_per_token": 5e-07, + "output_cost_per_token": 2.15625e-06, + "source": "https://www.volcengine.com/docs/82379/1544106", "supports_function_calling": true, - "supports_vision": true, - "deprecation_date": "2026-08-01" - }, - "scaleway/hcompany/holo2-30b-a3b": { - "input_cost_per_token": 3e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 22000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 7e-07, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_vision": true, - "deprecation_date": "2026-08-09" + "supports_tool_choice": false, + "supports_vision": true }, - "scaleway/mistralai/mistral-medium-3.5-128b": { - "input_cost_per_token": 1.5e-06, - "litellm_provider": "scaleway", + "volcengine/doubao-seed-2-0-lite-260215": { + "litellm_provider": "volcengine", "max_input_tokens": 256000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 7.5e-06, - "supports_reasoning": true, + "source": "https://docs.volcengine.com/docs/82379/1330310", "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": false, "supports_vision": true, - "supports_tool_choice": true + "tiered_pricing": [ + { + "input_cost_per_token": 8.7e-08, + "output_cost_per_token": 5.2e-07, + "range": [ + 0, + 32000.0 + ] + }, + { + "input_cost_per_token": 1.3e-07, + "output_cost_per_token": 7.8e-07, + "range": [ + 32000.0, + 128000.0 + ] + }, + { + "input_cost_per_token": 2.6e-07, + "output_cost_per_token": 1.6e-06, + "range": [ + 128000.0, + 256000.0 + ] + } + ] }, - "scaleway/mistralai/devstral-2-123b-instruct-2512": { - "input_cost_per_token": 4e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 200000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "volcengine/doubao-seed-2-0-mini-260215": { + "litellm_provider": "volcengine", + "max_input_tokens": 256000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2e-06, + "source": "https://docs.volcengine.com/docs/82379/1330310", "supports_function_calling": true, - "deprecation_date": "2026-08-01" - }, - "scaleway/mistralai/voxtral-small-24b-2507": { - "input_cost_per_audio_token": 1.5e-07, - "input_cost_per_token": 1.5e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 32000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 3.5e-07, - "supports_audio_input": true, - "deprecation_date": "2026-08-01" + "supports_reasoning": true, + "supports_tool_choice": false, + "supports_vision": true, + "tiered_pricing": [ + { + "input_cost_per_token": 2.9e-08, + "output_cost_per_token": 2.9e-07, + "range": [ + 0, + 32000.0 + ] + }, + { + "input_cost_per_token": 5.8e-08, + "output_cost_per_token": 5.8e-07, + "range": [ + 32000.0, + 128000.0 + ] + }, + { + "input_cost_per_token": 1.2e-07, + "output_cost_per_token": 1.2e-06, + "range": [ + 128000.0, + 256000.0 + ] + } + ] }, - "scaleway/mistralai/mistral-small-3.2-24b-instruct-2506": { - "input_cost_per_token": 1.5e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 128000, - "max_output_tokens": 32768, - "max_tokens": 32768, + "volcengine/doubao-seed-2-0-code-preview-260215": { + "litellm_provider": "volcengine", + "max_input_tokens": 256000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3.5e-07, + "source": "https://docs.volcengine.com/docs/82379/1330310", "supports_function_calling": true, - "supports_vision": true - }, - "scaleway/mistralai/pixtral-12b-2409": { - "input_cost_per_token": 2e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 2e-07, + "supports_reasoning": true, + "supports_tool_choice": false, "supports_vision": true, - "supports_function_calling": true, - "deprecation_date": "2026-10-01" - }, - "scaleway/BAAI/bge-multilingual-gemma2": { - "input_cost_per_token": 1e-07, - "litellm_provider": "scaleway", - "mode": "embedding", - "output_cost_per_token": 0.0 - }, - "scaleway/meta/llama-3.3-70b-instruct": { - "input_cost_per_token": 9e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 9e-07, - "supports_function_calling": true + "tiered_pricing": [ + { + "input_cost_per_token": 4.6e-07, + "output_cost_per_token": 2.3e-06, + "range": [ + 0, + 32000.0 + ] + }, + { + "input_cost_per_token": 7e-07, + "output_cost_per_token": 3.5e-06, + "range": [ + 32000.0, + 128000.0 + ] + }, + { + "input_cost_per_token": 1.4e-06, + "output_cost_per_token": 7e-06, + "range": [ + 128000.0, + 256000.0 + ] + } + ] }, - "novita/deepseek/deepseek-v3.2": { - "litellm_provider": "novita", + "bedrock/us-east-1/zai.glm-5": { + "input_cost_per_token": 1e-06, + "output_cost_per_token": 3.2e-06, + "litellm_provider": "bedrock", + "max_input_tokens": 200000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "input_cost_per_token": 2.69e-07, - "output_cost_per_token": 4e-07, - "max_input_tokens": 163840, - "max_output_tokens": 65536, - "max_tokens": 65536, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_reasoning": true, "supports_system_messages": true, - "supports_response_schema": true, - "cache_read_input_token_cost": 1.345e-07, - "input_cost_per_token_cache_hit": 1.345e-07, - "supports_reasoning": true - }, - "novita/minimax/minimax-m2.1": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, - "max_input_tokens": 204800, - "max_output_tokens": 131072, - "max_tokens": 131072, - "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_native_structured_output": true, "supports_tool_choice": true, - "supports_system_messages": true, + "supports_audio_input": false, "supports_response_schema": true, - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token_cache_hit": 3e-08 + "supports_vision": false, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "novita/zai-org/glm-4.7": { - "litellm_provider": "novita", + "bedrock/us-west-2/zai.glm-5": { + "input_cost_per_token": 1e-06, + "output_cost_per_token": 3.2e-06, + "litellm_provider": "bedrock", + "max_input_tokens": 200000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.2e-06, - "max_input_tokens": 204800, - "max_output_tokens": 131072, - "max_tokens": 131072, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_reasoning": true, "supports_system_messages": true, - "supports_response_schema": true, - "cache_read_input_token_cost": 1.1e-07, - "input_cost_per_token_cache_hit": 1.1e-07, - "supports_reasoning": true - }, - "novita/xiaomimimo/mimo-v2-flash": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 1.1e-07, - "output_cost_per_token": 3.3e-07, - "max_input_tokens": 262144, - "max_output_tokens": 32000, - "max_tokens": 32000, - "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_native_structured_output": true, "supports_tool_choice": true, - "supports_system_messages": true, + "supports_audio_input": false, "supports_response_schema": true, - "cache_read_input_token_cost": 2.4e-08, - "input_cost_per_token_cache_hit": 2.4e-08, - "supports_reasoning": true - }, - "novita/zai-org/autoglm-phone-9b-multilingual": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 3.5e-08, - "output_cost_per_token": 1.38e-07, - "max_input_tokens": 65536, - "max_output_tokens": 65536, - "max_tokens": 65536, - "supports_vision": true, - "supports_system_messages": true + "supports_vision": false, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "novita/moonshotai/kimi-k2-thinking": { - "litellm_provider": "novita", + "bedrock/us-gov-east-1/anthropic.claude-haiku-4-5-20251001-v1:0": { + "cache_creation_input_token_cost": 1.5e-06, + "cache_creation_input_token_cost_above_1hr": 2.4e-06, + "cache_read_input_token_cost": 1.2e-07, + "input_cost_per_token": 1.2e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 200000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.5e-06, - "max_input_tokens": 262144, - "max_output_tokens": 100352, - "max_tokens": 100352, + "output_cost_per_token": 6e-06, + "source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock", + "supports_assistant_prefill": true, + "supports_computer_use": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true, - "supports_response_schema": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "cache_read_input_token_cost": 1.5e-07, - "supports_prompt_caching": true - }, - "novita/minimax/minimax-m2": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, - "max_input_tokens": 204800, - "max_output_tokens": 131072, - "max_tokens": 131072, - "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_system_messages": true, - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token_cache_hit": 3e-08, - "supports_reasoning": true, - "supports_response_schema": true - }, - "novita/paddlepaddle/paddleocr-vl": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 2e-08, - "output_cost_per_token": 2e-08, - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, "supports_vision": true, - "supports_system_messages": true + "supports_native_structured_output": true, + "supports_pdf_input": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 4096 }, - "novita/deepseek/deepseek-v3.2-exp": { - "litellm_provider": "novita", + "bedrock/us-gov-west-1/anthropic.claude-haiku-4-5-20251001-v1:0": { + "cache_creation_input_token_cost": 1.5e-06, + "cache_creation_input_token_cost_above_1hr": 2.4e-06, + "cache_read_input_token_cost": 1.2e-07, + "input_cost_per_token": 1.2e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 200000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "input_cost_per_token": 2.7e-07, - "output_cost_per_token": 4.1e-07, - "max_input_tokens": 163840, - "max_output_tokens": 65536, - "max_tokens": 65536, + "output_cost_per_token": 6e-06, + "source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock", + "supports_assistant_prefill": true, + "supports_computer_use": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_reasoning": true - }, - "novita/qwen/qwen3-vl-235b-a22b-thinking": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 9.8e-07, - "output_cost_per_token": 3.95e-06, - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "supports_tool_choice": true, "supports_vision": true, - "supports_system_messages": true, - "supports_reasoning": true, - "supports_function_calling": true, - "supports_tool_choice": true + "supports_native_structured_output": true, + "supports_pdf_input": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 4096 }, - "novita/zai-org/glm-4.6v": { - "litellm_provider": "novita", + "snowflake/claude-sonnet-4-5": { + "max_tokens": 16384, + "max_input_tokens": 200000, + "max_output_tokens": 16384, + "input_cost_per_token": 3e-06, + "output_cost_per_token": 1.5e-05, + "cache_read_input_token_cost": 3e-07, + "litellm_provider": "snowflake", "mode": "chat", - "input_cost_per_token": 3e-07, - "output_cost_per_token": 9e-07, - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, "supports_vision": true, + "supports_prompt_caching": true, "supports_system_messages": true, "supports_response_schema": true, - "cache_read_input_token_cost": 5.5e-08, - "input_cost_per_token_cache_hit": 5.5e-08, - "supports_reasoning": true + "prompt_cache_min_tokens": 1024 }, - "novita/zai-org/glm-4.6": { - "litellm_provider": "novita", + "snowflake/claude-sonnet-4-6": { + "supports_adaptive_thinking": true, + "supports_legacy_thinking": true, + "max_tokens": 16384, + "max_input_tokens": 200000, + "max_output_tokens": 16384, + "input_cost_per_token": 3e-06, + "output_cost_per_token": 1.5e-05, + "cache_read_input_token_cost": 3e-07, + "litellm_provider": "snowflake", "mode": "chat", - "input_cost_per_token": 5.5e-07, - "output_cost_per_token": 2.2e-06, - "max_input_tokens": 204800, - "max_output_tokens": 131072, - "max_tokens": 131072, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_vision": true, + "supports_prompt_caching": true, "supports_system_messages": true, "supports_response_schema": true, - "cache_read_input_token_cost": 1.1e-07, - "input_cost_per_token_cache_hit": 1.1e-07, - "supports_reasoning": true + "prompt_cache_min_tokens": 1024 }, - "novita/kwaipilot/kat-coder-pro": { - "litellm_provider": "novita", + "snowflake/claude-4-sonnet": { + "max_tokens": 16384, + "max_input_tokens": 200000, + "max_output_tokens": 16384, + "input_cost_per_token": 3e-06, + "output_cost_per_token": 1.5e-05, + "cache_read_input_token_cost": 3e-07, + "litellm_provider": "snowflake", "mode": "chat", - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, - "max_input_tokens": 256000, - "max_output_tokens": 128000, - "max_tokens": 128000, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_vision": true, + "supports_prompt_caching": true, "supports_system_messages": true, "supports_response_schema": true, - "cache_read_input_token_cost": 6e-08, - "input_cost_per_token_cache_hit": 6e-08 + "prompt_cache_min_tokens": 1024 }, - "novita/qwen/qwen3-next-80b-a3b-instruct": { - "litellm_provider": "novita", + "snowflake/claude-4-opus": { + "max_tokens": 16384, + "max_input_tokens": 200000, + "max_output_tokens": 16384, + "input_cost_per_token": 5e-06, + "output_cost_per_token": 2.5e-05, + "cache_read_input_token_cost": 5e-07, + "litellm_provider": "snowflake", "mode": "chat", - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 1.5e-06, - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_vision": true, + "supports_prompt_caching": true, "supports_system_messages": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_reasoning": true + "prompt_cache_min_tokens": 1024 }, - "novita/qwen/qwen3-next-80b-a3b-thinking": { - "litellm_provider": "novita", + "snowflake/claude-haiku-4-5": { + "max_tokens": 16384, + "max_input_tokens": 200000, + "max_output_tokens": 16384, + "input_cost_per_token": 1e-06, + "output_cost_per_token": 5e-06, + "cache_read_input_token_cost": 1e-07, + "litellm_provider": "snowflake", "mode": "chat", - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 1.5e-06, - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_vision": true, + "supports_prompt_caching": true, "supports_system_messages": true, "supports_response_schema": true, - "supports_reasoning": true + "prompt_cache_min_tokens": 4096 }, - "novita/deepseek/deepseek-ocr": { - "litellm_provider": "novita", + "snowflake/claude-3-7-sonnet": { + "max_tokens": 16384, + "max_input_tokens": 200000, + "max_output_tokens": 16384, + "input_cost_per_token": 3e-06, + "output_cost_per_token": 1.5e-05, + "cache_read_input_token_cost": 3e-07, + "litellm_provider": "snowflake", "mode": "chat", - "input_cost_per_token": 3e-08, - "output_cost_per_token": 3e-08, - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "supports_tool_choice": true, + "supports_function_calling": true, "supports_vision": true, + "supports_prompt_caching": true, "supports_system_messages": true, + "supports_reasoning": true, "supports_response_schema": true }, - "novita/deepseek/deepseek-v3.1-terminus": { - "litellm_provider": "novita", + "snowflake/openai-gpt-4.1": { + "max_tokens": 16384, + "max_input_tokens": 300000, + "max_output_tokens": 16384, + "input_cost_per_token": 2e-06, + "output_cost_per_token": 8e-06, + "cache_read_input_token_cost": 5e-07, + "litellm_provider": "snowflake", "mode": "chat", - "input_cost_per_token": 2.7e-07, - "output_cost_per_token": 1e-06, - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_vision": true, + "supports_prompt_caching": true, "supports_system_messages": true, - "supports_response_schema": true, - "cache_read_input_token_cost": 1.35e-07, - "input_cost_per_token_cache_hit": 1.35e-07, - "supports_reasoning": true + "supports_response_schema": true }, - "novita/qwen/qwen3-vl-235b-a22b-instruct": { - "litellm_provider": "novita", + "snowflake/openai-gpt-5": { + "max_tokens": 16384, + "max_input_tokens": 300000, + "max_output_tokens": 16384, + "input_cost_per_token": 1.25e-06, + "output_cost_per_token": 1e-05, + "cache_read_input_token_cost": 1.25e-07, + "litellm_provider": "snowflake", "mode": "chat", - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.5e-06, - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, "supports_vision": true, + "supports_prompt_caching": true, "supports_system_messages": true, + "supports_reasoning": true, "supports_response_schema": true }, - "novita/qwen/qwen3-max": { - "litellm_provider": "novita", + "snowflake/openai-gpt-5-mini": { + "max_tokens": 16384, + "max_input_tokens": 1000000, + "max_output_tokens": 16384, + "input_cost_per_token": 3e-07, + "output_cost_per_token": 1.2e-06, + "litellm_provider": "snowflake", "mode": "chat", - "input_cost_per_token": 2.11e-06, - "output_cost_per_token": 8.45e-06, - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, "supports_system_messages": true, "supports_response_schema": true }, - "novita/skywork/r1v4-lite": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 2e-07, + "snowflake/openai-gpt-5-nano": { + "max_tokens": 16384, + "max_input_tokens": 5000000, + "max_output_tokens": 16384, + "input_cost_per_token": 1.5e-07, "output_cost_per_token": 6e-07, - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, - "supports_tool_choice": true, - "supports_vision": true, + "litellm_provider": "snowflake", + "mode": "chat", + "supports_function_calling": true, "supports_system_messages": true, "supports_response_schema": true }, - "novita/deepseek/deepseek-v3.1": { - "litellm_provider": "novita", + "snowflake/llama4-maverick": { + "max_tokens": 16384, + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "input_cost_per_token": 2.4e-07, + "output_cost_per_token": 9.7e-07, + "litellm_provider": "snowflake", "mode": "chat", - "input_cost_per_token": 2.7e-07, - "output_cost_per_token": 1e-06, - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_system_messages": true + }, + "snowflake/snowflake-arctic-embed-l-v2.0": { + "max_tokens": 8192, + "max_input_tokens": 8192, + "input_cost_per_token": 7e-08, + "output_cost_per_token": 0.0, + "litellm_provider": "snowflake", + "mode": "embedding" + }, + "snowflake/snowflake-arctic-embed-m-v2.0": { + "max_tokens": 8192, + "max_input_tokens": 8192, + "input_cost_per_token": 7e-08, + "output_cost_per_token": 0.0, + "litellm_provider": "snowflake", + "mode": "embedding" + }, + "soniox/stt-async-v4": { + "litellm_provider": "soniox", + "max_output_tokens": 8000, + "max_tokens": 8000, + "input_cost_per_second": 0.0, + "output_cost_per_second": 2.77778e-05, + "mode": "audio_transcription", + "source": "https://soniox.com/pricing", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ], + "supports_audio_input": true + }, + "soniox/stt-async-v5": { + "litellm_provider": "soniox", + "max_output_tokens": 8000, + "max_tokens": 8000, + "input_cost_per_second": 0.0, + "output_cost_per_second": 2.77778e-05, + "mode": "audio_transcription", + "source": "https://soniox.com/pricing", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ], + "supports_audio_input": true + }, + "tensormesh/Qwen/Qwen3.5-397B-A17B-FP8": { + "litellm_provider": "tensormesh", + "mode": "chat", + "input_cost_per_token": 6e-07, + "output_cost_per_token": 3.6e-06, + "cache_read_input_token_cost": 0, + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "supports_function_calling": true, "supports_tool_choice": true, - "supports_system_messages": true, "supports_response_schema": true, - "cache_read_input_token_cost": 1.35e-07, - "input_cost_per_token_cache_hit": 1.35e-07, - "supports_reasoning": true + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_reasoning": true, + "source": "https://serverless.tensormesh.ai/v1/models/openrouter" }, - "novita/moonshotai/kimi-k2-0905": { - "litellm_provider": "novita", + "tensormesh/Qwen/Qwen3-Coder-480B-A35B-Instruct-FP8": { + "litellm_provider": "tensormesh", "mode": "chat", - "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.5e-06, + "input_cost_per_token": 4.5e-07, + "output_cost_per_token": 1.8e-06, + "cache_read_input_token_cost": 0, "max_input_tokens": 262144, - "max_output_tokens": 100352, - "max_tokens": 100352, + "max_output_tokens": 262144, "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_tool_choice": true, + "supports_response_schema": true, + "supports_prompt_caching": true, "supports_system_messages": true, - "supports_response_schema": true + "source": "https://serverless.tensormesh.ai/v1/models/openrouter" }, - "novita/qwen/qwen3-coder-480b-a35b-instruct": { - "litellm_provider": "novita", + "tensormesh/Qwen/Qwen3.6-27B-FP8": { + "litellm_provider": "tensormesh", "mode": "chat", - "input_cost_per_token": 3.8e-07, - "output_cost_per_token": 1.55e-06, + "input_cost_per_token": 3.2e-07, + "output_cost_per_token": 3.2e-06, + "cache_read_input_token_cost": 0, "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 262144, "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_tool_choice": true, + "supports_response_schema": true, + "supports_prompt_caching": true, "supports_system_messages": true, - "supports_response_schema": true + "supports_reasoning": true, + "source": "https://serverless.tensormesh.ai/v1/models/openrouter" }, - "novita/qwen/qwen3-coder-30b-a3b-instruct": { - "litellm_provider": "novita", + "tensormesh/lukealonso/GLM-5.1-NVFP4-MTP": { + "litellm_provider": "tensormesh", "mode": "chat", - "input_cost_per_token": 7e-08, - "output_cost_per_token": 2.7e-07, - "max_input_tokens": 160000, - "max_output_tokens": 32768, - "max_tokens": 32768, + "input_cost_per_token": 1.4e-06, + "output_cost_per_token": 4.4e-06, + "cache_read_input_token_cost": 0, + "max_input_tokens": 202752, + "max_output_tokens": 202752, "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_tool_choice": true, + "supports_response_schema": true, + "supports_prompt_caching": true, "supports_system_messages": true, - "supports_response_schema": true + "supports_reasoning": true, + "source": "https://serverless.tensormesh.ai/v1/models/openrouter" }, - "novita/openai/gpt-oss-120b": { - "litellm_provider": "novita", + "tensormesh/deepseek-ai/DeepSeek-V4-Flash": { + "litellm_provider": "tensormesh", "mode": "chat", - "input_cost_per_token": 5e-08, - "output_cost_per_token": 2.5e-07, - "max_input_tokens": 131072, + "input_cost_per_token": 1.4e-07, + "output_cost_per_token": 2.8e-07, + "cache_read_input_token_cost": 0, + "max_input_tokens": 32768, "max_output_tokens": 32768, - "max_tokens": 32768, "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_system_messages": true, "supports_response_schema": true, - "supports_reasoning": true + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_reasoning": true, + "source": "https://serverless.tensormesh.ai/v1/models/openrouter" }, - "novita/moonshotai/kimi-k2-instruct": { - "litellm_provider": "novita", + "tensormesh/moonshotai/Kimi-K2.6": { + "litellm_provider": "tensormesh", "mode": "chat", - "input_cost_per_token": 5.7e-07, - "output_cost_per_token": 2.3e-06, - "max_input_tokens": 131072, - "max_output_tokens": 100352, - "max_tokens": 100352, + "input_cost_per_token": 9.6e-07, + "output_cost_per_token": 4e-06, + "cache_read_input_token_cost": 0, + "max_input_tokens": 32768, + "max_output_tokens": 32768, "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_tool_choice": true, + "supports_response_schema": true, + "supports_prompt_caching": true, "supports_system_messages": true, - "supports_response_schema": true + "supports_reasoning": true, + "source": "https://serverless.tensormesh.ai/v1/models/openrouter" }, - "novita/deepseek/deepseek-v3-0324": { - "litellm_provider": "novita", + "tensormesh/MiniMaxAI/MiniMax-M2.5": { + "litellm_provider": "tensormesh", "mode": "chat", - "input_cost_per_token": 2.7e-07, - "output_cost_per_token": 1.12e-06, - "max_input_tokens": 163840, - "max_output_tokens": 65536, - "max_tokens": 65536, + "input_cost_per_token": 3e-07, + "output_cost_per_token": 1.2e-06, + "cache_read_input_token_cost": 0, + "max_input_tokens": 196608, + "max_output_tokens": 196608, "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_tool_choice": true, + "supports_response_schema": true, + "supports_prompt_caching": true, "supports_system_messages": true, + "supports_reasoning": true, + "source": "https://serverless.tensormesh.ai/v1/models/openrouter" + }, + "tensormesh/google/gemma-4-31B-it": { + "litellm_provider": "tensormesh", + "mode": "chat", + "input_cost_per_token": 1.4e-07, + "output_cost_per_token": 5.6e-07, + "cache_read_input_token_cost": 0, + "max_input_tokens": 32768, + "max_output_tokens": 32768, + "supports_function_calling": true, + "supports_tool_choice": true, "supports_response_schema": true, - "cache_read_input_token_cost": 1.35e-07, - "input_cost_per_token_cache_hit": 1.35e-07 + "supports_prompt_caching": true, + "supports_system_messages": true, + "supports_reasoning": true, + "source": "https://serverless.tensormesh.ai/v1/models/openrouter" }, - "novita/zai-org/glm-4.5": { - "litellm_provider": "novita", + "tensormesh/openai/gpt-oss-120b": { + "litellm_provider": "tensormesh", "mode": "chat", - "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.2e-06, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "cache_read_input_token_cost": 0, "max_input_tokens": 131072, - "max_output_tokens": 98304, - "max_tokens": 98304, + "max_output_tokens": 131072, "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_tool_choice": true, + "supports_response_schema": true, + "supports_prompt_caching": true, "supports_system_messages": true, - "cache_read_input_token_cost": 1.1e-07, - "input_cost_per_token_cache_hit": 1.1e-07, - "supports_reasoning": true + "supports_reasoning": true, + "source": "https://serverless.tensormesh.ai/v1/models/openrouter" }, - "novita/qwen/qwen3-235b-a22b-thinking-2507": { - "litellm_provider": "novita", + "tensormesh/openai/gpt-oss-20b": { + "litellm_provider": "tensormesh", "mode": "chat", - "input_cost_per_token": 3e-07, - "output_cost_per_token": 3e-06, + "input_cost_per_token": 7e-08, + "output_cost_per_token": 2.8e-07, + "cache_read_input_token_cost": 0, "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_output_tokens": 131072, "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_tool_choice": true, + "supports_response_schema": true, + "supports_prompt_caching": true, "supports_system_messages": true, - "supports_reasoning": true + "supports_reasoning": true, + "source": "https://serverless.tensormesh.ai/v1/models/openrouter" }, - "novita/meta-llama/llama-3.1-8b-instruct": { - "litellm_provider": "novita", + "deepseek-flash": { + "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 6e-09, + "input_cost_per_token": 3e-07, + "input_cost_per_token_cache_hit": 6e-09, + "litellm_provider": "deepseek", + "max_input_tokens": 1000000, + "max_output_tokens": 393216, + "max_tokens": 393216, "mode": "chat", - "input_cost_per_token": 2e-08, - "output_cost_per_token": 5e-08, - "max_input_tokens": 16384, - "max_output_tokens": 16384, - "max_tokens": 16384, + "off_peak_pricing": { + "cache_read_input_token_cost": 3e-09, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "windows": [ + { + "hours_utc": [ + "00:00-01:00", + "04:00-06:00", + "10:00-00:00" + ], + "weekdays": [ + 1, + 2, + 3, + 4, + 5 + ] + }, + { + "hours_utc": "00:00-00:00", + "weekdays": [ + 6, + 7 + ] + } + ] + }, + "output_cost_per_token": 1.2e-06, + "source": "https://api-docs.deepseek.com/quick_start/pricing", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_assistant_prefill": true, + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_system_messages": true, - "supports_response_schema": true + "supports_tool_choice": true, + "supports_vision": true }, - "novita/google/gemma-3-12b-it": { - "litellm_provider": "novita", + "deepseek-v4-flash": { + "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 6e-09, + "input_cost_per_token": 3e-07, + "input_cost_per_token_cache_hit": 6e-09, + "litellm_provider": "deepseek", + "max_input_tokens": 1000000, + "max_output_tokens": 393216, + "max_tokens": 393216, "mode": "chat", - "input_cost_per_token": 5e-08, - "output_cost_per_token": 1e-07, - "max_input_tokens": 131072, - "max_output_tokens": 8192, - "max_tokens": 8192, - "supports_tool_choice": true, - "supports_vision": true, + "off_peak_pricing": { + "cache_read_input_token_cost": 3e-09, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "windows": [ + { + "hours_utc": [ + "00:00-01:00", + "04:00-06:00", + "10:00-00:00" + ], + "weekdays": [ + 1, + 2, + 3, + 4, + 5 + ] + }, + { + "hours_utc": "00:00-00:00", + "weekdays": [ + 6, + 7 + ] + } + ] + }, + "output_cost_per_token": 1.2e-06, + "source": "https://api-docs.deepseek.com/quick_start/pricing", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_assistant_prefill": true, + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_system_messages": true, - "supports_response_schema": true + "supports_tool_choice": true, + "supports_vision": true }, - "novita/zai-org/glm-4.5v": { - "litellm_provider": "novita", + "deepseek-v4-flash-vision-exp": { + "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 6e-09, + "input_cost_per_token": 3e-07, + "input_cost_per_token_cache_hit": 6e-09, + "litellm_provider": "deepseek", + "max_input_tokens": 1000000, + "max_output_tokens": 393216, + "max_tokens": 393216, "mode": "chat", - "input_cost_per_token": 6e-07, - "output_cost_per_token": 1.8e-06, - "max_input_tokens": 65536, - "max_output_tokens": 16384, - "max_tokens": 16384, + "off_peak_pricing": { + "cache_read_input_token_cost": 3e-09, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "windows": [ + { + "hours_utc": [ + "00:00-01:00", + "04:00-06:00", + "10:00-00:00" + ], + "weekdays": [ + 1, + 2, + 3, + 4, + 5 + ] + }, + { + "hours_utc": "00:00-00:00", + "weekdays": [ + 6, + 7 + ] + } + ] + }, + "output_cost_per_token": 1.2e-06, + "source": "https://api-docs.deepseek.com/quick_start/pricing", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_assistant_prefill": true, "supports_function_calling": true, + "supports_native_streaming": true, "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_system_messages": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "cache_read_input_token_cost": 1.1e-07, - "input_cost_per_token_cache_hit": 1.1e-07, - "supports_reasoning": true - }, - "novita/openai/gpt-oss-20b": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 4e-08, - "output_cost_per_token": 1.5e-07, - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, - "supports_tool_choice": true, - "supports_vision": false, "supports_system_messages": true, - "supports_response_schema": true, - "supports_reasoning": true + "supports_tool_choice": true, + "supports_vision": true }, - "novita/qwen/qwen3-235b-a22b-instruct-2507": { - "litellm_provider": "novita", + "deepseek-v4-pro": { + "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 4.4e-08, + "input_cost_per_token": 1.32e-06, + "input_cost_per_token_cache_hit": 4.4e-08, + "litellm_provider": "deepseek", + "max_input_tokens": 1000000, + "max_output_tokens": 393216, + "max_tokens": 393216, "mode": "chat", - "input_cost_per_token": 9e-08, - "output_cost_per_token": 5.8e-07, - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "off_peak_pricing": { + "cache_read_input_token_cost": 2.2e-08, + "input_cost_per_token": 6.6e-07, + "output_cost_per_token": 1.98e-06, + "windows": [ + { + "hours_utc": [ + "00:00-01:00", + "04:00-06:00", + "10:00-00:00" + ], + "weekdays": [ + 1, + 2, + 3, + 4, + 5 + ] + }, + { + "hours_utc": "00:00-00:00", + "weekdays": [ + 6, + 7 + ] + } + ] + }, + "output_cost_per_token": 3.96e-06, + "source": "https://api-docs.deepseek.com/quick_start/pricing", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_assistant_prefill": true, "supports_function_calling": true, + "supports_native_streaming": true, "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_system_messages": true, - "supports_response_schema": true - }, - "novita/deepseek/deepseek-r1-distill-qwen-14b": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 1.5e-07, - "max_input_tokens": 32768, - "max_output_tokens": 16384, - "max_tokens": 16384, "supports_tool_choice": true, - "supports_system_messages": true, - "supports_response_schema": true, - "supports_reasoning": true + "supports_vision": false }, - "novita/meta-llama/llama-3.3-70b-instruct": { - "litellm_provider": "novita", + "deepseek/deepseek-flash": { + "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 6e-09, + "input_cost_per_token": 3e-07, + "input_cost_per_token_cache_hit": 6e-09, + "litellm_provider": "deepseek", + "max_input_tokens": 1000000, + "max_output_tokens": 393216, + "max_tokens": 393216, "mode": "chat", - "input_cost_per_token": 1.35e-07, - "output_cost_per_token": 4e-07, - "max_input_tokens": 12288, - "max_output_tokens": 12288, - "max_tokens": 12288, + "off_peak_pricing": { + "cache_read_input_token_cost": 3e-09, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "windows": [ + { + "hours_utc": [ + "00:00-01:00", + "04:00-06:00", + "10:00-00:00" + ], + "weekdays": [ + 1, + 2, + 3, + 4, + 5 + ] + }, + { + "hours_utc": "00:00-00:00", + "weekdays": [ + 6, + 7 + ] + } + ] + }, + "output_cost_per_token": 1.2e-06, + "source": "https://api-docs.deepseek.com/quick_start/pricing", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_assistant_prefill": true, "supports_function_calling": true, + "supports_native_streaming": true, "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_system_messages": true, - "supports_response_schema": true + "supports_tool_choice": true, + "supports_vision": true }, - "novita/qwen/qwen-2.5-72b-instruct": { - "litellm_provider": "novita", + "deepseek/deepseek-v4-flash": { + "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 6e-09, + "input_cost_per_token": 3e-07, + "input_cost_per_token_cache_hit": 6e-09, + "litellm_provider": "deepseek", + "max_input_tokens": 1000000, + "max_output_tokens": 393216, + "max_tokens": 393216, "mode": "chat", - "input_cost_per_token": 3.8e-07, - "output_cost_per_token": 4e-07, - "max_input_tokens": 32000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "off_peak_pricing": { + "cache_read_input_token_cost": 3e-09, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "windows": [ + { + "hours_utc": [ + "00:00-01:00", + "04:00-06:00", + "10:00-00:00" + ], + "weekdays": [ + 1, + 2, + 3, + 4, + 5 + ] + }, + { + "hours_utc": "00:00-00:00", + "weekdays": [ + 6, + 7 + ] + } + ] + }, + "output_cost_per_token": 1.2e-06, + "source": "https://api-docs.deepseek.com/quick_start/pricing", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_assistant_prefill": true, "supports_function_calling": true, + "supports_native_streaming": true, "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_system_messages": true, - "supports_response_schema": true - }, - "novita/mistralai/mistral-nemo": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 4e-08, - "output_cost_per_token": 1.7e-07, - "max_input_tokens": 60288, - "max_output_tokens": 16000, - "max_tokens": 16000, "supports_tool_choice": true, - "supports_system_messages": true, - "supports_response_schema": true + "supports_vision": true }, - "novita/minimaxai/minimax-m1-80k": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 5.5e-07, - "output_cost_per_token": 2.2e-06, + "deepseek/deepseek-v4-flash-vision-exp": { + "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 6e-09, + "input_cost_per_token": 3e-07, + "input_cost_per_token_cache_hit": 6e-09, + "litellm_provider": "deepseek", "max_input_tokens": 1000000, - "max_output_tokens": 40000, - "max_tokens": 40000, + "max_output_tokens": 393216, + "max_tokens": 393216, + "mode": "chat", + "off_peak_pricing": { + "cache_read_input_token_cost": 3e-09, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "windows": [ + { + "hours_utc": [ + "00:00-01:00", + "04:00-06:00", + "10:00-00:00" + ], + "weekdays": [ + 1, + 2, + 3, + 4, + 5 + ] + }, + { + "hours_utc": "00:00-00:00", + "weekdays": [ + 6, + 7 + ] + } + ] + }, + "output_cost_per_token": 1.2e-06, + "source": "https://api-docs.deepseek.com/quick_start/pricing", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_assistant_prefill": true, "supports_function_calling": true, + "supports_native_streaming": true, "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true }, - "novita/deepseek/deepseek-r1-0528": { - "litellm_provider": "novita", + "deepseek/deepseek-v4-pro": { + "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 4.4e-08, + "input_cost_per_token": 1.32e-06, + "input_cost_per_token_cache_hit": 4.4e-08, + "litellm_provider": "deepseek", + "max_input_tokens": 1000000, + "max_output_tokens": 393216, + "max_tokens": 393216, "mode": "chat", - "input_cost_per_token": 7e-07, - "output_cost_per_token": 2.5e-06, - "max_input_tokens": 163840, - "max_output_tokens": 32768, - "max_tokens": 32768, + "off_peak_pricing": { + "cache_read_input_token_cost": 2.2e-08, + "input_cost_per_token": 6.6e-07, + "output_cost_per_token": 1.98e-06, + "windows": [ + { + "hours_utc": [ + "00:00-01:00", + "04:00-06:00", + "10:00-00:00" + ], + "weekdays": [ + 1, + 2, + 3, + 4, + 5 + ] + }, + { + "hours_utc": "00:00-00:00", + "weekdays": [ + 6, + 7 + ] + } + ] + }, + "output_cost_per_token": 3.96e-06, + "source": "https://api-docs.deepseek.com/quick_start/pricing", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_assistant_prefill": true, "supports_function_calling": true, + "supports_native_streaming": true, "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true, - "supports_response_schema": true, - "cache_read_input_token_cost": 3.5e-07, - "input_cost_per_token_cache_hit": 3.5e-07, - "supports_reasoning": true - }, - "novita/deepseek/deepseek-r1-distill-qwen-32b": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 3e-07, - "output_cost_per_token": 3e-07, - "max_input_tokens": 64000, - "max_output_tokens": 32000, - "max_tokens": 32000, - "supports_tool_choice": true, - "supports_system_messages": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_reasoning": true - }, - "novita/meta-llama/llama-3-8b-instruct": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 4e-08, - "output_cost_per_token": 4e-08, - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "supports_system_messages": true, - "supports_response_schema": true - }, - "novita/microsoft/wizardlm-2-8x22b": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 6.2e-07, - "output_cost_per_token": 6.2e-07, - "max_input_tokens": 65535, - "max_output_tokens": 8000, - "max_tokens": 8000, - "supports_system_messages": true, - "supports_response_schema": true - }, - "novita/deepseek/deepseek-r1-0528-qwen3-8b": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 6e-08, - "output_cost_per_token": 9e-08, - "max_input_tokens": 128000, - "max_output_tokens": 32000, - "max_tokens": 32000, - "supports_system_messages": true, - "supports_reasoning": true - }, - "novita/deepseek/deepseek-r1-distill-llama-70b": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 8e-07, - "output_cost_per_token": 8e-07, - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "supports_tool_choice": true, "supports_system_messages": true, - "supports_response_schema": true, - "supports_reasoning": true - }, - "novita/meta-llama/llama-3-70b-instruct": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 5.1e-07, - "output_cost_per_token": 7.4e-07, - "max_input_tokens": 8192, - "max_output_tokens": 8000, - "max_tokens": 8000, "supports_tool_choice": true, - "supports_system_messages": true, - "supports_response_schema": true + "supports_vision": false }, - "novita/qwen/qwen3-235b-a22b-fp8": { - "litellm_provider": "novita", + "tencent/deepseek-v4-pro": { + "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 3.625e-09, + "input_cost_per_token": 4.35e-07, + "input_cost_per_token_cache_hit": 3.625e-09, + "litellm_provider": "tencent", + "max_input_tokens": 1000000, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", - "input_cost_per_token": 2e-07, - "output_cost_per_token": 8e-07, - "max_input_tokens": 40960, - "max_output_tokens": 20000, - "max_tokens": 20000, + "output_cost_per_token": 8.7e-07, + "source": "https://www.tencentcloud.com/products/tokenhub", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_assistant_prefill": true, + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_response_schema": true, "supports_system_messages": true, + "supports_tool_choice": true, "supports_reasoning": true, - "supports_response_schema": true + "supports_vision": false }, - "novita/meta-llama/llama-4-maverick-17b-128e-instruct-fp8": { - "litellm_provider": "novita", + "tencent/deepseek-v4-flash": { + "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 2.8e-09, + "input_cost_per_token": 1.4e-07, + "input_cost_per_token_cache_hit": 2.8e-09, + "litellm_provider": "tencent", + "max_input_tokens": 1000000, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", - "input_cost_per_token": 2.7e-07, - "output_cost_per_token": 8.5e-07, - "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, - "supports_vision": true, + "output_cost_per_token": 2.8e-07, + "source": "https://www.tencentcloud.com/products/tokenhub", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_assistant_prefill": true, + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_response_schema": true, "supports_system_messages": true, - "supports_response_schema": true - }, - "novita/meta-llama/llama-4-scout-17b-16e-instruct": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 1.8e-07, - "output_cost_per_token": 5.9e-07, - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "max_tokens": 131072, - "supports_vision": true, - "supports_system_messages": true - }, - "novita/nousresearch/hermes-2-pro-llama-3-8b": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 1.4e-07, - "output_cost_per_token": 1.4e-07, - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, "supports_tool_choice": true, - "supports_system_messages": true, - "supports_response_schema": true + "supports_reasoning": true, + "supports_vision": false }, - "novita/qwen/qwen2.5-vl-72b-instruct": { - "litellm_provider": "novita", + "tencent/minimax-m3": { + "cache_creation_input_token_cost": 0.0, + "cache_read_input_token_cost": 6e-08, + "input_cost_per_token": 3e-07, + "input_cost_per_token_cache_hit": 6e-08, + "litellm_provider": "tencent", + "max_input_tokens": 1000000, "mode": "chat", - "input_cost_per_token": 8e-07, - "output_cost_per_token": 8e-07, - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "max_tokens": 32768, - "supports_vision": true, - "supports_system_messages": true + "output_cost_per_token": 1.2e-06, + "source": "https://www.tencentcloud.com/products/tokenhub", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_adaptive_thinking": true, + "supports_function_calling": true, + "supports_native_streaming": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_vision": false }, - "novita/sao10k/l3-70b-euryale-v2.1": { - "litellm_provider": "novita", + "cognition/swe-1.6": { + "input_cost_per_token": 5e-07, + "output_cost_per_token": 2.5e-06, + "cache_read_input_token_cost": 2e-07, + "litellm_provider": "cognition", "mode": "chat", - "input_cost_per_token": 1.48e-06, - "output_cost_per_token": 1.48e-06, - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true + "supports_prompt_caching": true, + "source": "https://docs.devin.ai/windsurf/plugins/cascade/models" }, - "novita/baidu/ernie-4.5-21B-a3b-thinking": { - "litellm_provider": "novita", + "cognition/swe-1.7": { + "input_cost_per_token": 5e-07, + "output_cost_per_token": 2.5e-06, + "cache_read_input_token_cost": 2e-07, + "litellm_provider": "cognition", "mode": "chat", - "input_cost_per_token": 7e-08, - "output_cost_per_token": 2.8e-07, - "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, - "supports_system_messages": true, - "supports_reasoning": true + "supports_function_calling": true, + "supports_prompt_caching": true, + "source": "https://docs.devin.ai/desktop/models" }, - "novita/sao10k/l3-8b-lunaris": { - "litellm_provider": "novita", + "cognition/swe-1.7-lightning": { + "input_cost_per_token": 2.5e-06, + "output_cost_per_token": 1.25e-05, + "cache_read_input_token_cost": 1e-06, + "litellm_provider": "cognition", "mode": "chat", - "input_cost_per_token": 5e-08, - "output_cost_per_token": 5e-08, - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "supports_tool_choice": true, - "supports_system_messages": true, - "supports_response_schema": true + "supports_function_calling": true, + "supports_prompt_caching": true, + "source": "https://docs.devin.ai/desktop/models" }, - "novita/baichuan/baichuan-m2-32b": { - "litellm_provider": "novita", + "pinstripes/ps/glm-4.5-air": { + "max_tokens": 128000, + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "input_cost_per_token": 1.25e-07, + "output_cost_per_token": 4.5e-07, + "litellm_provider": "pinstripes", "mode": "chat", - "input_cost_per_token": 7e-08, - "output_cost_per_token": 7e-08, + "supports_function_calling": true, + "supports_assistant_prefill": true, + "supports_reasoning": true, + "source": "https://pinstripes.io/" + }, + "pinstripes/ps/qwen3.6-35b-a3b": { + "max_tokens": 131072, "max_input_tokens": 131072, "max_output_tokens": 131072, - "max_tokens": 131072, - "supports_system_messages": true - }, - "novita/baidu/ernie-4.5-vl-424b-a47b": { - "litellm_provider": "novita", + "input_cost_per_token": 1.4e-07, + "output_cost_per_token": 4.5e-07, + "litellm_provider": "pinstripes", "mode": "chat", - "input_cost_per_token": 4.2e-07, - "output_cost_per_token": 1.25e-06, - "max_input_tokens": 123000, - "max_output_tokens": 16000, - "max_tokens": 16000, - "supports_vision": true, - "supports_system_messages": true, - "supports_reasoning": true + "supports_function_calling": true, + "supports_assistant_prefill": true, + "supports_reasoning": true, + "source": "https://pinstripes.io/" }, - "novita/baidu/ernie-4.5-300b-a47b-paddle": { - "litellm_provider": "novita", + "pinstripes/ps/qwen3-30b-a3b": { + "max_tokens": 131072, + "max_input_tokens": 131072, + "max_output_tokens": 131072, + "input_cost_per_token": 9e-08, + "output_cost_per_token": 2e-07, + "litellm_provider": "pinstripes", "mode": "chat", - "input_cost_per_token": 2.8e-07, - "output_cost_per_token": 1.1e-06, - "max_input_tokens": 123000, - "max_output_tokens": 12000, - "max_tokens": 12000, - "supports_tool_choice": true, - "supports_system_messages": true, - "supports_response_schema": true + "supports_function_calling": true, + "supports_assistant_prefill": true, + "supports_reasoning": true, + "source": "https://pinstripes.io/" }, - "novita/deepseek/deepseek-prover-v2-671b": { - "litellm_provider": "novita", + "pinstripes/ps/qwen3-coder-30b-a3b": { + "max_tokens": 131072, + "max_input_tokens": 131072, + "max_output_tokens": 131072, + "input_cost_per_token": 3e-07, + "output_cost_per_token": 6e-07, + "litellm_provider": "pinstripes", "mode": "chat", - "input_cost_per_token": 7e-07, - "output_cost_per_token": 2.5e-06, - "max_input_tokens": 160000, - "max_output_tokens": 160000, - "max_tokens": 160000, - "supports_system_messages": true + "supports_function_calling": true, + "supports_assistant_prefill": true, + "supports_reasoning": false, + "source": "https://pinstripes.io/" }, - "novita/qwen/qwen3-32b-fp8": { - "litellm_provider": "novita", - "mode": "chat", + "pinstripes/ps/deepseek-v4-flash": { + "max_tokens": 163840, + "max_input_tokens": 163840, + "max_output_tokens": 163840, "input_cost_per_token": 1e-07, - "output_cost_per_token": 4.5e-07, - "max_input_tokens": 40960, - "max_output_tokens": 20000, - "max_tokens": 20000, - "supports_system_messages": true, - "supports_reasoning": true - }, - "novita/qwen/qwen3-30b-a3b-fp8": { - "litellm_provider": "novita", + "output_cost_per_token": 2e-07, + "litellm_provider": "pinstripes", "mode": "chat", - "input_cost_per_token": 9e-08, - "output_cost_per_token": 4.5e-07, - "max_input_tokens": 40960, - "max_output_tokens": 20000, - "max_tokens": 20000, - "supports_system_messages": true, - "supports_reasoning": true, "supports_function_calling": true, - "supports_tool_choice": true + "supports_assistant_prefill": true, + "supports_reasoning": true, + "source": "https://pinstripes.io/" }, - "novita/google/gemma-3-27b-it": { - "litellm_provider": "novita", + "pinstripes/ps/minimax-m2.7": { + "max_tokens": 1000192, + "max_input_tokens": 1000192, + "max_output_tokens": 1000192, + "input_cost_per_token": 2.55e-07, + "output_cost_per_token": 5.5e-07, + "litellm_provider": "pinstripes", "mode": "chat", - "input_cost_per_token": 1.19e-07, - "output_cost_per_token": 2e-07, - "max_input_tokens": 98304, - "max_output_tokens": 16384, - "max_tokens": 16384, - "supports_vision": true, - "supports_system_messages": true + "supports_function_calling": true, + "supports_assistant_prefill": true, + "supports_reasoning": false, + "source": "https://pinstripes.io/" }, - "novita/deepseek/deepseek-v3-turbo": { - "litellm_provider": "novita", + "darkbloom/gemma-4-26b": { + "input_cost_per_token": 3e-08, + "litellm_provider": "darkbloom", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "input_cost_per_token": 4e-07, - "output_cost_per_token": 1.3e-06, - "max_input_tokens": 64000, - "max_output_tokens": 16000, - "max_tokens": 16000, + "output_cost_per_token": 1.65e-07, + "source": "https://www.darkbloom.dev/", + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true + "supports_native_streaming": true, + "supports_system_messages": true, + "supports_tool_choice": true }, - "novita/deepseek/deepseek-r1-turbo": { - "litellm_provider": "novita", + "darkbloom/gpt-oss-20b": { + "input_cost_per_token": 1.45e-08, + "litellm_provider": "darkbloom", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "input_cost_per_token": 7e-07, - "output_cost_per_token": 2.5e-06, - "max_input_tokens": 64000, - "max_output_tokens": 16000, - "max_tokens": 16000, + "output_cost_per_token": 7e-08, + "source": "https://www.darkbloom.dev/", + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_native_streaming": true, "supports_system_messages": true, - "supports_reasoning": true, - "supports_response_schema": true + "supports_tool_choice": true }, - "novita/Sao10K/L3-8B-Stheno-v3.2": { - "litellm_provider": "novita", + "xai/grok-4.20-0309-non-reasoning": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", - "input_cost_per_token": 5e-08, - "output_cost_per_token": 5e-08, - "max_input_tokens": 8192, - "max_output_tokens": 32000, - "max_tokens": 32000, + "output_cost_per_token": 2.5e-06, + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_prompt_caching": true, "supports_tool_choice": true, - "supports_system_messages": true + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true }, - "novita/gryphe/mythomax-l2-13b": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 9e-08, - "output_cost_per_token": 9e-08, - "max_input_tokens": 4096, - "max_output_tokens": 3200, - "max_tokens": 3200, - "supports_system_messages": true + "xai/grok-4.20-multi-agent-0309": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "responses", + "output_cost_per_token": 2.5e-06, + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_tool_choice": false, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true, + "supported_endpoints": [ + "/v1/responses" + ] }, - "novita/baidu/ernie-4.5-vl-28b-a3b-thinking": { - "litellm_provider": "novita", + "xai/grok-build-0.1": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1e-06, + "litellm_provider": "xai", + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, "mode": "chat", - "input_cost_per_token": 3.9e-07, - "output_cost_per_token": 3.9e-07, - "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, + "output_cost_per_token": 2e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_system_messages": true, + "input_cost_per_token_above_200k_tokens": 2e-06, + "output_cost_per_token_above_200k_tokens": 4e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1e-06, "supports_response_schema": true, - "supports_reasoning": true + "supports_vision": true }, - "novita/qwen/qwen3-vl-8b-instruct": { - "litellm_provider": "novita", + "gpt-transcribe": { + "input_cost_per_second": 7.5e-05, + "litellm_provider": "openai", + "mode": "audio_transcription", + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/audio/transcriptions", + "/v1/realtime/transcription_sessions" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true + }, + "gpt-live-transcribe": { + "input_cost_per_second": 0.000283333333333, + "litellm_provider": "openai", + "mode": "audio_transcription", + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime", + "/v1/realtime/transcription_sessions" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true + }, + "gpt-live-1": { + "input_cost_per_second": 0.000833333333333, + "litellm_provider": "openai", + "mode": "realtime", + "source": "https://developers.openai.com/api/docs/pricing", + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "supports_function_calling": true + }, + "gpt-realtime-translate": { + "input_cost_per_second": 0.000566666666667, + "litellm_provider": "openai", + "max_input_tokens": 16000, + "max_output_tokens": 2000, + "max_tokens": 2000, + "mode": "realtime", + "source": "https://developers.openai.com/api/docs/pricing", + "supported_modalities": [ + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true + }, + "claude-mythos-5": { + "supports_anthropic_compaction": true, + "cache_creation_input_token_cost": 1.25e-05, + "cache_creation_input_token_cost_above_1hr": 2e-05, + "cache_creation_input_token_cost_batches": 6.25e-06, + "cache_read_input_token_cost": 1e-06, + "cache_read_input_token_cost_batches": 5e-07, + "input_cost_per_token": 1e-05, + "input_cost_per_token_batches": 5e-06, + "litellm_provider": "anthropic", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "input_cost_per_token": 8e-08, - "output_cost_per_token": 5e-07, - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "output_cost_per_token": 5e-05, + "output_cost_per_token_batches": 2.5e-05, + "prompt_cache_min_tokens": 512, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://platform.claude.com/docs/en/about-claude/pricing", + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_system_messages": true, - "supports_response_schema": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": true, + "provider_specific_entry": { + "us": 1.1 + } }, - "novita/zai-org/glm-4.5-air": { - "litellm_provider": "novita", + "claude-mythos-5-1": { + "supports_anthropic_compaction": true, + "cache_creation_input_token_cost": 1.25e-05, + "cache_creation_input_token_cost_above_1hr": 2e-05, + "cache_creation_input_token_cost_batches": 6.25e-06, + "cache_read_input_token_cost": 2.5e-07, + "cache_read_input_token_cost_batches": 1.25e-07, + "input_cost_per_token": 1e-05, + "input_cost_per_token_batches": 5e-06, + "litellm_provider": "anthropic", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "input_cost_per_token": 1.3e-07, - "output_cost_per_token": 8.5e-07, - "max_input_tokens": 131072, - "max_output_tokens": 98304, - "max_tokens": 98304, + "output_cost_per_token": 5e-05, + "output_cost_per_token_batches": 2.5e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_forced_tool_use": false, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "cache_read_input_token_cost": 2.5e-08, - "supports_prompt_caching": true + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_max_reasoning_effort": true, + "provider_specific_entry": { + "us": 1.1 + }, + "supports_output_config": true, + "prompt_cache_min_tokens": 512, + "supports_native_structured_output": true, + "source": "https://platform.claude.com/docs/en/about-claude/pricing" }, - "novita/qwen/qwen3-vl-30b-a3b-instruct": { - "litellm_provider": "novita", + "claude-mythos-preview": { + "deprecation_date": "2026-06-09", + "supports_anthropic_compaction": true, + "cache_creation_input_token_cost": 1.25e-05, + "cache_creation_input_token_cost_above_1hr": 2e-05, + "cache_read_input_token_cost": 1e-06, + "input_cost_per_token": 1e-05, + "litellm_provider": "anthropic", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "input_cost_per_token": 2e-07, - "output_cost_per_token": 7e-07, - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "output_cost_per_token": 5e-05, + "prompt_cache_min_tokens": 512, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://platform.claude.com/docs/en/about-claude/models/overview", + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_system_messages": true, - "supports_response_schema": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": true, + "provider_specific_entry": { + "us": 1.1 + } }, - "novita/qwen/qwen3-vl-30b-a3b-thinking": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 2e-07, - "output_cost_per_token": 1e-06, + "gemini/gemini-robotics-er-2-streaming-preview": { + "input_cost_per_audio_token": 1e-06, + "input_cost_per_token": 1e-06, + "litellm_provider": "gemini", "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 5e-06, + "search_context_cost_per_query": { + "search_context_size_high": 0.014, + "search_context_size_low": 0.014, + "search_context_size_medium": 0.014 + }, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, + "supports_reasoning": true, + "supports_video_input": true, "supports_vision": true, - "supports_system_messages": true, - "supports_response_schema": true + "supports_web_search": true, + "web_search_billing_unit": "per_query" }, - "novita/qwen/qwen3-omni-30b-a3b-thinking": { - "litellm_provider": "novita", + "mistral/mistral-small-2603": { + "cache_read_input_token_cost": 1.5e-08, + "input_cost_per_token": 1.5e-07, + "litellm_provider": "mistral", + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 9.7e-07, - "max_input_tokens": 65536, - "max_output_tokens": 16384, - "max_tokens": 16384, + "output_cost_per_token": 6e-07, + "reasoning_effort_levels": [ + "none", + "high" + ], + "source": "https://docs.mistral.ai/models/model-cards/mistral-small-4-0-26-03", + "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_system_messages": true, - "supports_response_schema": true, "supports_reasoning": true, - "supports_audio_input": true + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "novita/qwen/qwen3-omni-30b-a3b-instruct": { - "litellm_provider": "novita", + "mistral/labs-leanstral-1-5": { + "deprecation_date": "2026-09-30", + "input_cost_per_token": 0.0, + "litellm_provider": "mistral", + "max_input_tokens": 262144, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 9.7e-07, - "max_input_tokens": 65536, - "max_output_tokens": 16384, - "max_tokens": 16384, + "output_cost_per_token": 0.0, + "source": "https://docs.mistral.ai/models/model-cards/leanstral-1-5", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_system_messages": true, "supports_response_schema": true, - "supports_audio_input": true, - "supports_audio_output": true + "supports_tool_choice": true }, - "novita/qwen/qwen-mt-plus": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 7.5e-07, - "max_input_tokens": 16384, - "max_output_tokens": 8192, - "max_tokens": 8192, - "supports_system_messages": true + "mistral/mistral-moderation-2603": { + "input_cost_per_token": 0.0, + "litellm_provider": "mistral", + "max_input_tokens": 131072, + "mode": "moderation", + "output_cost_per_token": 0.0, + "source": "https://docs.mistral.ai/models/model-cards/mistral-moderation-26-03" }, - "novita/baidu/ernie-4.5-vl-28b-a3b": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 1.4e-07, - "output_cost_per_token": 5.6e-07, - "max_input_tokens": 30000, - "max_output_tokens": 8000, - "max_tokens": 8000, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_system_messages": true, - "supports_reasoning": true + "mistral/voxtral-mini-2602": { + "input_cost_per_second": 5e-05, + "litellm_provider": "mistral", + "mode": "audio_transcription", + "source": "https://docs.mistral.ai/models/model-cards/voxtral-mini-transcribe-26-02", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ], + "supported_modalities": [ + "audio" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true }, - "novita/baidu/ernie-4.5-21B-a3b": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 7e-08, - "output_cost_per_token": 2.8e-07, - "max_input_tokens": 120000, - "max_output_tokens": 8000, - "max_tokens": 8000, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true + "mistral/voxtral-mini-transcribe-realtime-2602": { + "input_cost_per_second": 0.0001, + "litellm_provider": "mistral", + "mode": "audio_transcription", + "source": "https://docs.mistral.ai/models/model-cards/voxtral-mini-transcribe-realtime-26-02", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ], + "supported_modalities": [ + "audio" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true }, - "novita/qwen/qwen3-8b-fp8": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 3.5e-08, - "output_cost_per_token": 1.38e-07, - "max_input_tokens": 128000, - "max_output_tokens": 20000, - "max_tokens": 20000, - "supports_system_messages": true, - "supports_reasoning": true + "mistral/voxtral-mini-tts-2603": { + "input_cost_per_character": 1.6e-05, + "litellm_provider": "mistral", + "mode": "audio_speech", + "source": "https://docs.mistral.ai/models/model-cards/voxtral-tts-26-03", + "supported_endpoints": [ + "/v1/audio/speech" + ], + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "audio" + ], + "supports_audio_output": true }, - "novita/qwen/qwen3-4b-fp8": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 3e-08, - "output_cost_per_token": 3e-08, - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "supports_system_messages": true, - "supports_reasoning": true, - "supports_function_calling": true, - "supports_tool_choice": true + "fallback_generalizations": { + "rules": [ + { + "name": "bedrock-claude-ids", + "pattern": "^(?:[a-z-]+\\.)?anthropic\\.claude-", + "description": "A Bedrock-syntax Claude id, for every version: anthropic.claude- at the start of the name, optionally behind a single dotted geo segment (us./eu./au./jp./apac./global./us-gov.). Anchored to the start because routing rules see the raw request string and provider inference feeds the proxy's provider/* wildcard access checks: an id under an unrecognized namespace such as bedrockz/anthropic.claude-... must stay unroutable rather than resolve to bedrock and slip through a bedrock/* key. Routes to bedrock before the bare-id Anthropic rule is consulted.", + "model_info": { + "litellm_provider": "bedrock" + } + }, + { + "name": "anthropic-claude-ids", + "pattern": "^claude-[a-z]+-\\d+(?:[-.]\\d+)?(?:-\\d{8})?$", + "description": "A bare Claude family-major id with an optional minor and an optional 8-digit date suffix, anchored to the whole name, so claude-newfamily-5 routes like claude-newfamily-5-1 does. Routes an unmapped Claude id that carries no provider namespace to the Anthropic API.", + "model_info": { + "litellm_provider": "anthropic" + } + }, + { + "name": "claude-family-baseline", + "pattern": "claude-[a-z]+-\\d+(?:[-.]\\d+)?(?:-\\d{8})?", + "description": "Any Claude family-major id with an optional minor and an optional 8-digit date suffix, under any provider namespace (bare, bedrock-dotted, vertex, databricks, ...), so bare majors like claude-newfamily-5 get the same baseline as claude-newfamily-5-1. Carries the model-family facts every Claude shares; it carries no pricing, so cost stays on the standard unpriced behavior rather than a guessed number.", + "model_info": { + "mode": "chat", + "max_input_tokens": 200000, + "max_output_tokens": 64000, + "max_tokens": 64000, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_vision": true, + "supports_tool_choice": true, + "supports_assistant_prefill": true, + "supports_prompt_caching": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_pdf_input": true, + "supports_system_messages": true + } + }, + { + "name": "claude-adaptive-thinking", + "pattern": "claude-[a-z]+-(?:4[-._](?:[6-9]|[1-9]\\d)(?!\\d)|[5-9](?!\\d)(?:[-._]\\d{1,2}(?!\\d))?)", + "fill_missing_for_providers": ["anthropic", "azure_ai", "bedrock", "bedrock_converse", "vertex_ai-anthropic_models"], + "description": "Claude at version 4.6 or higher, in any id shape that contains claude--: minors 4.6 through 4.99, any later major-minor, and bare 5+ majors so a new family shaped like claude-fable-5 matches. Requiring the claude- prefix keeps non-Claude names such as team-sonnet-5-1 out. The minor is capped at two digits so an 8-digit date suffix such as claude-opus-4-20250514 is never read as a >= 4.6 minor. Two-digit majors are deliberately not matched so ids like claude-opus-41 (4.1) are not read as major 41. Turns on adaptive thinking for new versions and new families with no code change.", + "model_info": { + "supports_adaptive_thinking": true + } + }, + { + "name": "claude-legacy-thinking", + "pattern": "claude-[a-z]+-4[-._]6(?!\\d)", + "fill_missing_for_providers": ["anthropic", "azure_ai", "bedrock", "bedrock_converse", "vertex_ai-anthropic_models"], + "description": "Claude at version 4.6 exactly, in any id shape that contains claude--4-6 (dotted and underscored minors included, dated releases such as claude-sonnet-4-6-20260219 too). The 4.6 family is adaptive-thinking yet still accepts legacy thinking.type=enabled with budget_tokens, so the caller's hard budget cap is forwarded verbatim instead of being rewritten to an uncapped output_config.effort. The lookahead keeps two-digit minors such as 4-60 from matching. 4.7+ and 5+ majors reject the legacy shape and stay on the adaptive translation.", + "model_info": { + "supports_legacy_thinking": true + } + }, + { + "name": "claude-always-on-thinking", + "pattern": "claude-(?:fable|mythos)-", + "description": "Any Claude Fable or Mythos id, under any provider namespace and any version. These families always think and reject thinking.type=disabled with a 400; the Anthropic transformations omit the param instead, so the model falls back to its default adaptive thinking.", + "model_info": { + "thinking_always_on": true + } + }, + { + "name": "claude-mid-conversation-system", + "pattern": "claude-[a-z]+-(?:4[-._](?:[89]|[1-9]\\d)(?!\\d)|[5-9](?!\\d)(?:[-._]\\d{1,2}(?!\\d))?)", + "fill_missing_for_providers": ["anthropic", "azure_ai", "bedrock", "bedrock_converse", "vertex_ai-anthropic_models"], + "description": "Claude at version 4.8 or higher, in any id shape that contains claude--: minors 4.8 through 4.99, any later major-minor, and bare 5+ majors so a new family like claude-fable-5 matches. Two-digit majors are deliberately not matched so ids like claude-opus-41 (4.1) are not read as major 41. Anthropic introduced mid-conversation system messages with Opus 4.8 and every newer Claude keeps them; 4.7 and below reject the system role inside messages.", + "model_info": { + "supports_mid_conversation_system": true + } + }, + { + "name": "claude-tool-search", + "pattern": "claude-[a-z]+-(?:4[-._](?:[5-9]|[1-9]\\d)(?!\\d)|[5-9](?!\\d)(?:[-._]\\d{1,2}(?!\\d))?)", + "fill_missing_for_providers": ["anthropic", "bedrock", "bedrock_converse", "vertex_ai-anthropic_models"], + "description": "Claude at version 4.5 or higher, in any id shape that contains claude--: minors 4.5 through 4.99, any later major-minor, and bare 5+ majors so a new family like claude-fable-5 matches. Two-digit majors are deliberately not matched so ids like claude-opus-41 (4.1) are not read as major 41. Anthropic's tool search docs list every Claude 4.5 and newer model as supported and Opus 4.1 and earlier as unsupported, so the flag follows the version instead of a per-model list. azure_ai is left out on purpose: Anthropic documents tool search as unavailable on Azure-hosted Foundry deployments, and the azure_ai/ key cannot tell those from Anthropic-hosted ones.", + "model_info": { + "supports_tool_search": true + } + }, + { + "name": "wandb-reasoning-baseline", + "pattern": "^wandb/", + "description": "Any Weights & Biases Inference model id, anchored to the wandb/ namespace so only that provider's ids match. W&B's serverless catalog is reasoning-first and grows faster than this registry names it, so an id the map has not described yet is treated as reasoning-capable and keeps the caller's reasoning_effort instead of dropping it or raising UnsupportedParamsError. Rules lose to exact entries, so a mapped non-reasoning model such as wandb/meta-llama/Llama-3.1-8B-Instruct is unaffected. Carries no mode and no pricing, so cost stays on the standard unpriced behavior and the deployment does not read as catalog-mapped to the router's reasoning-effort resolver.", + "model_info": { + "supports_reasoning": true + } + }, + { + "name": "openai-reasoning-family-baseline", + "pattern": "^(?!.*search-api)(?:[a-z0-9_.-]+/)*(?:ft:)?(?:o[1-9]\\d*(?![a-z0-9])|gpt-[5-9](?:\\.\\d+)?(?![0-9.])|(?:gpt-\\d+(?:\\.\\d+)?(?:-[a-z0-9]+)*-)?(?:codex|deep-research|chat-latest)(?![a-z0-9]))", + "fill_missing_for_providers": ["azure", "azure_ai", "openai"], + "description": "OpenAI reasoning families by id shape, under any provider namespace and with an optional ft: prefix: the o-series (o1, o3-pro, o4-mini), gpt-5 through gpt-9 majors including dotted minors and suffixed variants (gpt-5.5-cyber, gpt-6-astra), and the codex, deep-research and chat-latest lines when standalone or on a gpt base. gpt-5-search-api is excluded because it is a search-only surface. Every model here is a reasoning model, and the Responses API drops the caller's reasoning param for any mapped OpenAI model whose info lacks supports_reasoning, so an id the registry has not named yet keeps its reasoning settings instead of silently losing them. Rules lose to exact entries. Carries no mode and no pricing, so cost stays on the standard unpriced behavior.", + "model_info": { + "supports_reasoning": true + } + }, + { + "name": "gemini-chat-baseline", + "pattern": "gemini-(?!.*(?:-tts|-image|-live|-audio|-embedding|-computer-use|-robotics|-transcribe|-translate))(?:2[.-][5-9]|[3-9](?:[.-]\\d{1,2})?)-(?:pro|flash)(?:-lite)?(?![a-z])", + "description": "Any Gemini text-chat id at 2.5 or higher under any namespace, including bare ids, gemini/, vertex_ai/, openrouter/google/, deepinfra/google/, vercel_ai_gateway/google/, oci/google., and databricks-gemini--: gemini-[.minor]-(pro|flash)[-lite] with any trailing preview, date or variant tag. The capability flags were verified against each of those providers' own catalogs and docs. The lookahead excludes the tts, image, live, audio, embedding, computer-use, robotics, transcribe and translate lines, which are different modes with different capabilities. Provider-specific deviations, such as Perplexity's Agent API serving these as mode responses, are carried by their exact map entries, which always win over this rule. Carries no token limits or pricing, so those stay on the standard unmapped behavior rather than a guessed number. Source check 2026-09-15: all 45 first-party 2.5+ text-chat entries in this map carry every field below, and the OpenRouter (openrouter.ai/api/v1/models), Vercel AI Gateway (ai-gateway.vercel.sh/v1/models), DeepInfra (api.deepinfra.com/models/list), OCI and Databricks model docs list reasoning, tools and image input for the same models.", + "model_info": { + "mode": "chat", + "supports_reasoning": true, + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_system_messages": true, + "supports_vision": true, + "supports_response_schema": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_web_search": true + } + } + ] }, - "novita/qwen/qwen2.5-7b-instruct": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 7e-08, - "output_cost_per_token": 7e-08, - "max_input_tokens": 32000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true, - "supports_response_schema": true + "gemini/gemini-3.5-live-translate-preview": { + "input_cost_per_audio_token": 3.5e-06, + "input_cost_per_token": 3.5e-06, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "realtime", + "output_cost_per_audio_token": 2.1e-05, + "output_cost_per_token": 2.1e-05, + "rpm": 10, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "audio" + ], + "supported_output_modalities": [ + "audio", + "text" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "supports_function_calling": false, + "supports_response_schema": false, + "supports_web_search": false, + "tpm": 250000 }, - "novita/meta-llama/llama-3.2-3b-instruct": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 3e-08, - "output_cost_per_token": 5e-08, - "max_input_tokens": 32768, - "max_output_tokens": 32000, - "max_tokens": 32000, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true + "gemini/gemini-3.5-transcribe": { + "input_cost_per_audio_token": 2e-06, + "input_cost_per_token": 2e-06, + "litellm_provider": "gemini", + "mode": "audio_transcription", + "output_cost_per_token": 1.2e-05, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true, + "tpm": 800000, + "rpm": 2000, + "supports_function_calling": false }, - "novita/sao10k/l31-70b-euryale-v2.2": { - "litellm_provider": "novita", - "mode": "chat", - "input_cost_per_token": 1.48e-06, - "output_cost_per_token": 1.48e-06, - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true + "gemini/gemini-3.5-transcribe-live": { + "input_cost_per_audio_token": 3.5e-06, + "input_cost_per_token": 3.5e-06, + "litellm_provider": "gemini", + "mode": "audio_transcription", + "output_cost_per_token": 2.1e-05, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "audio" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true, + "tpm": 250000, + "rpm": 10, + "supports_function_calling": false }, - "novita/qwen/qwen3-embedding-0.6b": { - "litellm_provider": "novita", - "mode": "embedding", - "input_cost_per_token": 7e-08, - "output_cost_per_token": 0, - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "max_tokens": 32768 + "vertex_ai/gemini-3.5-transcribe-preview": { + "input_cost_per_audio_token": 2e-06, + "input_cost_per_token": 2e-06, + "litellm_provider": "vertex_ai", + "mode": "audio_transcription", + "output_cost_per_token": 1.2e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true }, - "novita/qwen/qwen3-embedding-8b": { - "litellm_provider": "novita", - "mode": "embedding", - "input_cost_per_token": 7e-08, - "output_cost_per_token": 0, - "max_input_tokens": 32768, - "max_output_tokens": 4096, - "max_tokens": 4096 + "vertex_ai/gemini-3.5-transcribe-live-preview": { + "input_cost_per_audio_token": 3.5e-06, + "input_cost_per_token": 3.5e-06, + "litellm_provider": "vertex_ai", + "mode": "audio_transcription", + "output_cost_per_token": 2.1e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "audio" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true + }, + "vertex_ai/gemini-3.5-live-translate-preview": { + "input_cost_per_audio_token": 3.5e-06, + "input_cost_per_second": 8.83333333333e-05, + "input_cost_per_token": 3.5e-06, + "litellm_provider": "vertex_ai", + "mode": "realtime", + "output_cost_per_audio_token": 2.1e-05, + "output_cost_per_token": 2.1e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "audio" + ], + "supported_output_modalities": [ + "audio", + "text" + ], + "supports_audio_input": true, + "supports_audio_output": true }, - "novita/baai/bge-m3": { - "litellm_provider": "novita", + "perplexity/pplx-embed-context-v1-0.6b": { + "input_cost_per_token": 8e-09, + "litellm_provider": "perplexity", + "max_input_tokens": 32768, + "max_tokens": 32768, "mode": "embedding", - "input_cost_per_token": 1e-08, - "output_cost_per_token": 1e-08, - "max_input_tokens": 8192, - "max_output_tokens": 96000, - "max_tokens": 96000 + "output_cost_per_token": 0.0, + "output_vector_size": 1024, + "source": "https://docs.perplexity.ai/getting-started/pricing" }, - "novita/qwen/qwen3-reranker-8b": { - "litellm_provider": "novita", - "mode": "rerank", + "perplexity/pplx-embed-context-v1-4b": { "input_cost_per_token": 5e-08, - "output_cost_per_token": 5e-08, + "litellm_provider": "perplexity", "max_input_tokens": 32768, - "max_output_tokens": 4096, - "max_tokens": 4096 + "max_tokens": 32768, + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 2560, + "source": "https://docs.perplexity.ai/getting-started/pricing" }, - "novita/baai/bge-reranker-v2-m3": { - "litellm_provider": "novita", - "mode": "rerank", - "input_cost_per_token": 1e-08, - "output_cost_per_token": 1e-08, - "max_input_tokens": 8000, - "max_output_tokens": 8000, - "max_tokens": 8000 + "voyage/voyage-4-large": { + "input_cost_per_token": 1.2e-07, + "litellm_provider": "voyage", + "max_input_tokens": 32000, + "max_tokens": 32000, + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 1024, + "source": "https://docs.voyageai.com/docs/pricing" }, - "llamagate/llama-3.1-8b": { - "max_tokens": 8192, - "max_input_tokens": 131072, - "max_output_tokens": 8192, - "input_cost_per_token": 3e-08, - "output_cost_per_token": 5e-08, - "litellm_provider": "llamagate", - "mode": "chat", - "supports_function_calling": true, - "supports_response_schema": true + "voyage/voyage-4": { + "input_cost_per_token": 6e-08, + "litellm_provider": "voyage", + "max_input_tokens": 32000, + "max_tokens": 32000, + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 1024, + "source": "https://docs.voyageai.com/docs/pricing" }, - "llamagate/llama-3.2-3b": { - "max_tokens": 8192, - "max_input_tokens": 131072, - "max_output_tokens": 8192, - "input_cost_per_token": 4e-08, - "output_cost_per_token": 8e-08, - "litellm_provider": "llamagate", - "mode": "chat", - "supports_function_calling": true, - "supports_response_schema": true + "voyage/voyage-4-lite": { + "input_cost_per_token": 2e-08, + "litellm_provider": "voyage", + "max_input_tokens": 32000, + "max_tokens": 32000, + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 1024, + "source": "https://docs.voyageai.com/docs/pricing" }, - "llamagate/mistral-7b-v0.3": { - "max_tokens": 8192, - "max_input_tokens": 32768, - "max_output_tokens": 8192, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 1.5e-07, - "litellm_provider": "llamagate", - "mode": "chat", - "supports_function_calling": true, - "supports_response_schema": true + "voyage/voyage-code-4": { + "input_cost_per_token": 1.2e-07, + "litellm_provider": "voyage", + "max_input_tokens": 32000, + "max_tokens": 32000, + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 1024, + "source": "https://docs.voyageai.com/docs/pricing" }, - "llamagate/qwen3-8b": { - "max_tokens": 8192, - "max_input_tokens": 32768, - "max_output_tokens": 8192, - "input_cost_per_token": 4e-08, - "output_cost_per_token": 1.4e-07, - "litellm_provider": "llamagate", - "mode": "chat", - "supports_function_calling": true, - "supports_response_schema": true + "voyage/voyage-context-4": { + "input_cost_per_token": 1.2e-07, + "litellm_provider": "voyage", + "max_input_tokens": 120000, + "max_tokens": 120000, + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 1024, + "source": "https://docs.voyageai.com/docs/pricing" }, - "llamagate/dolphin3-8b": { - "max_tokens": 8192, - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "input_cost_per_token": 8e-08, - "output_cost_per_token": 1.5e-07, - "litellm_provider": "llamagate", - "mode": "chat", - "supports_function_calling": true, - "supports_response_schema": true + "voyage/voyage-multimodal-3.5": { + "input_cost_per_token": 1.2e-07, + "litellm_provider": "voyage", + "max_input_tokens": 32000, + "max_tokens": 32000, + "mode": "embedding", + "output_cost_per_token": 0.0, + "output_vector_size": 1024, + "source": "https://docs.voyageai.com/docs/pricing", + "supports_embedding_image_input": true }, - "llamagate/deepseek-r1-8b": { - "max_tokens": 16384, - "max_input_tokens": 65536, - "max_output_tokens": 16384, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "llamagate", + "fireworks_ai/accounts/fireworks/models/deepseek-v4-flash-0731": { + "cache_read_input_token_cost": 7e-09, + "cache_read_input_token_cost_priority": 8.75e-09, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 2.2e-07, + "input_cost_per_token_priority": 2.75e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", + "output_cost_per_token": 6.6e-07, + "output_cost_per_token_priority": 8.25e-07, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_reasoning": true + "supports_tool_choice": true, + "supports_vision": false }, - "llamagate/deepseek-r1-7b-qwen": { - "max_tokens": 16384, - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "input_cost_per_token": 8e-08, - "output_cost_per_token": 1.5e-07, - "litellm_provider": "llamagate", + "fireworks_ai/accounts/fireworks/models/deepseek-v4p1-flash": { + "cache_read_input_token_cost": 6e-09, + "cache_read_input_token_cost_priority": 7.5e-09, + "input_cost_per_token": 3e-07, + "input_cost_per_token_priority": 3.75e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 393216, + "max_tokens": 393216, "mode": "chat", + "output_cost_per_token": 1.2e-06, + "output_cost_per_token_priority": 1.5e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_reasoning": true + "supports_tool_choice": true, + "supports_vision": true }, - "llamagate/openthinker-7b": { - "max_tokens": 8192, - "max_input_tokens": 32768, - "max_output_tokens": 8192, - "input_cost_per_token": 8e-08, - "output_cost_per_token": 1.5e-07, - "litellm_provider": "llamagate", + "fireworks_ai/accounts/fireworks/routers/deepseek-v4p1-flash-us": { + "cache_read_input_token_cost": 9e-09, + "cache_read_input_token_cost_priority": 1.125e-08, + "input_cost_per_token": 4.5e-07, + "input_cost_per_token_priority": 5.625e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 393216, + "max_tokens": 393216, "mode": "chat", + "output_cost_per_token": 1.8e-06, + "output_cost_per_token_priority": 2.25e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_reasoning": true + "supports_tool_choice": true, + "supports_vision": true }, - "llamagate/qwen2.5-coder-7b": { - "max_tokens": 8192, - "max_input_tokens": 32768, - "max_output_tokens": 8192, - "input_cost_per_token": 6e-08, - "output_cost_per_token": 1.2e-07, - "litellm_provider": "llamagate", + "fireworks_ai/accounts/fireworks/models/deepseek-v4-flash-vision-exp": { + "cache_read_input_token_cost": 7e-09, + "cache_read_input_token_cost_priority": 8.75e-09, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 2.2e-07, + "input_cost_per_token_priority": 2.75e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_tokens": 1048576, "mode": "chat", + "output_cost_per_token": 6.6e-07, + "output_cost_per_token_priority": 8.25e-07, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, + "supports_tool_choice": true, + "supports_vision": true, "supports_response_schema": true }, - "llamagate/deepseek-coder-6.7b": { - "max_tokens": 4096, - "max_input_tokens": 16384, - "max_output_tokens": 4096, - "input_cost_per_token": 6e-08, - "output_cost_per_token": 1.2e-07, - "litellm_provider": "llamagate", + "fireworks_ai/accounts/fireworks/models/kimi-k3": { + "cache_read_input_token_cost": 3e-07, + "cache_read_input_token_cost_priority": 3.75e-07, + "input_cost_per_token": 3e-06, + "input_cost_per_token_priority": 3.75e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", + "output_cost_per_token": 1.5e-05, + "output_cost_per_token_priority": 1.875e-05, + "reasoning_effort_levels": [ + "low", + "high", + "max" + ], + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_response_schema": true + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "llamagate/codellama-7b": { - "max_tokens": 4096, - "max_input_tokens": 16384, - "max_output_tokens": 4096, - "input_cost_per_token": 6e-08, - "output_cost_per_token": 1.2e-07, - "litellm_provider": "llamagate", + "fireworks_ai/deepseek-v4-flash-0731": { + "cache_read_input_token_cost": 7e-09, + "cache_read_input_token_cost_priority": 8.75e-09, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 2.2e-07, + "input_cost_per_token_priority": 2.75e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", + "output_cost_per_token": 6.6e-07, + "output_cost_per_token_priority": 8.25e-07, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_response_schema": true + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "llamagate/qwen3-vl-8b": { - "max_tokens": 8192, - "max_input_tokens": 32768, - "max_output_tokens": 8192, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 5.5e-07, - "litellm_provider": "llamagate", + "fireworks_ai/deepseek-v4p1-flash": { + "cache_read_input_token_cost": 6e-09, + "cache_read_input_token_cost_priority": 7.5e-09, + "input_cost_per_token": 3e-07, + "input_cost_per_token_priority": 3.75e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 393216, + "max_tokens": 393216, "mode": "chat", + "output_cost_per_token": 1.2e-06, + "output_cost_per_token_priority": 1.5e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true }, - "llamagate/llava-7b": { - "max_tokens": 2048, - "max_input_tokens": 4096, - "max_output_tokens": 2048, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "llamagate", + "fireworks_ai/deepseek-v4p1-flash-us": { + "cache_read_input_token_cost": 9e-09, + "cache_read_input_token_cost_priority": 1.125e-08, + "input_cost_per_token": 4.5e-07, + "input_cost_per_token_priority": 5.625e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 393216, + "max_tokens": 393216, "mode": "chat", + "output_cost_per_token": 1.8e-06, + "output_cost_per_token_priority": 2.25e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true }, - "llamagate/gemma3-4b": { - "max_tokens": 8192, - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "input_cost_per_token": 3e-08, - "output_cost_per_token": 8e-08, - "litellm_provider": "llamagate", + "fireworks_ai/deepseek-v4-flash-vision-exp": { + "cache_read_input_token_cost": 7e-09, + "cache_read_input_token_cost_priority": 8.75e-09, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 2.2e-07, + "input_cost_per_token_priority": 2.75e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_tokens": 1048576, "mode": "chat", + "output_cost_per_token": 6.6e-07, + "output_cost_per_token_priority": 8.25e-07, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_response_schema": true, - "supports_vision": true - }, - "llamagate/nomic-embed-text": { - "max_tokens": 8192, - "max_input_tokens": 8192, - "input_cost_per_token": 2e-08, - "output_cost_per_token": 0, - "litellm_provider": "llamagate", - "mode": "embedding" - }, - "llamagate/qwen3-embedding-8b": { - "max_tokens": 40960, - "max_input_tokens": 40960, - "input_cost_per_token": 2e-08, - "output_cost_per_token": 0, - "litellm_provider": "llamagate", - "mode": "embedding" + "supports_tool_choice": true, + "supports_vision": true, + "supports_response_schema": true }, - "libertai/hermes-3-8b-tee": { - "max_tokens": 16000, - "max_input_tokens": 16000, - "max_output_tokens": 16000, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "litellm_provider": "libertai", + "fireworks_ai/glm-5p2-fast": { + "cache_read_input_token_cost": 2.1e-07, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 2.1e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", + "output_cost_per_token": 6.6e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": false, - "source": "https://docs.libertai.io/apis/text/" + "supports_vision": false }, - "libertai/gemma-4-31b-it": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 4e-07, - "litellm_provider": "libertai", + "fireworks_ai/glm-5p2-fast-us": { + "cache_read_input_token_cost": 2.1e-07, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 2.1e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", + "output_cost_per_token": 6.6e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": true, - "source": "https://docs.libertai.io/apis/text/" + "supports_vision": false }, - "libertai/gemma-4-31b-it-thinking": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 4e-07, - "litellm_provider": "libertai", + "fireworks_ai/kimi-k3": { + "cache_read_input_token_cost": 3e-07, + "cache_read_input_token_cost_priority": 3.75e-07, + "input_cost_per_token": 3e-06, + "input_cost_per_token_priority": 3.75e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", + "output_cost_per_token": 1.5e-05, + "output_cost_per_token_priority": 1.875e-05, + "reasoning_effort_levels": [ + "low", + "high", + "max" + ], + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": true, + "supports_vision": true + }, + "fireworks_ai/kimi-k3-fast": { + "cache_read_input_token_cost": 4.5e-07, + "input_cost_per_token": 4.5e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 2.25e-05, + "reasoning_effort_levels": [ + "low", + "high", + "max" + ], + "source": "https://docs.fireworks.ai/serverless/pricing", + "supports_function_calling": true, "supports_reasoning": true, - "source": "https://docs.libertai.io/apis/text/" + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "libertai/qwen3.6-27b": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 5e-07, - "litellm_provider": "libertai", + "fireworks_ai/kimi-k3-us": { + "cache_read_input_token_cost": 4.5e-07, + "cache_read_input_token_cost_priority": 5.625e-07, + "input_cost_per_token": 4.5e-06, + "input_cost_per_token_priority": 5.625e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", + "output_cost_per_token": 2.25e-05, + "output_cost_per_token_priority": 2.8125e-05, + "reasoning_effort_levels": [ + "low", + "high", + "max" + ], + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": true, - "source": "https://docs.libertai.io/apis/text/" + "supports_vision": true }, - "libertai/qwen3.6-27b-thinking": { - "max_tokens": 262144, + "fireworks_ai/qwen3p8-max": { + "cache_read_input_token_cost": 2.5e-07, + "cache_read_input_token_cost_priority": 3.75e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_priority": 3e-06, + "litellm_provider": "fireworks_ai", "max_input_tokens": 262144, - "max_output_tokens": 262144, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 5e-07, - "litellm_provider": "libertai", "mode": "chat", + "output_cost_per_token": 6e-06, + "output_cost_per_token_priority": 9e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": true, "supports_reasoning": true, - "source": "https://docs.libertai.io/apis/text/" + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "libertai/qwen3.6-35b-a3b": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 5e-07, - "litellm_provider": "libertai", + "fireworks_ai/muse-glimmer-30b": { + "cache_read_input_token_cost": 4e-08, + "cache_read_input_token_cost_priority": 6e-08, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 3.5e-07, + "input_cost_per_token_priority": 5.25e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", + "output_cost_per_token": 1.5e-06, + "output_cost_per_token_priority": 2.25e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": true, - "source": "https://docs.libertai.io/apis/text/" + "supports_vision": true }, - "libertai/qwen3.6-35b-a3b-thinking": { - "max_tokens": 262144, + "fireworks_ai/nemotron-lightning-3p5-30b-a3b": { + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_priority": 1.25e-08, + "input_cost_per_token": 5e-08, + "input_cost_per_token_priority": 6.25e-08, + "litellm_provider": "fireworks_ai", "max_input_tokens": 262144, - "max_output_tokens": 262144, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 5e-07, - "litellm_provider": "libertai", + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", + "output_cost_per_token": 2e-07, + "output_cost_per_token_priority": 2.5e-07, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": true, "supports_reasoning": true, - "source": "https://docs.libertai.io/apis/text/" + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "libertai/qwen3.5-122b-a10b": { - "max_tokens": 262144, + "fireworks_ai/nemotron-3-ultra-nvfp4": { + "cache_read_input_token_cost": 1.2e-07, + "cache_read_input_token_cost_priority": 1.5e-07, + "input_cost_per_token": 6e-07, + "input_cost_per_token_priority": 7.5e-07, + "litellm_provider": "fireworks_ai", "max_input_tokens": 262144, - "max_output_tokens": 262144, - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 1.75e-06, - "litellm_provider": "libertai", + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", + "output_cost_per_token": 2.4e-06, + "output_cost_per_token_priority": 3e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": true, - "source": "https://docs.libertai.io/apis/text/" + "supports_vision": false }, - "libertai/qwen3.5-122b-a10b-thinking": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 1.75e-06, - "litellm_provider": "libertai", + "fireworks_ai/accounts/fireworks/models/muse-glimmer-30b": { + "cache_read_input_token_cost": 4e-08, + "cache_read_input_token_cost_priority": 6e-08, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 3.5e-07, + "input_cost_per_token_priority": 5.25e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", + "output_cost_per_token": 1.5e-06, + "output_cost_per_token_priority": 2.25e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": true, "supports_reasoning": true, - "source": "https://docs.libertai.io/apis/text/" + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "libertai/deepseek-v4-flash": { - "max_tokens": 200000, - "max_input_tokens": 200000, - "max_output_tokens": 200000, - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 1.75e-06, - "litellm_provider": "libertai", + "fireworks_ai/accounts/fireworks/models/nemotron-lightning-3p5-30b-a3b": { + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_priority": 1.25e-08, + "input_cost_per_token": 5e-08, + "input_cost_per_token_priority": 6.25e-08, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", + "output_cost_per_token": 2e-07, + "output_cost_per_token_priority": 2.5e-07, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": false, - "source": "https://docs.libertai.io/apis/text/" + "supports_vision": false }, - "libertai/deepseek-v4-flash-thinking": { - "max_tokens": 200000, - "max_input_tokens": 200000, - "max_output_tokens": 200000, - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 1.75e-06, - "litellm_provider": "libertai", + "fireworks_ai/accounts/fireworks/models/nemotron-3-ultra-nvfp4": { + "cache_read_input_token_cost": 1.2e-07, + "cache_read_input_token_cost_priority": 1.5e-07, + "input_cost_per_token": 6e-07, + "input_cost_per_token_priority": 7.5e-07, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", + "output_cost_per_token": 2.4e-06, + "output_cost_per_token_priority": 3e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": false, "supports_reasoning": true, - "source": "https://docs.libertai.io/apis/text/" - }, - "libertai/bge-m3": { - "max_tokens": 8192, - "max_input_tokens": 8192, - "input_cost_per_token": 1e-08, - "output_cost_per_token": 0.0, - "litellm_provider": "libertai", - "mode": "embedding", - "source": "https://docs.libertai.io/apis/text/" - }, - "sarvam/sarvam-m": { - "cache_creation_input_token_cost": 0, - "cache_creation_input_token_cost_above_1hr": 0, - "cache_read_input_token_cost": 0, - "input_cost_per_token": 0, - "litellm_provider": "sarvam", - "max_input_tokens": 8192, - "max_output_tokens": 32000, - "max_tokens": 32000, - "mode": "chat", - "output_cost_per_token": 0, - "supports_reasoning": true - }, - "tts-1-1106": { - "input_cost_per_character": 1.5e-05, - "litellm_provider": "openai", - "mode": "audio_speech", - "supported_endpoints": [ - "/v1/audio/speech" - ] - }, - "tts-1-hd-1106": { - "input_cost_per_character": 3e-05, - "litellm_provider": "openai", - "mode": "audio_speech", - "supported_endpoints": [ - "/v1/audio/speech" - ] - }, - "gpt-4o-mini-tts-2025-03-20": { - "deprecation_date": "2026-07-23", - "input_cost_per_token": 6e-07, - "litellm_provider": "openai", - "mode": "audio_speech", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_second": 0.00025, - "output_cost_per_token": 1e-05, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/audio/speech" - ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "audio" - ] - }, - "gpt-4o-mini-tts-2025-12-15": { - "input_cost_per_token": 6e-07, - "litellm_provider": "openai", - "mode": "audio_speech", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_second": 0.00025, - "output_cost_per_token": 1e-05, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/audio/speech" - ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "audio" - ] - }, - "gpt-4o-mini-transcribe-2025-03-20": { - "deprecation_date": "2027-01-20", - "input_cost_per_audio_token": 1.25e-06, - "input_cost_per_second": 5e-05, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "openai", - "max_input_tokens": 16000, - "max_output_tokens": 2000, - "mode": "audio_transcription", - "output_cost_per_token": 5e-06, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ] - }, - "gpt-4o-mini-transcribe-2025-12-15": { - "input_cost_per_audio_token": 1.25e-06, - "input_cost_per_second": 5e-05, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "openai", - "max_input_tokens": 16000, - "max_output_tokens": 2000, - "mode": "audio_transcription", - "output_cost_per_token": 5e-06, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ] + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "gpt-5-search-api": { - "cache_read_input_token_cost": 1.25e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "openai", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "fireworks_ai/accounts/fireworks/models/qwen3p8-max": { + "cache_read_input_token_cost": 2.5e-07, + "cache_read_input_token_cost_priority": 3.75e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_priority": 3e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 262144, "mode": "chat", - "output_cost_per_token": 1e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "source": "https://developers.openai.com/api/docs/pricing", + "output_cost_per_token": 6e-06, + "output_cost_per_token_priority": 9e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_none_reasoning_effort": false, - "supports_xhigh_reasoning_effort": false, - "supports_minimal_reasoning_effort": true + "supports_vision": true }, - "gpt-5-search-api-2025-10-14": { - "cache_read_input_token_cost": 1.25e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "openai", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "fireworks_ai/accounts/fireworks/routers/glm-5p2-fast": { + "cache_read_input_token_cost": 2.1e-07, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 2.1e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "source": "https://developers.openai.com/api/docs/pricing", + "output_cost_per_token": 6.6e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_none_reasoning_effort": false, - "supports_xhigh_reasoning_effort": false + "supports_vision": false }, - "gpt-realtime-mini-2025-10-06": { - "cache_creation_input_audio_token_cost": 3e-07, - "cache_read_input_audio_token_cost": 3e-07, - "cache_read_input_token_cost": 6e-08, - "deprecation_date": "2026-07-23", - "input_cost_per_audio_token": 1e-05, - "input_cost_per_image_token": 8e-07, - "input_cost_per_token": 6e-07, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "realtime", - "output_cost_per_audio_token": 2e-05, - "output_cost_per_token": 2.4e-06, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "image", - "audio" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, + "fireworks_ai/accounts/fireworks/routers/glm-5p2-fast-us": { + "cache_read_input_token_cost": 2.1e-07, + "deprecation_date": "2026-09-25", + "input_cost_per_token": 2.1e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 6.6e-06, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_system_messages": true, - "supports_tool_choice": true + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "gpt-realtime-mini-2025-12-15": { - "cache_creation_input_audio_token_cost": 3e-07, - "cache_read_input_audio_token_cost": 3e-07, - "cache_read_input_token_cost": 6e-08, - "input_cost_per_audio_token": 1e-05, - "input_cost_per_image_token": 8e-07, - "input_cost_per_token": 6e-07, - "litellm_provider": "openai", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "realtime", - "output_cost_per_audio_token": 2e-05, - "output_cost_per_token": 2.4e-06, - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "image", - "audio" - ], - "supported_output_modalities": [ - "text", - "audio" + "fireworks_ai/accounts/fireworks/routers/kimi-k3-fast": { + "cache_read_input_token_cost": 4.5e-07, + "input_cost_per_token": 4.5e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 2.25e-05, + "reasoning_effort_levels": [ + "low", + "high", + "max" ], - "supports_audio_input": true, - "supports_audio_output": true, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_system_messages": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_tool_choice": true, - "deprecation_date": "2027-01-20", - "source": "https://developers.openai.com/api/docs/pricing" - }, - "gpt-realtime-whisper": { - "input_cost_per_second": 0.000283333333333, - "litellm_provider": "openai", - "mode": "audio_transcription", - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime", - "/v1/realtime/transcription_sessions" - ], - "supported_modalities": [ - "audio" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true - }, - "sora-2": { - "deprecation_date": "2026-09-24", - "litellm_provider": "openai", - "mode": "video_generation", - "output_cost_per_video_per_second": 0.1, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "video" - ] - }, - "sora-2-pro": { - "deprecation_date": "2026-09-24", - "litellm_provider": "openai", - "mode": "video_generation", - "output_cost_per_video_per_second": 0.3, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "video" - ] - }, - "sora-2-pro-high-res": { - "litellm_provider": "openai", - "mode": "video_generation", - "output_cost_per_video_per_second": 0.5, - "source": "https://platform.openai.com/docs/api-reference/videos", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "video" - ] - }, - "chatgpt-image-latest": { - "cache_read_input_token_cost": 1.25e-06, - "deprecation_date": "2026-12-01", - "input_cost_per_image_token": 8e-06, - "input_cost_per_image_token_batches": 4e-06, - "input_cost_per_token": 5e-06, - "input_cost_per_token_batches": 2.5e-06, - "litellm_provider": "openai", - "mode": "image_generation", - "output_cost_per_image_token": 3.2e-05, - "output_cost_per_token": 1e-05, - "output_cost_per_token_batches": 5e-06, - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/images/generations", - "/v1/images/edits" - ] - }, - "gemini-2.0-flash-exp-image-generation": { - "input_cost_per_token": 0.0, - "litellm_provider": "gemini", - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "image_generation", - "output_cost_per_image": 0.039, - "output_cost_per_token": 0.0, - "source": "https://ai.google.dev/pricing", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text", - "image" - ], "supports_vision": true }, - "gemini/gemini-2.0-flash-exp-image-generation": { - "input_cost_per_token": 0.0, - "litellm_provider": "gemini", - "max_input_tokens": 32768, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "image_generation", - "output_cost_per_image": 0.039, - "output_cost_per_token": 0.0, - "source": "https://ai.google.dev/pricing", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text", - "image" + "fireworks_ai/accounts/fireworks/routers/kimi-k3-us": { + "cache_read_input_token_cost": 4.5e-07, + "cache_read_input_token_cost_priority": 5.625e-07, + "input_cost_per_token": 4.5e-06, + "input_cost_per_token_priority": 5.625e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 2.25e-05, + "output_cost_per_token_priority": 2.8125e-05, + "reasoning_effort_levels": [ + "low", + "high", + "max" ], - "supports_vision": true, - "tpm": 250000, - "rpm": 10 + "source": "https://docs.fireworks.ai/serverless/pricing", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "gemini/gemini-2.0-flash-lite-001": { - "cache_read_input_token_cost": 1.875e-08, - "deprecation_date": "2026-06-01", - "input_cost_per_audio_token": 7.5e-08, - "input_cost_per_token": 7.5e-08, - "litellm_provider": "gemini", + "novita/zai-org/glm-5.3": { + "cache_read_input_token_cost": 2.6e-07, + "input_cost_per_token": 1.4e-06, + "litellm_provider": "novita", "max_input_tokens": 1048576, - "max_output_tokens": 8192, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 3e-07, - "rpm": 4000, - "source": "https://ai.google.dev/gemini-api/docs/pricing#gemini-2.0-flash-lite", - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": true, + "output_cost_per_token": 4.4e-06, + "source": "https://api.novita.ai/v3/openai/models", "supports_function_calling": true, "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "tpm": 4000000, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } + "supports_vision": false }, - "gemini-2.5-flash-native-audio-latest": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_token": 5e-07, - "litellm_provider": "gemini", + "novita/deepseek/deepseek-v4-pro-0813": { + "cache_read_input_token_cost": 1.3200000000000002e-07, + "input_cost_per_token": 1.32e-06, + "litellm_provider": "novita", "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 2e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, - "gemini_native_audio": true + "max_output_tokens": 393216, + "max_tokens": 393216, + "mode": "chat", + "output_cost_per_token": 3.96e-06, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "gemini-2.5-flash-native-audio-preview-09-2025": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_token": 5e-07, - "litellm_provider": "gemini", + "novita/moonshotai/kimi-k3": { + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 3e-06, + "litellm_provider": "novita", "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 2e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, - "gemini_native_audio": true + "max_output_tokens": 1048576, + "max_tokens": 1048576, + "mode": "chat", + "output_cost_per_token": 1.5e-05, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "gemini-2.5-flash-native-audio-preview-12-2025": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_token": 5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 131072, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 2e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, - "gemini_native_audio": true, + "novita/tencent/hy3": { + "cache_read_input_token_cost": 3.5e-08, + "input_cost_per_token": 1.4e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 5.8e-07, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_response_schema": false, - "supports_vision": true, - "supports_web_search": true + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "gemini-3.1-flash-live-preview": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_image_token": 1e-06, - "input_cost_per_token": 7.5e-07, - "input_cost_per_video_per_second": 3.3333333333333335e-05, - "litellm_provider": "gemini", - "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 4.5e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, + "novita/zai-org/glm-5.2": { + "cache_read_input_token_cost": 2.6e-07, + "input_cost_per_token": 1.4e-06, + "litellm_provider": "novita", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 4.4e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_vision": true, - "supports_web_search": true, - "gemini_audio_only_live": true, - "input_cost_per_second": 8.33333333333e-05, - "supports_response_schema": false + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "gemini-3.8-live": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_image_token": 1e-06, - "input_cost_per_token": 7.5e-07, - "input_cost_per_video_per_second": 3.3333333333333335e-05, - "litellm_provider": "gemini", - "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 4.5e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, + "novita/moonshotai/kimi-k2.7-code": { + "cache_read_input_token_cost": 1.9e-07, + "input_cost_per_token": 9.499999999999999e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 4e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_vision": true, - "supports_web_search": true, - "gemini_audio_only_live": true, - "supports_response_schema": false + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "gemini-3.8-live-extended-thinking": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_image_token": 1e-06, - "input_cost_per_token": 7.5e-07, - "input_cost_per_video_per_second": 3.3333333333333335e-05, - "litellm_provider": "gemini", - "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, + "novita/deepseek/deepseek-v4-flash-vision-exp": { + "cache_read_input_token_cost": 2.8e-08, + "input_cost_per_token": 4.4e-07, + "litellm_provider": "novita", + "max_input_tokens": 1048576, + "max_output_tokens": 393216, + "max_tokens": 393216, + "mode": "chat", + "output_cost_per_token": 1.32e-06, + "source": "https://api.novita.ai/v3/openai/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "novita/deepseek/deepseek-v4-flash-0731": { + "cache_read_input_token_cost": 2.8e-08, + "input_cost_per_token": 4.4e-07, + "litellm_provider": "novita", + "max_input_tokens": 1048576, + "max_output_tokens": 393216, + "max_tokens": 393216, + "mode": "chat", + "output_cost_per_token": 1.32e-06, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false + }, + "novita/mindai/macaron-v1-venti": { + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 1.5e-06, + "litellm_provider": "novita", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", "output_cost_per_token": 4.5e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_vision": true, - "supports_web_search": true, - "gemini_audio_only_live": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false + "supports_tool_choice": true, + "supports_vision": false }, - "gemini/gemini-2.5-flash-native-audio-latest": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_token": 5e-07, - "litellm_provider": "gemini", + "novita/minimax/minimax-m3": { + "cache_read_input_token_cost": 6e-08, + "input_cost_per_token": 3e-07, + "litellm_provider": "novita", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "novita/deepseek/deepseek-v4-flash": { + "cache_read_input_token_cost": 2.8e-08, + "input_cost_per_token": 1.4e-07, + "litellm_provider": "novita", "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 2e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, - "tpm": 250000, - "rpm": 10, - "gemini_native_audio": true + "max_output_tokens": 393216, + "max_tokens": 393216, + "mode": "chat", + "output_cost_per_token": 2.8e-07, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "gemini/gemini-2.5-flash-native-audio-preview-09-2025": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_token": 5e-07, - "litellm_provider": "gemini", + "novita/deepseek/deepseek-v4-pro": { + "cache_read_input_token_cost": 1.35e-07, + "input_cost_per_token": 1.6000000000000001e-06, + "litellm_provider": "novita", "max_input_tokens": 1048576, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 2e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, - "tpm": 250000, - "rpm": 10, - "gemini_native_audio": true + "max_output_tokens": 393216, + "max_tokens": 393216, + "mode": "chat", + "output_cost_per_token": 3.2000000000000003e-06, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false + }, + "novita/inclusionai/ling-3.0-flash-fast": { + "cache_read_input_token_cost": 1.2e-08, + "input_cost_per_token": 6e-08, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 1.8e-07, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": false + }, + "novita/qwen/qwen3.8-max": { + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "novita", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 6e-06, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "novita/inclusionai/ling-3.0-flash": { + "cache_read_input_token_cost": 1.2e-08, + "input_cost_per_token": 6e-08, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 1.8e-07, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": false + }, + "novita/mindai/macaron-v1-tall": { + "cache_read_input_token_cost": 8e-08, + "input_cost_per_token": 4.5000000000000003e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 2.6e-06, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": false + }, + "novita/stepfun/step-3.7-flash": { + "cache_read_input_token_cost": 4e-08, + "input_cost_per_token": 2.0000000000000002e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 256000, + "max_tokens": 256000, + "mode": "chat", + "output_cost_per_token": 1.15e-06, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "gemini/gemini-2.5-flash-native-audio-preview-12-2025": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_token": 5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 131072, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 2e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, - "tpm": 250000, - "rpm": 10, - "gemini_native_audio": true, + "novita/nvidia/nemotron-3-nano-30b-a3b": { + "input_cost_per_token": 5.0000000000000004e-08, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 2.0000000000000002e-07, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_response_schema": false, - "supports_vision": true, - "supports_web_search": true + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "gemini/gemini-3.1-flash-live-preview": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_image_token": 1e-06, - "input_cost_per_token": 7.5e-07, - "input_cost_per_video_per_second": 3.3333333333333335e-05, - "litellm_provider": "gemini", + "novita/baidu/cobuddy": { + "cache_read_input_token_cost": 7e-08, + "input_cost_per_token": 2.8e-07, + "litellm_provider": "novita", "max_input_tokens": 131072, "max_output_tokens": 65536, "max_tokens": 65536, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 4.5e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, + "mode": "chat", + "output_cost_per_token": 1.13e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_vision": true, - "supports_web_search": true, - "tpm": 250000, - "rpm": 10, - "gemini_audio_only_live": true, - "input_cost_per_second": 8.33333333333e-05, - "supports_response_schema": false - }, - "gemini/gemini-3.1-flash-tts-preview": { - "input_cost_per_token": 1e-06, - "input_cost_per_token_batches": 5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 8192, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "audio_speech", - "output_cost_per_audio_token": 2e-05, - "output_cost_per_token": 2e-05, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/audio/speech" - ], - "tpm": 4000000, - "rpm": 10, - "supports_function_calling": false, - "supports_response_schema": false, - "supports_web_search": false - }, - "gemini-2.5-flash-preview-tts": { - "input_cost_per_token": 5e-07, - "input_cost_per_token_batches": 2.5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 8192, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "audio_speech", - "output_cost_per_audio_token": 1e-05, - "output_cost_per_token": 1e-05, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/audio/speech" - ], - "supports_audio_input": false, - "supports_function_calling": false, - "supports_response_schema": false, - "supports_web_search": false + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": false }, - "gemini-flash-latest": { - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_token": 7.5e-07, - "litellm_provider": "gemini", + "novita/xiaomimimo/mimo-v2.5": { + "cache_read_input_token_cost": 3.4e-09, + "input_cost_per_token": 1.6800000000000002e-07, + "litellm_provider": "novita", "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 3.3600000000000004e-07, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "novita/qwen/qwen3.7-max": { + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "novita", + "max_input_tokens": 1000000, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_reasoning_token": 3.75e-06, "output_cost_per_token": 3.75e-06, - "rpm": 100000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": false, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "tpm": 8000000, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "google_maps_grounding_cost_per_query": 0.014, - "cache_read_input_token_cost_flex": 3.75e-08, - "cache_read_input_token_cost_priority": 1.35e-07, - "input_cost_per_token_batches": 3.75e-07, - "input_cost_per_token_flex": 3.75e-07, - "input_cost_per_token_priority": 1.35e-06, - "output_cost_per_token_batches": 1.875e-06, - "output_cost_per_token_flex": 1.875e-06, - "output_cost_per_token_priority": 6.75e-06, - "prompt_cache_min_tokens": 4096, - "supports_audio_input": true, - "supports_native_streaming": true, - "supports_video_input": true, - "web_search_billing_unit": "per_query" + "supports_vision": false }, - "gemini-flash-lite-latest": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "gemini", + "novita/xiaomimimo/mimo-v2.5-pro": { + "cache_read_input_token_cost": 4.3e-09, + "input_cost_per_token": 5.22e-07, + "litellm_provider": "novita", "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_reasoning_token": 2.5e-06, - "output_cost_per_token": 2.5e-06, - "rpm": 15, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": false, + "output_cost_per_token": 1.044e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "tpm": 250000, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "google_maps_grounding_cost_per_query": 0.014, - "cache_read_input_token_cost_flex": 2e-08, - "cache_read_input_token_cost_priority": 5e-08, - "input_cost_per_token_batches": 1.5e-07, - "input_cost_per_token_flex": 1.5e-07, - "input_cost_per_token_priority": 5.4e-07, - "output_cost_per_token_batches": 1.25e-06, - "output_cost_per_token_flex": 1.25e-06, - "output_cost_per_token_priority": 4.5e-06, - "supports_audio_input": true, - "supports_native_streaming": true, - "supports_video_input": true, - "web_search_billing_unit": "per_query" + "supports_vision": false }, - "gemini-pro-latest": { - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "litellm_provider": "gemini", - "max_input_tokens": 1048576, + "novita/qwen/qwen3.6-27b": { + "input_cost_per_token": 6e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_200k_tokens": 1.8e-05, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 3.6000000000000003e-06, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "novita/moonshotai/kimi-k2.6": { + "cache_read_input_token_cost": 1.6e-07, + "input_cost_per_token": 8.000000000000001e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 3.4e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "tpm": 800000, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "google_maps_grounding_cost_per_query": 0.014, - "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, - "cache_read_input_token_cost_priority": 3.6e-07, - "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, - "input_cost_per_token_batches": 1e-06, - "input_cost_per_token_priority": 3.6e-06, - "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, - "output_cost_per_token_batches": 6e-06, - "output_cost_per_token_priority": 2.16e-05, - "prompt_cache_min_tokens": 4096, - "supports_native_streaming": true, - "supports_url_context": true, - "web_search_billing_unit": "per_query", - "cache_read_input_token_cost_flex": 2e-07, - "input_cost_per_token_flex": 1e-06, - "output_cost_per_token_flex": 6e-06 + "supports_vision": true }, - "gemini/gemini-pro-latest": { - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "litellm_provider": "gemini", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "novita/zai-org/glm-5.1": { + "cache_read_input_token_cost": 2.6e-07, + "input_cost_per_token": 1.38e-06, + "litellm_provider": "novita", + "max_input_tokens": 204800, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_200k_tokens": 1.8e-05, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, + "output_cost_per_token": 4.4e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "tpm": 800000, - "search_context_cost_per_query": { - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014, - "search_context_size_high": 0.014 - }, - "google_maps_grounding_cost_per_query": 0.014, - "cache_read_input_token_cost_above_200k_tokens_priority": 7.2e-07, - "cache_read_input_token_cost_priority": 3.6e-07, - "input_cost_per_token_above_200k_tokens_priority": 7.2e-06, - "input_cost_per_token_batches": 1e-06, - "input_cost_per_token_priority": 3.6e-06, - "output_cost_per_token_above_200k_tokens_priority": 3.24e-05, - "output_cost_per_token_batches": 6e-06, - "output_cost_per_token_priority": 2.16e-05, - "prompt_cache_min_tokens": 4096, - "supports_native_streaming": true, - "supports_url_context": true, - "web_search_billing_unit": "per_query", - "cache_read_input_token_cost_flex": 2e-07, - "input_cost_per_token_flex": 1e-06, - "output_cost_per_token_flex": 6e-06 + "supports_vision": false }, - "gemini-exp-1206": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_audio_token": 1e-06, - "input_cost_per_token": 3e-07, - "litellm_provider": "gemini", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "novita/minimax/minimax-m2.7-highspeed": { + "cache_read_input_token_cost": 6e-08, + "input_cost_per_token": 6e-07, + "litellm_provider": "novita", + "max_input_tokens": 204800, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_reasoning_token": 2.5e-06, - "output_cost_per_token": 2.5e-06, - "rpm": 100000, - "source": "https://ai.google.dev/gemini-api/docs/models#gemini-2.5-flash-preview", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/completions", - "/v1/batch" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_output": false, + "output_cost_per_token": 2.4e-06, + "source": "https://api.novita.ai/v3/openai/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_url_context": true, - "supports_vision": true, - "supports_web_search": true, - "tpm": 8000000, - "search_context_cost_per_query": { - "search_context_size_low": 0.035, - "search_context_size_medium": 0.035, - "search_context_size_high": 0.035 - } + "supports_vision": false }, - "vertex_ai/claude-sonnet-5@default": { - "deprecation_date": "2026-12-24", - "regional_endpoint_uplift_multiplier": 1.1, - "supports_mid_conversation_system": true, - "cache_creation_input_token_cost": 2.5e-06, - "cache_creation_input_token_cost_above_1hr": 4e-06, - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 2e-06, - "litellm_provider": "vertex_ai-anthropic_models", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "novita/zai-org/glm-5v-turbo": { + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 1.2e-06, + "litellm_provider": "novita", + "max_input_tokens": 204800, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 4e-06, + "source": "https://api.novita.ai/v3/openai/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "novita/google/gemma-4-26b-a4b-it": { + "input_cost_per_token": 1.3e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 4.0000000000000003e-07, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "novita/google/gemma-4-31b-it": { + "input_cost_per_token": 1.4e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 4.0000000000000003e-07, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "novita/zai-org/glm-5-turbo": { + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 1.2e-06, + "litellm_provider": "novita", + "max_input_tokens": 202800, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_adaptive_thinking": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, + "output_cost_per_token": 4e-06, + "source": "https://api.novita.ai/v3/openai/models", "supports_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_max_reasoning_effort": true, - "prompt_cache_min_tokens": 1024 + "supports_vision": false }, - "vertex_ai/claude-sonnet-4-6@default": { - "regional_endpoint_uplift_multiplier": 1.1, - "supports_adaptive_thinking": true, - "supports_legacy_thinking": true, - "cache_creation_input_token_cost": 3.75e-06, - "cache_creation_input_token_cost_above_1hr": 6e-06, - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 3e-06, - "litellm_provider": "vertex_ai-anthropic_models", - "max_input_tokens": 1000000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "novita/minimax/minimax-m2.7": { + "cache_read_input_token_cost": 6e-08, + "input_cost_per_token": 3e-07, + "litellm_provider": "novita", + "max_input_tokens": 204800, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.5e-05, - "supports_assistant_prefill": true, - "supports_computer_use": true, + "output_cost_per_token": 1.2e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_max_reasoning_effort": true, "supports_tool_choice": true, - "supports_vision": true, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_output_config": true, - "prompt_cache_min_tokens": 1024 - }, - "duckduckgo/search": { - "litellm_provider": "duckduckgo", - "mode": "search", - "input_cost_per_query": 0.0, - "metadata": { - "notes": "DuckDuckGo Instant Answer API is free and does not require an API key." - } + "supports_vision": false }, - "bedrock_mantle/openai.gpt-oss-120b": { - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "novita/minimax/minimax-m2.5-highspeed": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 6e-07, + "litellm_provider": "novita", + "max_input_tokens": 204800, + "max_output_tokens": 131100, + "max_tokens": 131100, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], + "output_cost_per_token": 2.4e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_tool_choice": true, + "supports_vision": false }, - "bedrock_mantle/openai.gpt-oss-20b": { - "input_cost_per_token": 7e-08, - "output_cost_per_token": 3e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "novita/qwen/qwen3.5-27b": { + "input_cost_per_token": 3e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], + "output_cost_per_token": 2.4e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_parallel_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_tool_choice": true, + "supports_vision": true }, - "bedrock_mantle/openai.gpt-oss-safeguard-120b": { - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 131072, + "novita/qwen/qwen3.5-122b-a10b": { + "input_cost_per_token": 4.0000000000000003e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions" - ], + "output_cost_per_token": 3.2000000000000003e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_tool_choice": true, + "supports_vision": true }, - "bedrock_mantle/openai.gpt-oss-safeguard-20b": { - "input_cost_per_token": 7e-08, - "output_cost_per_token": 2e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 131072, + "novita/qwen/qwen3.5-35b-a3b": { + "input_cost_per_token": 2.5e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions" - ], + "output_cost_per_token": 2e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_tool_choice": true, + "supports_vision": true }, - "bedrock_mantle/openai.gpt-5.6-sol": { - "input_cost_per_token": 4.4e-06, - "input_cost_per_token_above_272k_tokens": 8.8e-06, - "cache_creation_input_token_cost": 5.5e-06, - "cache_creation_input_token_cost_above_272k_tokens": 1.1e-05, - "cache_read_input_token_cost": 4.4e-07, - "cache_read_input_token_cost_above_272k_tokens": 8.8e-07, - "output_cost_per_token": 2.2e-05, - "output_cost_per_token_above_272k_tokens": 3.3e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.012, - "search_context_size_low": 0.012, - "search_context_size_medium": 0.012 - }, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "novita/qwen/qwen3.5-397b-a17b": { + "input_cost_per_token": 6e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 3.6000000000000003e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_web_search": true + "supports_vision": true }, - "bedrock_mantle/openai.gpt-5.6-terra": { - "input_cost_per_token": 2.2e-06, - "input_cost_per_token_above_272k_tokens": 4.4e-06, - "cache_creation_input_token_cost": 2.75e-06, - "cache_creation_input_token_cost_above_272k_tokens": 5.5e-06, - "cache_read_input_token_cost": 2.2e-07, - "cache_read_input_token_cost_above_272k_tokens": 4.4e-07, - "output_cost_per_token": 1.32e-05, - "output_cost_per_token_above_272k_tokens": 1.98e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.012, - "search_context_size_low": 0.012, - "search_context_size_medium": 0.012 - }, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "novita/minimax/minimax-m2.5": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 3e-07, + "litellm_provider": "novita", + "max_input_tokens": 204800, + "max_output_tokens": 131100, + "max_tokens": 131100, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_web_search": true + "supports_vision": false }, - "bedrock_mantle/openai.gpt-5.6-cyber": { - "input_cost_per_token": 1.375e-05, - "cache_creation_input_token_cost": 1.71875e-05, - "cache_read_input_token_cost": 1.375e-06, - "output_cost_per_token": 8.25e-05, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "novita/zai-org/glm-5": { + "cache_read_input_token_cost": 2.0000000000000002e-07, + "input_cost_per_token": 1e-06, + "litellm_provider": "novita", + "max_input_tokens": 202800, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 3.2000000000000003e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_minimal_reasoning_effort": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_xhigh_reasoning_effort": true, + "supports_vision": false + }, + "novita/qwen/qwen3-coder-next": { + "input_cost_per_token": 2.0000000000000002e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 1.5e-06, + "source": "https://novita.ai/pricing", + "supports_function_calling": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false + }, + "novita/deepseek/deepseek-ocr-2": { + "input_cost_per_token": 3e-08, + "litellm_provider": "novita", + "max_input_tokens": 8192, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 3e-08, + "source": "https://novita.ai/pricing", "supports_vision": true }, - "bedrock_mantle/openai.gpt-daybreak-blue-5.6-sol": { - "input_cost_per_token": 5.5e-06, - "input_cost_per_token_above_272k_tokens": 1.1e-05, - "cache_creation_input_token_cost": 6.875e-06, - "cache_creation_input_token_cost_above_272k_tokens": 1.375e-05, - "cache_read_input_token_cost": 5.5e-07, - "cache_read_input_token_cost_above_272k_tokens": 1.1e-06, - "output_cost_per_token": 3.3e-05, - "output_cost_per_token_above_272k_tokens": 4.95e-05, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "novita/moonshotai/kimi-k2.5": { + "cache_read_input_token_cost": 1.0000000000000001e-07, + "input_cost_per_token": 6e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 3e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_minimal_reasoning_effort": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_xhigh_reasoning_effort": true, - "supports_vision": true, - "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-daybreak-blue-56-sol.html" + "supports_vision": true }, - "bedrock_mantle/openai.gpt-5.6-luna": { - "input_cost_per_token": 2.2e-07, - "input_cost_per_token_above_272k_tokens": 4.4e-07, - "cache_creation_input_token_cost": 2.75e-07, - "cache_creation_input_token_cost_above_272k_tokens": 5.5e-07, - "cache_read_input_token_cost": 2.2e-08, - "cache_read_input_token_cost_above_272k_tokens": 4.4e-08, - "output_cost_per_token": 1.32e-06, - "output_cost_per_token_above_272k_tokens": 1.98e-06, - "search_context_cost_per_query": { - "search_context_size_high": 0.012, - "search_context_size_low": 0.012, - "search_context_size_medium": 0.012 - }, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "novita/zai-org/glm-4.7-h": { + "cache_read_input_token_cost": 1.1e-07, + "input_cost_per_token": 6e-07, + "litellm_provider": "novita", + "max_input_tokens": 204800, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 2.2e-06, + "source": "https://api.novita.ai/v3/openai/models", "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_web_search": true + "supports_vision": false }, - "us.openai.gpt-5.6-sol": { - "input_cost_per_token": 4.4e-06, - "input_cost_per_token_above_272k_tokens": 8.8e-06, - "cache_creation_input_token_cost": 5.5e-06, - "cache_creation_input_token_cost_above_272k_tokens": 1.1e-05, - "cache_read_input_token_cost": 4.4e-07, - "cache_read_input_token_cost_above_272k_tokens": 8.8e-07, - "output_cost_per_token": 2.2e-05, - "output_cost_per_token_above_272k_tokens": 3.3e-05, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 1000000, + "novita/zai-org/glm-4.7-flash": { + "cache_read_input_token_cost": 1e-08, + "input_cost_per_token": 7e-08, + "litellm_provider": "novita", + "max_input_tokens": 200000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "output_cost_per_token": 4.0000000000000003e-07, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_xhigh_reasoning_effort": true, - "supports_vision": true + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "global.openai.gpt-5.6-sol": { - "input_cost_per_token": 4e-06, - "input_cost_per_token_above_272k_tokens": 8e-06, - "cache_creation_input_token_cost": 5e-06, - "cache_creation_input_token_cost_above_272k_tokens": 1e-05, - "cache_read_input_token_cost": 4e-07, - "cache_read_input_token_cost_above_272k_tokens": 8e-07, - "output_cost_per_token": 2e-05, - "output_cost_per_token_above_272k_tokens": 3e-05, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "novita/qwen/qwen3.6-35b-a3b": { + "input_cost_per_token": 2.48e-07, + "litellm_provider": "novita", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "output_cost_per_token": 1.4850000000000002e-06, + "source": "https://novita.ai/pricing", "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, - "supports_tool_choice": true, "supports_reasoning": true, - "supports_xhigh_reasoning_effort": true, + "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true }, - "us.openai.gpt-5.6-terra": { - "input_cost_per_token": 2.2e-06, - "input_cost_per_token_above_272k_tokens": 4.4e-06, - "cache_creation_input_token_cost": 2.75e-06, - "cache_creation_input_token_cost_above_272k_tokens": 5.5e-06, - "cache_read_input_token_cost": 2.2e-07, - "cache_read_input_token_cost_above_272k_tokens": 4.4e-07, - "output_cost_per_token": 1.32e-05, - "output_cost_per_token_above_272k_tokens": 1.98e-05, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "novita/deepseek/deepseek_v3": { + "input_cost_per_token": 8.900000000000001e-07, + "litellm_provider": "novita", + "max_input_tokens": 64000, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "output_cost_per_token": 8.900000000000001e-07, + "source": "https://api.novita.ai/v3/openai/models", "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, "supports_tool_choice": true, - "supports_reasoning": true, - "supports_xhigh_reasoning_effort": true, - "supports_vision": true + "supports_vision": false }, - "global.openai.gpt-5.6-terra": { - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_272k_tokens": 4e-06, - "cache_creation_input_token_cost": 2.5e-06, - "cache_creation_input_token_cost_above_272k_tokens": 5e-06, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_272k_tokens": 4e-07, - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_272k_tokens": 1.8e-05, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "novita/deepseek/deepseek-r1": { + "input_cost_per_token": 4e-06, + "litellm_provider": "novita", + "max_input_tokens": 64000, + "max_output_tokens": 16000, + "max_tokens": 16000, + "mode": "chat", + "output_cost_per_token": 4e-06, + "source": "https://api.novita.ai/v3/openai/models", "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, - "supports_tool_choice": true, "supports_reasoning": true, - "supports_xhigh_reasoning_effort": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": false }, - "us.openai.gpt-5.6-luna": { - "input_cost_per_token": 2.2e-07, - "input_cost_per_token_above_272k_tokens": 4.4e-07, - "cache_creation_input_token_cost": 2.75e-07, - "cache_creation_input_token_cost_above_272k_tokens": 5.5e-07, - "cache_read_input_token_cost": 2.2e-08, - "cache_read_input_token_cost_above_272k_tokens": 4.4e-08, - "output_cost_per_token": 1.32e-06, - "output_cost_per_token_above_272k_tokens": 1.98e-06, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "novita/deepseek/deepseek-v3/community": { + "input_cost_per_token": 8.900000000000001e-07, + "litellm_provider": "novita", + "max_input_tokens": 64000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "output_cost_per_token": 8.900000000000001e-07, + "source": "https://api.novita.ai/v3/openai/models", "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, "supports_tool_choice": true, + "supports_vision": false + }, + "novita/deepseek/deepseek-r1/community": { + "input_cost_per_token": 4e-06, + "litellm_provider": "novita", + "max_input_tokens": 64000, + "max_output_tokens": 8000, + "max_tokens": 8000, + "mode": "chat", + "output_cost_per_token": 4e-06, + "source": "https://api.novita.ai/v3/openai/models", + "supports_function_calling": true, "supports_reasoning": true, - "supports_xhigh_reasoning_effort": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": false }, - "global.openai.gpt-5.6-luna": { - "input_cost_per_token": 2e-07, - "input_cost_per_token_above_272k_tokens": 4e-07, - "cache_creation_input_token_cost": 2.5e-07, - "cache_creation_input_token_cost_above_272k_tokens": 5e-07, - "cache_read_input_token_cost": 2e-08, - "cache_read_input_token_cost_above_272k_tokens": 4e-08, - "output_cost_per_token": 1.2e-06, - "output_cost_per_token_above_272k_tokens": 1.8e-06, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "novita/thudm/glm-4-32b-0414": { + "input_cost_per_token": 5.5e-07, + "litellm_provider": "novita", + "max_input_tokens": 32000, + "max_output_tokens": 32000, + "max_tokens": 32000, "mode": "chat", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "output_cost_per_token": 1.66e-06, + "source": "https://api.novita.ai/v3/openai/models", "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, + "supports_response_schema": true, "supports_tool_choice": true, + "supports_vision": false + }, + "novita/meta-llama/llama-3.2-1b-instruct": { + "input_cost_per_token": 2e-08, + "litellm_provider": "novita", + "max_input_tokens": 131000, + "max_output_tokens": 32000, + "max_tokens": 32000, + "mode": "chat", + "output_cost_per_token": 2e-08, + "source": "https://api.novita.ai/v3/openai/models", + "supports_response_schema": true, + "supports_vision": false + }, + "wandb/deepseek-ai/DeepSeek-V4-Flash": { "supports_reasoning": true, - "supports_xhigh_reasoning_effort": true, - "supports_vision": true + "max_tokens": 1048576, + "max_input_tokens": 1049000, + "input_cost_per_token": 1.4e-07, + "output_cost_per_token": 2.8e-07, + "cache_read_input_token_cost": 7e-08, + "deprecation_date": "2026-10-05", + "supports_prompt_caching": true, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": false, + "source": "https://wandb.ai/site/pricing/tokens/" }, - "bedrock_mantle/openai.gpt-6-astra": { - "input_cost_per_token": 1.1e-05, - "input_cost_per_token_above_272k_tokens": 2.2e-05, - "cache_creation_input_token_cost": 1.375e-05, - "cache_creation_input_token_cost_above_272k_tokens": 2.75e-05, - "cache_read_input_token_cost": 1.1e-06, - "cache_read_input_token_cost_above_272k_tokens": 2.2e-06, - "output_cost_per_token": 5.5e-05, - "output_cost_per_token_above_272k_tokens": 8.25e-05, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, - "supports_none_reasoning_effort": false, + "wandb/deepseek-ai/DeepSeek-V4-Flash-0731": { + "supports_reasoning": true, + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 1.3e-07, + "output_cost_per_token": 2.8e-07, + "cache_read_input_token_cost": 7e-08, + "supports_prompt_caching": true, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": false, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/deepseek-ai/DeepSeek-V4-Pro": { + "supports_reasoning": true, + "max_tokens": 1048576, + "max_input_tokens": 1049000, + "input_cost_per_token": 1.15e-06, + "output_cost_per_token": 2.55e-06, + "cache_read_input_token_cost": 2e-07, + "deprecation_date": "2026-10-05", "supports_prompt_caching": true, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": false, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/google/gemma-4-31B-it": { "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_xhigh_reasoning_effort": true, + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 3.4e-07, + "litellm_provider": "wandb", + "mode": "chat", "supports_vision": true, - "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-6-astra.html" + "source": "https://wandb.ai/site/pricing/tokens/" }, - "us.openai.gpt-6-astra": { - "input_cost_per_token": 1.1e-05, - "input_cost_per_token_above_272k_tokens": 2.2e-05, - "cache_creation_input_token_cost": 1.375e-05, - "cache_creation_input_token_cost_above_272k_tokens": 2.75e-05, - "cache_read_input_token_cost": 1.1e-06, - "cache_read_input_token_cost_above_272k_tokens": 2.2e-06, - "output_cost_per_token": 5.5e-05, - "output_cost_per_token_above_272k_tokens": 8.25e-05, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, + "wandb/ibm-granite/granite-4.1-8b": { + "deprecation_date": "2026-10-05", + "max_tokens": 131072, + "max_input_tokens": 131000, + "input_cost_per_token": 5e-08, + "output_cost_per_token": 1e-07, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": false, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/JetBrains/Mellum2-12B-A2.5B-Instruct": { + "deprecation_date": "2026-10-05", + "max_tokens": 131072, + "max_input_tokens": 131000, + "input_cost_per_token": 5e-08, + "output_cost_per_token": 1e-07, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": false, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/meta-llama/Llama-3.1-70B-Instruct": { + "deprecation_date": "2026-10-05", "max_tokens": 128000, + "max_input_tokens": 131000, + "input_cost_per_token": 8e-07, + "output_cost_per_token": 8e-07, + "litellm_provider": "wandb", "mode": "chat", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, - "supports_none_reasoning_effort": false, - "supports_tool_choice": true, + "supports_vision": false, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/MiniMaxAI/MiniMax-M3": { + "supports_reasoning": true, + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 2.3e-07, + "output_cost_per_token": 9.6e-07, + "cache_read_input_token_cost": 5e-08, + "supports_prompt_caching": true, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": true, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/moonshotai/Kimi-K2.7-Code": { + "supports_reasoning": true, + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 7.1e-07, + "output_cost_per_token": 3.5e-06, + "cache_read_input_token_cost": 1.5e-07, "supports_prompt_caching": true, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": true, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/moonshotai/Kimi-K2.6": { "supports_reasoning": true, - "supports_xhigh_reasoning_effort": true, + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 6.5e-07, + "output_cost_per_token": 3.41e-06, + "cache_read_input_token_cost": 1.5e-07, + "supports_prompt_caching": true, + "litellm_provider": "wandb", + "mode": "chat", "supports_vision": true, - "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-6-astra.html" + "source": "https://wandb.ai/site/pricing/tokens/" }, - "global.openai.gpt-6-astra": { - "input_cost_per_token": 1e-05, - "input_cost_per_token_above_272k_tokens": 2e-05, - "cache_creation_input_token_cost": 1.25e-05, - "cache_creation_input_token_cost_above_272k_tokens": 2.5e-05, - "cache_read_input_token_cost": 1e-06, - "cache_read_input_token_cost_above_272k_tokens": 2e-06, - "output_cost_per_token": 5e-05, - "output_cost_per_token_above_272k_tokens": 7.5e-05, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "wandb/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B": { + "supports_reasoning": true, + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 7e-08, + "output_cost_per_token": 2e-07, + "cache_read_input_token_cost": 4e-08, + "supports_prompt_caching": true, + "litellm_provider": "wandb", "mode": "chat", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_minimal_reasoning_effort": false, - "supports_none_reasoning_effort": false, - "supports_tool_choice": true, + "supports_vision": false, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B": { + "supports_reasoning": true, + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 5e-07, + "output_cost_per_token": 2.15e-06, + "cache_read_input_token_cost": 1e-07, "supports_prompt_caching": true, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": false, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/OpenPipe/Qwen3-14B-Instruct": { + "deprecation_date": "2026-10-05", + "max_tokens": 32768, + "max_input_tokens": 32800, + "input_cost_per_token": 5e-08, + "output_cost_per_token": 2.2e-07, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": false, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/Qwen/Qwen3.8-27B": { "supports_reasoning": true, - "supports_xhigh_reasoning_effort": true, + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 4e-07, + "output_cost_per_token": 3e-06, + "cache_read_input_token_cost": 1.5e-07, + "supports_prompt_caching": true, + "litellm_provider": "wandb", + "mode": "chat", "supports_vision": true, - "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-6-astra.html" + "source": "https://wandb.ai/site/pricing/tokens/" }, - "bedrock_mantle/openai.gpt-5.5": { - "input_cost_per_token": 5.5e-06, - "input_cost_per_token_above_272k_tokens": 1.1e-05, - "cache_read_input_token_cost": 5.5e-07, - "cache_read_input_token_cost_above_272k_tokens": 1.1e-06, - "output_cost_per_token": 3.3e-05, - "output_cost_per_token_above_272k_tokens": 4.95e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.012, - "search_context_size_low": 0.012, - "search_context_size_medium": 0.012 - }, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], - "supports_function_calling": true, - "supports_minimal_reasoning_effort": false, + "wandb/Qwen/Qwen3.6-35B-A3B": { + "supports_reasoning": true, + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 1.25e-06, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": true, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/Qwen/Qwen3.6-27B": { + "supports_reasoning": true, + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 6e-07, + "output_cost_per_token": 3.6e-06, + "cache_read_input_token_cost": 1.2e-07, + "deprecation_date": "2026-10-05", "supports_prompt_caching": true, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": true, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/Qwen/Qwen3.5-35B-A3B": { + "deprecation_date": "2026-10-05", "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 1.25e-06, + "litellm_provider": "wandb", + "mode": "chat", "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_web_search": true + "source": "https://wandb.ai/site/pricing/tokens/" }, - "bedrock_mantle/openai.gpt-5.4": { - "input_cost_per_token": 2.75e-06, - "input_cost_per_token_above_272k_tokens": 5.5e-06, - "cache_read_input_token_cost": 2.75e-07, - "cache_read_input_token_cost_above_272k_tokens": 5.5e-07, - "output_cost_per_token": 1.65e-05, - "output_cost_per_token_above_272k_tokens": 2.475e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.012, - "search_context_size_low": 0.012, - "search_context_size_medium": 0.012 - }, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "wandb/Qwen/Qwen3-30B-A3B-Instruct-2507": { + "deprecation_date": "2026-10-05", + "max_tokens": 262144, + "max_input_tokens": 262000, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 3e-07, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": false, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/deepseek-ai/DeepSeek-V4-Pro-0813": { + "litellm_provider": "wandb", + "mode": "chat", + "supports_reasoning": true, + "input_cost_per_token": 1.31e-06, + "output_cost_per_token": 3.96e-06, + "cache_read_input_token_cost": 4.4e-08, + "max_input_tokens": 1049000, + "supports_prompt_caching": true, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/ibm-granite/granite-4.2-8b": { + "litellm_provider": "wandb", + "mode": "chat", + "supports_reasoning": true, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 1.5e-07, + "cache_read_input_token_cost": 5e-08, + "max_input_tokens": 131000, + "supports_prompt_caching": true, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "wandb/zai-org/GLM-5.2": { + "supports_reasoning": true, + "max_tokens": 262144, + "max_input_tokens": 1049000, + "input_cost_per_token": 7.6e-07, + "output_cost_per_token": 2.42e-06, + "cache_read_input_token_cost": 1.4e-07, + "supports_prompt_caching": true, + "litellm_provider": "wandb", + "mode": "chat", + "supports_vision": false, + "source": "https://wandb.ai/site/pricing/tokens/" + }, + "deepinfra/openai/gpt-oss-120b-Turbo": { + "max_tokens": 131072, + "max_input_tokens": 131072, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "litellm_provider": "deepinfra", + "mode": "chat", "supports_function_calling": true, - "supports_minimal_reasoning_effort": false, + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/MiniMaxAI/MiniMax-M2.7": { + "max_tokens": 196608, + "max_input_tokens": 196608, + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 1e-06, + "cache_read_input_token_cost": 5e-08, "supports_prompt_caching": true, - "supports_reasoning": true, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/Qwen/Qwen3.8-27B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 4e-07, + "output_cost_per_token": 3e-06, + "cache_read_input_token_cost": 4e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, "supports_tool_choice": true, + "supports_response_schema": true, + "supports_reasoning": true, "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_web_search": true + "source": "https://deepinfra.com/pricing" }, - "bedrock_mantle/google.gemma-4-31b": { - "input_cost_per_token": 1.4e-07, - "output_cost_per_token": 4e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, + "deepinfra/google/gemma-4-31B-it-Ultra": { + "max_tokens": 131072, + "max_input_tokens": 131072, + "input_cost_per_token": 2.7e-07, + "output_cost_per_token": 7.6e-07, + "litellm_provider": "deepinfra", "mode": "chat", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], "supports_function_calling": true, - "supports_parallel_function_calling": false, - "supports_reasoning": true, "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "bedrock_mantle/google.gemma-4-26b-a4b": { - "input_cost_per_token": 1.3e-07, - "output_cost_per_token": 4e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, + "deepinfra/moonshotai/Kimi-K2.5": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 4.5e-07, + "output_cost_per_token": 2.25e-06, + "cache_read_input_token_cost": 7e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], "supports_function_calling": true, - "supports_parallel_function_calling": false, - "supports_reasoning": true, "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "bedrock_mantle/google.gemma-4-e2b": { - "input_cost_per_token": 4e-08, - "output_cost_per_token": 8e-08, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "deepinfra/zai-org/GLM-4.7-Flash": { + "max_tokens": 202752, + "max_input_tokens": 202752, + "input_cost_per_token": 6e-08, + "output_cost_per_token": 4e-07, + "cache_read_input_token_cost": 1e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], "supports_function_calling": true, - "supports_parallel_function_calling": false, - "supports_reasoning": true, "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "bedrock_mantle/xai.grok-4.3": { - "use_openai_responses_path": true, - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 2.5e-06, - "cache_read_input_token_cost": 2e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1048576, - "max_output_tokens": 16384, - "max_tokens": 16384, + "deepinfra/zai-org/GLM-4.6": { + "max_tokens": 202752, + "max_input_tokens": 202752, + "input_cost_per_token": 5e-07, + "output_cost_per_token": 2e-06, + "cache_read_input_token_cost": 1e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "source": "https://aws.amazon.com/bedrock/pricing/" + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "bedrock_mantle/xai.grok-4.6": { - "use_openai_responses_path": true, - "input_cost_per_token": 2.2e-06, - "output_cost_per_token": 6.6e-06, - "cache_read_input_token_cost": 5.5e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 500000, - "max_output_tokens": 500000, - "max_tokens": 500000, + "deepinfra/anthropic/claude-opus-4-8": { + "input_cost_per_token": 5e-06, + "litellm_provider": "deepinfra", + "max_input_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], + "output_cost_per_token": 2.5e-05, + "prompt_cache_min_tokens": 1024, + "source": "https://deepinfra.com/pricing", + "supports_adaptive_thinking": true, "supports_function_calling": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true }, - "us.xai.grok-4.6": { - "input_cost_per_token": 2.2e-06, - "output_cost_per_token": 6.6e-06, - "cache_read_input_token_cost": 5.5e-07, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 500000, - "max_output_tokens": 500000, - "max_tokens": 500000, + "deepinfra/anthropic/claude-sonnet-4-6": { + "max_tokens": 1000000, + "max_input_tokens": 1000000, + "input_cost_per_token": 3e-06, + "output_cost_per_token": 1.5e-05, + "litellm_provider": "deepinfra", "mode": "chat", + "prompt_cache_min_tokens": 1024, "supports_function_calling": true, - "supports_prompt_caching": false, - "supports_reasoning": true, "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_reasoning": true, + "supports_adaptive_thinking": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "global.xai.grok-4.6": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 6e-06, - "cache_read_input_token_cost": 5e-07, - "litellm_provider": "bedrock_converse", - "max_input_tokens": 500000, - "max_output_tokens": 500000, - "max_tokens": 500000, + "deepinfra/google/gemini-3.5-flash": { + "max_tokens": 1000000, + "max_input_tokens": 1000000, + "input_cost_per_token": 1.5e-06, + "output_cost_per_token": 9e-06, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_prompt_caching": false, - "supports_reasoning": true, "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing", + "supports_audio_input": true }, - "volcengine/doubao-seed-2-0-pro-260215": { - "litellm_provider": "volcengine", - "max_input_tokens": 256000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "deepinfra/XiaomiMiMo/MiMo-V2.5": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 4e-07, + "output_cost_per_token": 2e-06, + "cache_read_input_token_cost": 8e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "source": "https://docs.volcengine.com/docs/82379/1330310", "supports_function_calling": true, + "supports_tool_choice": true, + "supports_response_schema": true, "supports_reasoning": true, - "supports_tool_choice": false, "supports_vision": true, - "tiered_pricing": [ - { - "input_cost_per_token": 4.6e-07, - "output_cost_per_token": 2.3e-06, - "range": [ - 0, - 32000.0 - ] - }, - { - "input_cost_per_token": 7e-07, - "output_cost_per_token": 3.5e-06, - "range": [ - 32000.0, - 128000.0 - ] - }, - { - "input_cost_per_token": 1.4e-06, - "output_cost_per_token": 7e-06, - "range": [ - 128000.0, - 256000.0 - ] - } - ] + "source": "https://deepinfra.com/pricing" }, - "volcengine/doubao-seed-2-1-pro-260628": { - "cache_read_input_token_cost": 1.725e-07, - "input_cost_per_token": 8.625e-07, - "litellm_provider": "volcengine", - "max_input_tokens": 256000, - "max_output_tokens": 256000, + "deepinfra/Qwen/Qwen3-Max": { "max_tokens": 256000, + "max_input_tokens": 256000, + "input_cost_per_token": 1.2e-06, + "output_cost_per_token": 6e-06, + "cache_read_input_token_cost": 2.4e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "output_cost_per_token": 4.3125e-06, - "source": "https://www.volcengine.com/docs/82379/1544106", "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_tool_choice": false, - "supports_vision": true + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "volcengine/doubao-seed-2-1-turbo-260628": { - "cache_read_input_token_cost": 8.625e-08, - "input_cost_per_token": 4.3125e-07, - "litellm_provider": "volcengine", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, + "deepinfra/google/gemma-4-31B-it-turbo": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 9e-08, + "output_cost_per_token": 3.4e-07, + "cache_read_input_token_cost": 5e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "output_cost_per_token": 2.15625e-06, - "source": "https://www.volcengine.com/docs/82379/1544106", "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_tool_choice": true, "supports_reasoning": true, - "supports_tool_choice": false, - "supports_vision": true + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "volcengine/doubao-seed-2-0-lite-260215": { - "litellm_provider": "volcengine", - "max_input_tokens": 256000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "deepinfra/thinkingmachines/Inkling-Small": { + "max_tokens": 524288, + "max_input_tokens": 524288, + "input_cost_per_token": 4.5e-07, + "output_cost_per_token": 1.2e-06, + "cache_read_input_token_cost": 1e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "source": "https://docs.volcengine.com/docs/82379/1330310", "supports_function_calling": true, + "supports_tool_choice": true, + "supports_response_schema": true, "supports_reasoning": true, - "supports_tool_choice": false, "supports_vision": true, - "tiered_pricing": [ - { - "input_cost_per_token": 8.7e-08, - "output_cost_per_token": 5.2e-07, - "range": [ - 0, - 32000.0 - ] - }, - { - "input_cost_per_token": 1.3e-07, - "output_cost_per_token": 7.8e-07, - "range": [ - 32000.0, - 128000.0 - ] - }, - { - "input_cost_per_token": 2.6e-07, - "output_cost_per_token": 1.6e-06, - "range": [ - 128000.0, - 256000.0 - ] - } - ] + "source": "https://deepinfra.com/pricing" }, - "volcengine/doubao-seed-2-0-mini-260215": { - "litellm_provider": "volcengine", - "max_input_tokens": 256000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "deepinfra/meta-models/Muse-Glimmer-30B": { + "max_tokens": 131072, + "max_input_tokens": 131072, + "input_cost_per_token": 3e-07, + "output_cost_per_token": 1.2e-06, + "cache_read_input_token_cost": 4e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "source": "https://docs.volcengine.com/docs/82379/1330310", "supports_function_calling": true, + "supports_tool_choice": true, + "supports_response_schema": true, "supports_reasoning": true, - "supports_tool_choice": false, "supports_vision": true, - "tiered_pricing": [ - { - "input_cost_per_token": 2.9e-08, - "output_cost_per_token": 2.9e-07, - "range": [ - 0, - 32000.0 - ] - }, - { - "input_cost_per_token": 5.8e-08, - "output_cost_per_token": 5.8e-07, - "range": [ - 32000.0, - 128000.0 - ] - }, - { - "input_cost_per_token": 1.2e-07, - "output_cost_per_token": 1.2e-06, - "range": [ - 128000.0, - 256000.0 - ] - } - ] + "source": "https://deepinfra.com/pricing" }, - "volcengine/doubao-seed-2-0-code-preview-260215": { - "litellm_provider": "volcengine", + "deepinfra/Qwen/Qwen3-Max-Thinking": { + "max_tokens": 256000, "max_input_tokens": 256000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "input_cost_per_token": 1.2e-06, + "output_cost_per_token": 6e-06, + "cache_read_input_token_cost": 2.4e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "source": "https://docs.volcengine.com/docs/82379/1330310", "supports_function_calling": true, - "supports_reasoning": true, - "supports_tool_choice": false, - "supports_vision": true, - "tiered_pricing": [ - { - "input_cost_per_token": 4.6e-07, - "output_cost_per_token": 2.3e-06, - "range": [ - 0, - 32000.0 - ] - }, - { - "input_cost_per_token": 7e-07, - "output_cost_per_token": 3.5e-06, - "range": [ - 32000.0, - 128000.0 - ] - }, - { - "input_cost_per_token": 1.4e-06, - "output_cost_per_token": 7e-06, - "range": [ - 128000.0, - 256000.0 - ] - } - ] + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "bedrock/us-east-1/zai.glm-5": { - "input_cost_per_token": 1e-06, - "output_cost_per_token": 3.2e-06, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "deepinfra/Qwen/Qwen3-VL-235B-A22B-Instruct": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 8.8e-07, + "cache_read_input_token_cost": 1.1e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_reasoning": true, - "supports_system_messages": true, - "supports_native_structured_output": true, "supports_tool_choice": true, - "source": "https://aws.amazon.com/bedrock/pricing/" + "supports_response_schema": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "bedrock/us-west-2/zai.glm-5": { - "input_cost_per_token": 1e-06, - "output_cost_per_token": 3.2e-06, - "litellm_provider": "bedrock", - "max_input_tokens": 200000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "deepinfra/Qwen/Qwen3-VL-30B-A3B-Instruct": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_reasoning": true, - "supports_system_messages": true, - "supports_native_structured_output": true, "supports_tool_choice": true, - "source": "https://aws.amazon.com/bedrock/pricing/" + "supports_response_schema": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "bedrock/us-gov-east-1/anthropic.claude-haiku-4-5-20251001-v1:0": { - "cache_creation_input_token_cost": 1.5e-06, - "cache_creation_input_token_cost_above_1hr": 2.4e-06, - "cache_read_input_token_cost": 1.2e-07, - "input_cost_per_token": 1.2e-06, - "litellm_provider": "bedrock", - "supports_tool_search": true, - "max_input_tokens": 200000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "deepinfra/Qwen/Qwen3.5-27B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 2.6e-07, + "output_cost_per_token": 2.6e-06, + "litellm_provider": "deepinfra", "mode": "chat", - "output_cost_per_token": 6e-06, - "source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock", - "supports_assistant_prefill": true, - "supports_computer_use": true, "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_tool_choice": true, "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/Qwen/Qwen3.6-35B-A3B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 9.5e-07, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, "supports_tool_choice": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/nvidia/Nemotron-Content-Safety-3.5": { + "max_tokens": 131072, + "max_input_tokens": 131072, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "deepinfra", + "mode": "chat", "supports_vision": true, - "supports_native_structured_output": true, - "supports_pdf_input": true, - "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096 + "source": "https://deepinfra.com/pricing" }, - "bedrock/us-gov-west-1/anthropic.claude-haiku-4-5-20251001-v1:0": { - "cache_creation_input_token_cost": 1.5e-06, - "cache_creation_input_token_cost_above_1hr": 2.4e-06, - "cache_read_input_token_cost": 1.2e-07, - "input_cost_per_token": 1.2e-06, - "litellm_provider": "bedrock", - "supports_tool_search": true, - "max_input_tokens": 200000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "deepinfra/anthropic/claude-opus-5": { + "input_cost_per_token": 5e-06, + "litellm_provider": "deepinfra", + "max_input_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 6e-06, - "source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock", - "supports_assistant_prefill": true, - "supports_computer_use": true, + "output_cost_per_token": 2.5e-05, + "prompt_cache_min_tokens": 512, + "source": "https://deepinfra.com/pricing", + "supports_adaptive_thinking": true, "supports_function_calling": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": true, - "supports_native_structured_output": true, - "supports_pdf_input": true, - "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 4096 + "supports_vision": true }, - "snowflake/claude-sonnet-4-5": { - "max_tokens": 16384, - "max_input_tokens": 200000, - "max_output_tokens": 16384, - "input_cost_per_token": 3e-06, - "output_cost_per_token": 1.5e-05, - "cache_read_input_token_cost": 3e-07, - "litellm_provider": "snowflake", + "deepinfra/thinkingmachines/Inkling": { + "max_tokens": 524288, + "max_input_tokens": 524288, + "input_cost_per_token": 9.5e-07, + "output_cost_per_token": 4.05e-06, + "cache_read_input_token_cost": 1.6e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_system_messages": true, + "supports_tool_choice": true, "supports_response_schema": true, - "prompt_cache_min_tokens": 1024 + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "snowflake/claude-sonnet-4-6": { - "supports_adaptive_thinking": true, - "supports_legacy_thinking": true, - "max_tokens": 16384, - "max_input_tokens": 200000, - "max_output_tokens": 16384, - "input_cost_per_token": 3e-06, - "output_cost_per_token": 1.5e-05, - "cache_read_input_token_cost": 3e-07, - "litellm_provider": "snowflake", + "deepinfra/moonshotai/Kimi-K2.6": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 7.5e-07, + "output_cost_per_token": 3.5e-06, + "cache_read_input_token_cost": 1.5e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_system_messages": true, + "supports_tool_choice": true, "supports_response_schema": true, - "prompt_cache_min_tokens": 1024 + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "snowflake/claude-4-sonnet": { - "max_tokens": 16384, - "max_input_tokens": 200000, - "max_output_tokens": 16384, - "input_cost_per_token": 3e-06, - "output_cost_per_token": 1.5e-05, - "cache_read_input_token_cost": 3e-07, - "litellm_provider": "snowflake", + "deepinfra/deepseek-ai/DeepSeek-V4-Pro-0813": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "input_cost_per_token": 1.3e-06, + "output_cost_per_token": 2.6e-06, + "cache_read_input_token_cost": 1e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_system_messages": true, + "supports_tool_choice": true, "supports_response_schema": true, - "prompt_cache_min_tokens": 1024 + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "snowflake/claude-4-opus": { - "max_tokens": 16384, - "max_input_tokens": 200000, - "max_output_tokens": 16384, - "input_cost_per_token": 5e-06, - "output_cost_per_token": 2.5e-05, + "deepinfra/Qwen/Qwen3.7-Max": { + "max_tokens": 256000, + "max_input_tokens": 256000, + "input_cost_per_token": 2.5e-06, + "output_cost_per_token": 7.5e-06, "cache_read_input_token_cost": 5e-07, - "litellm_provider": "snowflake", + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_system_messages": true, - "supports_reasoning": true, + "supports_tool_choice": true, "supports_response_schema": true, - "prompt_cache_min_tokens": 1024 + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "snowflake/claude-haiku-4-5": { - "max_tokens": 16384, - "max_input_tokens": 200000, - "max_output_tokens": 16384, - "input_cost_per_token": 1e-06, - "output_cost_per_token": 5e-06, - "cache_read_input_token_cost": 1e-07, - "litellm_provider": "snowflake", + "deepinfra/ByteDance/Seed-2.0-mini": { + "max_tokens": 256000, + "max_input_tokens": 256000, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 4e-07, + "cache_read_input_token_cost": 2e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_reasoning": true, "supports_vision": true, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/Qwen/Qwen3.8-2.4T-A95B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 2e-06, + "output_cost_per_token": 6e-06, + "cache_read_input_token_cost": 2e-07, "supports_prompt_caching": true, - "supports_system_messages": true, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, "supports_response_schema": true, - "prompt_cache_min_tokens": 4096 + "supports_reasoning": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "snowflake/claude-3-7-sonnet": { - "max_tokens": 16384, - "max_input_tokens": 200000, - "max_output_tokens": 16384, - "input_cost_per_token": 3e-06, - "output_cost_per_token": 1.5e-05, - "cache_read_input_token_cost": 3e-07, - "litellm_provider": "snowflake", + "deepinfra/MiniMaxAI/MiniMax-M3": { + "max_tokens": 524288, + "max_input_tokens": 524288, + "input_cost_per_token": 2.8e-07, + "output_cost_per_token": 1.1e-06, + "cache_read_input_token_cost": 5.6e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_system_messages": true, + "supports_tool_choice": true, + "supports_response_schema": true, "supports_reasoning": true, - "supports_response_schema": true + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "snowflake/openai-gpt-4.1": { - "max_tokens": 16384, - "max_input_tokens": 300000, - "max_output_tokens": 16384, - "input_cost_per_token": 2e-06, - "output_cost_per_token": 8e-06, - "cache_read_input_token_cost": 5e-07, - "litellm_provider": "snowflake", + "deepinfra/google/gemini-3.1-flash-lite": { + "max_tokens": 1000000, + "max_input_tokens": 1000000, + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 1.5e-06, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_reasoning": true, "supports_vision": true, - "supports_prompt_caching": true, - "supports_system_messages": true, - "supports_response_schema": true + "source": "https://deepinfra.com/pricing", + "supports_audio_input": true }, - "snowflake/openai-gpt-5": { - "max_tokens": 16384, - "max_input_tokens": 300000, - "max_output_tokens": 16384, - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 1e-05, - "cache_read_input_token_cost": 1.25e-07, - "litellm_provider": "snowflake", + "deepinfra/google/gemini-3.7-flash": { + "max_tokens": 1000000, + "max_input_tokens": 1000000, + "input_cost_per_token": 7.5e-07, + "output_cost_per_token": 3.75e-06, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_reasoning": true, "supports_vision": true, + "source": "https://deepinfra.com/pricing", + "supports_audio_input": true + }, + "deepinfra/inclusionAI/Ling-3.0-flash": { + "max_tokens": 131072, + "max_input_tokens": 131072, + "input_cost_per_token": 6e-08, + "output_cost_per_token": 1.8e-07, + "cache_read_input_token_cost": 1.2e-08, "supports_prompt_caching": true, - "supports_system_messages": true, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_response_schema": true, "supports_reasoning": true, - "supports_response_schema": true + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "snowflake/openai-gpt-5-mini": { - "max_tokens": 16384, - "max_input_tokens": 1000000, - "max_output_tokens": 16384, - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, - "litellm_provider": "snowflake", + "deepinfra/stepfun-ai/Step-3.7-Flash": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 1.15e-06, + "cache_read_input_token_cost": 4e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_system_messages": true, - "supports_response_schema": true + "supports_tool_choice": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "snowflake/openai-gpt-5-nano": { - "max_tokens": 16384, - "max_input_tokens": 5000000, - "max_output_tokens": 16384, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "litellm_provider": "snowflake", + "deepinfra/Qwen/Qwen3.5-35B-A3B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 1.4e-07, + "output_cost_per_token": 1e-06, + "cache_read_input_token_cost": 5e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_system_messages": true, - "supports_response_schema": true + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "snowflake/llama4-maverick": { - "max_tokens": 16384, - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "input_cost_per_token": 2.4e-07, - "output_cost_per_token": 9.7e-07, - "litellm_provider": "snowflake", + "deepinfra/ByteDance/Seed-1.8": { + "max_tokens": 256000, + "max_input_tokens": 256000, + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 2e-06, + "cache_read_input_token_cost": 5e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_system_messages": true - }, - "snowflake/snowflake-arctic-embed-l-v2.0": { - "max_tokens": 8192, - "max_input_tokens": 8192, - "input_cost_per_token": 7e-08, - "output_cost_per_token": 0.0, - "litellm_provider": "snowflake", - "mode": "embedding" - }, - "snowflake/snowflake-arctic-embed-m-v2.0": { - "max_tokens": 8192, - "max_input_tokens": 8192, - "input_cost_per_token": 7e-08, - "output_cost_per_token": 0.0, - "litellm_provider": "snowflake", - "mode": "embedding" - }, - "soniox/stt-async-v4": { - "litellm_provider": "soniox", - "max_output_tokens": 8000, - "max_tokens": 8000, - "input_cost_per_second": 0.0, - "output_cost_per_second": 2.77778e-05, - "mode": "audio_transcription", - "source": "https://soniox.com/pricing", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ], - "supports_audio_input": true - }, - "soniox/stt-async-v5": { - "litellm_provider": "soniox", - "max_output_tokens": 8000, - "max_tokens": 8000, - "input_cost_per_second": 0.0, - "output_cost_per_second": 2.77778e-05, - "mode": "audio_transcription", - "source": "https://soniox.com/pricing", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ], - "supports_audio_input": true + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "tensormesh/Qwen/Qwen3.5-397B-A17B-FP8": { - "litellm_provider": "tensormesh", - "mode": "chat", - "input_cost_per_token": 6e-07, - "output_cost_per_token": 3.6e-06, - "cache_read_input_token_cost": 0, + "deepinfra/tencent/Hy3": { + "max_tokens": 262144, "max_input_tokens": 262144, - "max_output_tokens": 262144, + "input_cost_per_token": 1.4e-07, + "output_cost_per_token": 5.8e-07, + "cache_read_input_token_cost": 3.5e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", + "mode": "chat", "supports_function_calling": true, "supports_tool_choice": true, "supports_response_schema": true, - "supports_prompt_caching": true, - "supports_system_messages": true, "supports_reasoning": true, - "source": "https://serverless.tensormesh.ai/v1/models/openrouter" + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "tensormesh/Qwen/Qwen3-Coder-480B-A35B-Instruct-FP8": { - "litellm_provider": "tensormesh", + "deepinfra/ByteDance/Seed-2.0-code": { + "max_tokens": 256000, + "max_input_tokens": 256000, + "input_cost_per_token": 5e-07, + "output_cost_per_token": 3e-06, + "cache_read_input_token_cost": 1e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "input_cost_per_token": 4.5e-07, - "output_cost_per_token": 1.8e-06, - "cache_read_input_token_cost": 0, - "max_input_tokens": 262144, - "max_output_tokens": 262144, "supports_function_calling": true, "supports_tool_choice": true, "supports_response_schema": true, - "supports_prompt_caching": true, - "supports_system_messages": true, - "source": "https://serverless.tensormesh.ai/v1/models/openrouter" + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "tensormesh/Qwen/Qwen3.6-27B-FP8": { - "litellm_provider": "tensormesh", + "deepinfra/ByteDance/Seed-2.0-pro": { + "max_tokens": 256000, + "max_input_tokens": 256000, + "input_cost_per_token": 5e-07, + "output_cost_per_token": 3e-06, + "cache_read_input_token_cost": 1e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "input_cost_per_token": 3.2e-07, - "output_cost_per_token": 3.2e-06, - "cache_read_input_token_cost": 0, - "max_input_tokens": 262144, - "max_output_tokens": 262144, "supports_function_calling": true, "supports_tool_choice": true, "supports_response_schema": true, - "supports_prompt_caching": true, - "supports_system_messages": true, "supports_reasoning": true, - "source": "https://serverless.tensormesh.ai/v1/models/openrouter" + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "tensormesh/lukealonso/GLM-5.1-NVFP4-MTP": { - "litellm_provider": "tensormesh", - "mode": "chat", - "input_cost_per_token": 1.4e-06, - "output_cost_per_token": 4.4e-06, - "cache_read_input_token_cost": 0, + "deepinfra/zai-org/GLM-5": { + "max_tokens": 202752, "max_input_tokens": 202752, - "max_output_tokens": 202752, + "input_cost_per_token": 6e-07, + "output_cost_per_token": 2.08e-06, + "cache_read_input_token_cost": 1.2e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", + "mode": "chat", "supports_function_calling": true, "supports_tool_choice": true, "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/nvidia/Nemotron-3-Nano-30B-A3B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 5e-08, + "output_cost_per_token": 2e-07, + "cache_read_input_token_cost": 2.5e-08, "supports_prompt_caching": true, - "supports_system_messages": true, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, "supports_reasoning": true, - "source": "https://serverless.tensormesh.ai/v1/models/openrouter" + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "tensormesh/deepseek-ai/DeepSeek-V4-Flash": { - "litellm_provider": "tensormesh", + "deepinfra/moonshotai/Kimi-K2.7-Code": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 6.8e-07, + "output_cost_per_token": 3.4e-06, + "cache_read_input_token_cost": 1.36e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "input_cost_per_token": 1.4e-07, - "output_cost_per_token": 2.8e-07, - "cache_read_input_token_cost": 0, - "max_input_tokens": 32768, - "max_output_tokens": 32768, "supports_function_calling": true, "supports_tool_choice": true, "supports_response_schema": true, - "supports_prompt_caching": true, - "supports_system_messages": true, "supports_reasoning": true, - "source": "https://serverless.tensormesh.ai/v1/models/openrouter" + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "tensormesh/moonshotai/Kimi-K2.6": { - "litellm_provider": "tensormesh", + "deepinfra/anthropic/claude-sonnet-5": { + "input_cost_per_token": 2e-06, + "litellm_provider": "deepinfra", + "max_input_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", - "input_cost_per_token": 9.6e-07, - "output_cost_per_token": 4e-06, - "cache_read_input_token_cost": 0, - "max_input_tokens": 32768, - "max_output_tokens": 32768, + "output_cost_per_token": 1e-05, + "prompt_cache_min_tokens": 1024, + "source": "https://deepinfra.com/pricing", + "supports_adaptive_thinking": true, "supports_function_calling": true, - "supports_tool_choice": true, + "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true + }, + "deepinfra/Qwen/Qwen3.5-397B-A17B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 4.5e-07, + "output_cost_per_token": 3e-06, + "cache_read_input_token_cost": 2.2e-07, "supports_prompt_caching": true, - "supports_system_messages": true, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_response_schema": true, "supports_reasoning": true, - "source": "https://serverless.tensormesh.ai/v1/models/openrouter" + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "tensormesh/MiniMaxAI/MiniMax-M2.5": { - "litellm_provider": "tensormesh", + "deepinfra/deepseek-ai/DeepSeek-V4-Flash-0731": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "input_cost_per_token": 8e-08, + "output_cost_per_token": 1.8e-07, + "cache_read_input_token_cost": 1.6e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, - "cache_read_input_token_cost": 0, - "max_input_tokens": 196608, - "max_output_tokens": 196608, "supports_function_calling": true, "supports_tool_choice": true, "supports_response_schema": true, - "supports_prompt_caching": true, - "supports_system_messages": true, "supports_reasoning": true, - "source": "https://serverless.tensormesh.ai/v1/models/openrouter" + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "tensormesh/google/gemma-4-31B-it": { - "litellm_provider": "tensormesh", + "deepinfra/google/gemma-4-E4B-it": { + "max_tokens": 131072, + "max_input_tokens": 131072, + "input_cost_per_token": 2e-08, + "output_cost_per_token": 1e-07, + "litellm_provider": "deepinfra", "mode": "chat", - "input_cost_per_token": 1.4e-07, - "output_cost_per_token": 5.6e-07, - "cache_read_input_token_cost": 0, - "max_input_tokens": 32768, - "max_output_tokens": 32768, "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, - "supports_prompt_caching": true, - "supports_system_messages": true, "supports_reasoning": true, - "source": "https://serverless.tensormesh.ai/v1/models/openrouter" + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "tensormesh/openai/gpt-oss-120b": { - "litellm_provider": "tensormesh", + "deepinfra/deepseek-ai/DeepSeek-V3.2": { + "max_tokens": 163840, + "max_input_tokens": 163840, + "input_cost_per_token": 2.6e-07, + "output_cost_per_token": 3.8e-07, + "cache_read_input_token_cost": 1.3e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "cache_read_input_token_cost": 0, - "max_input_tokens": 131072, - "max_output_tokens": 131072, "supports_function_calling": true, "supports_tool_choice": true, "supports_response_schema": true, - "supports_prompt_caching": true, - "supports_system_messages": true, - "supports_reasoning": true, - "source": "https://serverless.tensormesh.ai/v1/models/openrouter" + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "tensormesh/openai/gpt-oss-20b": { - "litellm_provider": "tensormesh", + "deepinfra/Qwen/Qwen3.8-Max": { + "max_tokens": 256000, + "max_input_tokens": 256000, + "input_cost_per_token": 1.65e-06, + "output_cost_per_token": 4.951e-06, + "cache_read_input_token_cost": 2.06e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "input_cost_per_token": 7e-08, - "output_cost_per_token": 2.8e-07, - "cache_read_input_token_cost": 0, - "max_input_tokens": 131072, - "max_output_tokens": 131072, "supports_function_calling": true, "supports_tool_choice": true, "supports_response_schema": true, - "supports_prompt_caching": true, - "supports_system_messages": true, - "supports_reasoning": true, - "source": "https://serverless.tensormesh.ai/v1/models/openrouter" + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "deepseek-flash": { - "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 6e-09, - "input_cost_per_token": 3e-07, - "input_cost_per_token_cache_hit": 6e-09, - "litellm_provider": "deepseek", + "deepinfra/anthropic/claude-fable-5": { + "input_cost_per_token": 1e-05, + "litellm_provider": "deepinfra", "max_input_tokens": 1000000, - "max_output_tokens": 393216, - "max_tokens": 393216, + "max_tokens": 1000000, "mode": "chat", - "off_peak_pricing": { - "cache_read_input_token_cost": 3e-09, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "windows": [ - { - "hours_utc": [ - "00:00-01:00", - "04:00-06:00", - "10:00-00:00" - ], - "weekdays": [ - 1, - 2, - 3, - 4, - 5 - ] - }, - { - "hours_utc": "00:00-00:00", - "weekdays": [ - 6, - 7 - ] - } - ] - }, - "output_cost_per_token": 1.2e-06, - "source": "https://api-docs.deepseek.com/quick_start/pricing", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_assistant_prefill": true, + "output_cost_per_token": 5e-05, + "prompt_cache_min_tokens": 512, + "source": "https://deepinfra.com/pricing", + "supports_adaptive_thinking": true, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, + "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "thinking_always_on": true }, - "deepseek-v4-flash": { - "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 6e-09, - "input_cost_per_token": 3e-07, - "input_cost_per_token_cache_hit": 6e-09, - "litellm_provider": "deepseek", - "max_input_tokens": 1000000, - "max_output_tokens": 393216, - "max_tokens": 393216, + "deepinfra/nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 5e-07, + "output_cost_per_token": 2.2e-06, + "cache_read_input_token_cost": 1e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "off_peak_pricing": { - "cache_read_input_token_cost": 3e-09, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "windows": [ - { - "hours_utc": [ - "00:00-01:00", - "04:00-06:00", - "10:00-00:00" - ], - "weekdays": [ - 1, - 2, - 3, - 4, - 5 - ] - }, - { - "hours_utc": "00:00-00:00", - "weekdays": [ - 6, - 7 - ] - } - ] - }, - "output_cost_per_token": 1.2e-06, - "source": "https://api-docs.deepseek.com/quick_start/pricing", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "deepseek-v4-flash-vision-exp": { - "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 6e-09, - "input_cost_per_token": 3e-07, - "input_cost_per_token_cache_hit": 6e-09, - "litellm_provider": "deepseek", - "max_input_tokens": 1000000, - "max_output_tokens": 393216, - "max_tokens": 393216, + "deepinfra/Qwen/Qwen3.5-122B-A10B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 2.9e-07, + "output_cost_per_token": 2.4e-06, + "litellm_provider": "deepinfra", "mode": "chat", - "off_peak_pricing": { - "cache_read_input_token_cost": 3e-09, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "windows": [ - { - "hours_utc": [ - "00:00-01:00", - "04:00-06:00", - "10:00-00:00" - ], - "weekdays": [ - 1, - 2, - 3, - 4, - 5 - ] - }, - { - "hours_utc": "00:00-00:00", - "weekdays": [ - 6, - 7 - ] - } - ] - }, - "output_cost_per_token": 1.2e-06, - "source": "https://api-docs.deepseek.com/quick_start/pricing", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "deepseek-v4-pro": { - "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 4.4e-08, - "input_cost_per_token": 1.32e-06, - "input_cost_per_token_cache_hit": 4.4e-08, - "litellm_provider": "deepseek", - "max_input_tokens": 1000000, - "max_output_tokens": 393216, - "max_tokens": 393216, + "deepinfra/zai-org/GLM-5.1": { + "max_tokens": 202752, + "max_input_tokens": 202752, + "input_cost_per_token": 1.05e-06, + "output_cost_per_token": 3.5e-06, + "cache_read_input_token_cost": 2.05e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "off_peak_pricing": { - "cache_read_input_token_cost": 2.2e-08, - "input_cost_per_token": 6.6e-07, - "output_cost_per_token": 1.98e-06, - "windows": [ - { - "hours_utc": [ - "00:00-01:00", - "04:00-06:00", - "10:00-00:00" - ], - "weekdays": [ - 1, - 2, - 3, - 4, - 5 - ] - }, - { - "hours_utc": "00:00-00:00", - "weekdays": [ - 6, - 7 - ] - } - ] - }, - "output_cost_per_token": 3.96e-06, - "source": "https://api-docs.deepseek.com/quick_start/pricing", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": false + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "deepseek/deepseek-flash": { - "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 6e-09, - "input_cost_per_token": 3e-07, - "input_cost_per_token_cache_hit": 6e-09, - "litellm_provider": "deepseek", - "max_input_tokens": 1000000, - "max_output_tokens": 393216, - "max_tokens": 393216, + "deepinfra/deepseek-ai/DeepSeek-V4-Pro": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "input_cost_per_token": 1.3e-06, + "output_cost_per_token": 2.6e-06, + "cache_read_input_token_cost": 1e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", - "off_peak_pricing": { - "cache_read_input_token_cost": 3e-09, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "windows": [ - { - "hours_utc": [ - "00:00-01:00", - "04:00-06:00", - "10:00-00:00" - ], - "weekdays": [ - 1, - 2, - 3, - 4, - 5 - ] - }, - { - "hours_utc": "00:00-00:00", - "weekdays": [ - 6, - 7 - ] - } - ] - }, - "output_cost_per_token": 1.2e-06, - "source": "https://api-docs.deepseek.com/quick_start/pricing", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "deepseek/deepseek-v4-flash": { - "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 6e-09, - "input_cost_per_token": 3e-07, - "input_cost_per_token_cache_hit": 6e-09, - "litellm_provider": "deepseek", - "max_input_tokens": 1000000, - "max_output_tokens": 393216, - "max_tokens": 393216, + "deepinfra/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 8.5e-08, + "output_cost_per_token": 4e-07, + "litellm_provider": "deepinfra", "mode": "chat", - "off_peak_pricing": { - "cache_read_input_token_cost": 3e-09, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "windows": [ - { - "hours_utc": [ - "00:00-01:00", - "04:00-06:00", - "10:00-00:00" - ], - "weekdays": [ - 1, - 2, - 3, - 4, - 5 - ] - }, - { - "hours_utc": "00:00-00:00", - "weekdays": [ - 6, - 7 - ] - } - ] - }, - "output_cost_per_token": 1.2e-06, - "source": "https://api-docs.deepseek.com/quick_start/pricing", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, + "supports_tool_choice": true, + "supports_response_schema": true, "supports_reasoning": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/zai-org/GLM-5.2": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "input_cost_per_token": 7.5e-07, + "output_cost_per_token": 2.4e-06, + "cache_read_input_token_cost": 1.4e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, "supports_response_schema": true, - "supports_system_messages": true, + "supports_reasoning": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/moonshotai/Kimi-K3": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "input_cost_per_token": 2.85e-06, + "output_cost_per_token": 1.425e-05, + "cache_read_input_token_cost": 2.85e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "deepseek/deepseek-v4-flash-vision-exp": { - "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 6e-09, - "input_cost_per_token": 3e-07, - "input_cost_per_token_cache_hit": 6e-09, - "litellm_provider": "deepseek", + "deepinfra/anthropic/claude-opus-4-7": { + "input_cost_per_token": 5e-06, + "litellm_provider": "deepinfra", "max_input_tokens": 1000000, - "max_output_tokens": 393216, - "max_tokens": 393216, - "mode": "chat", - "off_peak_pricing": { - "cache_read_input_token_cost": 3e-09, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "windows": [ - { - "hours_utc": [ - "00:00-01:00", - "04:00-06:00", - "10:00-00:00" - ], - "weekdays": [ - 1, - 2, - 3, - 4, - 5 - ] - }, - { - "hours_utc": "00:00-00:00", - "weekdays": [ - 6, - 7 - ] - } - ] - }, - "output_cost_per_token": 1.2e-06, - "source": "https://api-docs.deepseek.com/quick_start/pricing", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_assistant_prefill": true, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-05, + "prompt_cache_min_tokens": 2048, + "source": "https://deepinfra.com/pricing", + "supports_adaptive_thinking": true, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true }, - "deepseek/deepseek-v4-pro": { - "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 4.4e-08, - "input_cost_per_token": 1.32e-06, - "input_cost_per_token_cache_hit": 4.4e-08, - "litellm_provider": "deepseek", - "max_input_tokens": 1000000, - "max_output_tokens": 393216, - "max_tokens": 393216, + "deepinfra/Qwen/Qwen3.6-27B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 3.2e-07, + "output_cost_per_token": 3.2e-06, + "litellm_provider": "deepinfra", "mode": "chat", - "off_peak_pricing": { - "cache_read_input_token_cost": 2.2e-08, - "input_cost_per_token": 6.6e-07, - "output_cost_per_token": 1.98e-06, - "windows": [ - { - "hours_utc": [ - "00:00-01:00", - "04:00-06:00", - "10:00-00:00" - ], - "weekdays": [ - 1, - 2, - 3, - 4, - 5 - ] - }, - { - "hours_utc": "00:00-00:00", - "weekdays": [ - 6, - 7 - ] - } - ] - }, - "output_cost_per_token": 3.96e-06, - "source": "https://api-docs.deepseek.com/quick_start/pricing", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_tool_choice": true, "supports_response_schema": true, - "supports_system_messages": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/google/gemma-4-26B-A4B-it": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 7e-08, + "output_cost_per_token": 3.4e-07, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, "supports_tool_choice": true, - "supports_vision": false + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "tencent/deepseek-v4-pro": { - "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 3.625e-09, - "input_cost_per_token": 4.35e-07, - "input_cost_per_token_cache_hit": 3.625e-09, - "litellm_provider": "tencent", + "deepinfra/google/gemini-3.1-pro": { + "max_tokens": 1000000, "max_input_tokens": 1000000, - "max_output_tokens": 384000, - "max_tokens": 384000, + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1.2e-05, + "litellm_provider": "deepinfra", "mode": "chat", - "output_cost_per_token": 8.7e-07, - "source": "https://www.tencentcloud.com/products/tokenhub", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, - "supports_prompt_caching": true, + "supports_tool_choice": true, "supports_response_schema": true, - "supports_system_messages": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing", + "supports_audio_input": true + }, + "deepinfra/XiaomiMiMo/MiMo-V2.5-Pro": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "input_cost_per_token": 1e-06, + "output_cost_per_token": 3e-06, + "cache_read_input_token_cost": 2e-07, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, "supports_tool_choice": true, + "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": false + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "tencent/deepseek-v4-flash": { - "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 2.8e-09, - "input_cost_per_token": 1.4e-07, - "input_cost_per_token_cache_hit": 2.8e-09, - "litellm_provider": "tencent", - "max_input_tokens": 1000000, - "max_output_tokens": 384000, - "max_tokens": 384000, + "deepinfra/anthropic/claude-haiku-4-5": { + "max_tokens": 200000, + "max_input_tokens": 200000, + "input_cost_per_token": 1e-06, + "output_cost_per_token": 5e-06, + "litellm_provider": "deepinfra", "mode": "chat", - "output_cost_per_token": 2.8e-07, - "source": "https://www.tencentcloud.com/products/tokenhub", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_assistant_prefill": true, + "prompt_cache_min_tokens": 4096, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_parallel_function_calling": true, + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/deepseek-ai/DeepSeek-V4-Flash": { + "max_tokens": 1048576, + "max_input_tokens": 1048576, + "input_cost_per_token": 9e-08, + "output_cost_per_token": 1.8e-07, + "cache_read_input_token_cost": 1.8e-08, "supports_prompt_caching": true, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, "supports_response_schema": true, - "supports_system_messages": true, + "supports_reasoning": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/openai/gpt-oss-120b-Ultra": { + "max_tokens": 131072, + "max_input_tokens": 131072, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 9.5e-07, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, "supports_tool_choice": true, + "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": false + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "tencent/minimax-m3": { - "cache_creation_input_token_cost": 0.0, - "cache_read_input_token_cost": 6e-08, - "input_cost_per_token": 3e-07, - "input_cost_per_token_cache_hit": 6e-08, - "litellm_provider": "tencent", - "max_input_tokens": 1000000, + "deepinfra/Qwen/Qwen3.5-9B": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 1.5e-07, + "litellm_provider": "deepinfra", "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://www.tencentcloud.com/products/tokenhub", - "supported_endpoints": [ - "/v1/chat/completions" - ], - "supports_adaptive_thinking": true, "supports_function_calling": true, - "supports_native_streaming": true, + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" + }, + "deepinfra/MiniMaxAI/MiniMax-M2.7-Turbo": { + "max_tokens": 196608, + "max_input_tokens": 196608, + "input_cost_per_token": 3.8e-07, + "output_cost_per_token": 1.7e-06, + "cache_read_input_token_cost": 7e-08, "supports_prompt_caching": true, + "litellm_provider": "deepinfra", + "mode": "chat", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": false + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "cognition/swe-1.6": { - "input_cost_per_token": 5e-07, - "output_cost_per_token": 2.5e-06, - "cache_read_input_token_cost": 2e-07, - "litellm_provider": "cognition", + "deepinfra/zai-org/GLM-4.7": { + "max_tokens": 202752, + "max_input_tokens": 202752, + "input_cost_per_token": 4e-07, + "output_cost_per_token": 1.75e-06, + "cache_read_input_token_cost": 8e-08, + "supports_prompt_caching": true, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_prompt_caching": true, - "source": "https://docs.devin.ai/windsurf/plugins/cascade/models" + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": false, + "source": "https://deepinfra.com/pricing" }, - "cognition/swe-1.7": { - "input_cost_per_token": 5e-07, - "output_cost_per_token": 2.5e-06, - "cache_read_input_token_cost": 2e-07, - "litellm_provider": "cognition", + "deepinfra/google/gemma-4-31B-it": { + "max_tokens": 262144, + "max_input_tokens": 262144, + "input_cost_per_token": 1.3e-07, + "output_cost_per_token": 3.8e-07, + "litellm_provider": "deepinfra", "mode": "chat", "supports_function_calling": true, - "supports_prompt_caching": true, - "source": "https://docs.devin.ai/desktop/models" + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_reasoning": true, + "supports_vision": true, + "source": "https://deepinfra.com/pricing" }, - "cognition/swe-1.7-lightning": { - "input_cost_per_token": 2.5e-06, - "output_cost_per_token": 1.25e-05, - "cache_read_input_token_cost": 1e-06, - "litellm_provider": "cognition", + "gemini/gemini-omni-1.1-flash": { + "input_cost_per_audio_token": 1.5e-06, + "input_cost_per_token": 1.5e-06, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_reasoning_token": 9e-06, + "output_cost_per_token": 9e-06, + "output_cost_per_video_token": 1.75e-05, + "rpm": 2000, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_endpoints": [ + "/v1beta/interactions" + ], + "supported_modalities": [ + "text", + "image", + "audio", + "video" + ], + "supported_output_modalities": [ + "text", + "video" + ], + "supports_audio_input": true, + "supports_reasoning": true, + "supports_system_messages": true, + "supports_video_input": true, + "supports_vision": true, + "tpm": 800000 + }, + "xai/grok-4.20": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", + "output_cost_per_token": 2.5e-06, + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "input_cost_per_image_token": 1.25e-06, "supports_prompt_caching": true, - "source": "https://docs.devin.ai/desktop/models" + "supports_response_schema": true }, - "pinstripes/ps/glm-4.5-air": { - "max_tokens": 128000, - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "input_cost_per_token": 1.25e-07, - "output_cost_per_token": 4.5e-07, - "litellm_provider": "pinstripes", + "xai/grok-4.20-reasoning": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", + "output_cost_per_token": 2.5e-06, + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_assistant_prefill": true, "supports_reasoning": true, - "source": "https://pinstripes.io/" + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true }, - "pinstripes/ps/qwen3.6-35b-a3b": { - "max_tokens": 131072, - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "input_cost_per_token": 1.4e-07, - "output_cost_per_token": 4.5e-07, - "litellm_provider": "pinstripes", + "xai/grok-4.20-reasoning-latest": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", + "output_cost_per_token": 2.5e-06, + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_assistant_prefill": true, "supports_reasoning": true, - "source": "https://pinstripes.io/" + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true + }, + "xai/grok-imagine-image": { + "input_cost_per_image": 0.02, + "litellm_provider": "xai", + "mode": "image_generation", + "source": "https://docs.x.ai/docs/models", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "image" + ] + }, + "xai/grok-imagine-image-2026-03-02": { + "input_cost_per_image": 0.02, + "litellm_provider": "xai", + "mode": "image_generation", + "source": "https://docs.x.ai/docs/models", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "image" + ] + }, + "xai/grok-imagine-image-quality": { + "deprecation_date": "2026-11-02", + "input_cost_per_image": 0.05, + "litellm_provider": "xai", + "mode": "image_generation", + "source": "https://docs.x.ai/docs/models", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "image" + ] + }, + "xai/grok-imagine-image-quality-20260403": { + "deprecation_date": "2026-11-02", + "input_cost_per_image": 0.05, + "litellm_provider": "xai", + "mode": "image_generation", + "source": "https://docs.x.ai/docs/models", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "image" + ] + }, + "xai/grok-imagine-image-quality-latest": { + "deprecation_date": "2026-11-02", + "input_cost_per_image": 0.05, + "litellm_provider": "xai", + "mode": "image_generation", + "source": "https://docs.x.ai/docs/models", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "image" + ] + }, + "xai/grok-imagine-image-pro": { + "input_cost_per_image": 0.05, + "litellm_provider": "xai", + "mode": "image_generation", + "source": "https://docs.x.ai/docs/models", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "image" + ] + }, + "xai/grok-imagine-image-2.0": { + "input_cost_per_image": 0.06, + "litellm_provider": "xai", + "mode": "image_generation", + "source": "https://docs.x.ai/docs/models", + "supported_endpoints": [ + "/v1/images/generations" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "image" + ] + }, + "xai/grok-imagine-video": { + "input_cost_per_image": 0.002, + "litellm_provider": "xai", + "mode": "video_generation", + "output_cost_per_second": 0.05, + "output_cost_per_second_480p": 0.05, + "output_cost_per_second_720p": 0.07, + "source": "https://docs.x.ai/docs/models/grok-imagine-video", + "supported_modalities": [ + "text", + "image", + "video" + ], + "supported_output_modalities": [ + "video" + ] + }, + "xai/grok-imagine-video-1.5": { + "input_cost_per_image": 0.01, + "litellm_provider": "xai", + "mode": "video_generation", + "output_cost_per_second": 0.08, + "output_cost_per_second_1080p": 0.25, + "output_cost_per_second_480p": 0.08, + "output_cost_per_second_720p": 0.14, + "source": "https://docs.x.ai/docs/models/grok-imagine-video-1.5", + "supported_modalities": [ + "text", + "image", + "audio" + ], + "supported_output_modalities": [ + "video" + ] }, - "pinstripes/ps/qwen3-30b-a3b": { - "max_tokens": 131072, - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "input_cost_per_token": 9e-08, - "output_cost_per_token": 2e-07, - "litellm_provider": "pinstripes", - "mode": "chat", - "supports_function_calling": true, - "supports_assistant_prefill": true, - "supports_reasoning": true, - "source": "https://pinstripes.io/" + "xai/grok-imagine-video-1.5-2026-05-30": { + "input_cost_per_image": 0.01, + "litellm_provider": "xai", + "mode": "video_generation", + "output_cost_per_second": 0.08, + "output_cost_per_second_1080p": 0.25, + "output_cost_per_second_480p": 0.08, + "output_cost_per_second_720p": 0.14, + "source": "https://docs.x.ai/docs/models/grok-imagine-video-1.5", + "supported_modalities": [ + "text", + "image", + "audio" + ], + "supported_output_modalities": [ + "video" + ] }, - "pinstripes/ps/qwen3-coder-30b-a3b": { - "max_tokens": 131072, - "max_input_tokens": 131072, - "max_output_tokens": 131072, - "input_cost_per_token": 3e-07, - "output_cost_per_token": 6e-07, - "litellm_provider": "pinstripes", - "mode": "chat", - "supports_function_calling": true, - "supports_assistant_prefill": true, - "supports_reasoning": false, - "source": "https://pinstripes.io/" + "xai/grok-imagine-video-1.5-preview": { + "input_cost_per_image": 0.01, + "litellm_provider": "xai", + "mode": "video_generation", + "output_cost_per_second": 0.08, + "output_cost_per_second_1080p": 0.25, + "output_cost_per_second_480p": 0.08, + "output_cost_per_second_720p": 0.14, + "source": "https://docs.x.ai/docs/models/grok-imagine-video-1.5", + "supported_modalities": [ + "text", + "image", + "audio" + ], + "supported_output_modalities": [ + "video" + ] }, - "pinstripes/ps/deepseek-v4-flash": { - "max_tokens": 163840, - "max_input_tokens": 163840, - "max_output_tokens": 163840, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "pinstripes", - "mode": "chat", - "supports_function_calling": true, - "supports_assistant_prefill": true, - "supports_reasoning": true, - "source": "https://pinstripes.io/" + "xai/grok-voice-transcribe-1.0": { + "input_cost_per_second": 2.778e-05, + "litellm_provider": "xai", + "metadata": { + "calculation": "$0.10/3600 seconds = $0.00002778 per second", + "original_pricing_per_hour": 0.1 + }, + "mode": "audio_transcription", + "output_cost_per_second": 0.0, + "source": "https://docs.x.ai/developers/pricing", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ] }, - "pinstripes/ps/minimax-m2.7": { - "max_tokens": 1000192, - "max_input_tokens": 1000192, - "max_output_tokens": 1000192, - "input_cost_per_token": 2.55e-07, - "output_cost_per_token": 5.5e-07, - "litellm_provider": "pinstripes", - "mode": "chat", - "supports_function_calling": true, - "supports_assistant_prefill": true, - "supports_reasoning": false, - "source": "https://pinstripes.io/" + "xai/grok-voice-transcribe-2.0": { + "input_cost_per_second": 2.778e-05, + "litellm_provider": "xai", + "metadata": { + "calculation": "$0.10/3600 seconds = $0.00002778 per second", + "original_pricing_per_hour": 0.1 + }, + "mode": "audio_transcription", + "output_cost_per_second": 0.0, + "source": "https://docs.x.ai/developers/pricing", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ] }, - "darkbloom/gemma-4-26b": { - "input_cost_per_token": 3e-08, - "litellm_provider": "darkbloom", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 1.65e-07, - "source": "https://www.darkbloom.dev/", + "low/1024-x-1024/grok-imagine-image-2.0": { + "input_cost_per_image": 0.04, + "litellm_provider": "xai", + "mode": "image_generation", + "source": "https://docs.x.ai/docs/models", "supported_endpoints": [ - "/v1/chat/completions" + "/v1/images/generations" ], - "supports_function_calling": true, - "supports_native_streaming": true, - "supports_system_messages": true, - "supports_tool_choice": true + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "image" + ] }, - "darkbloom/gpt-oss-20b": { - "input_cost_per_token": 1.45e-08, - "litellm_provider": "darkbloom", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "xai/grok-4.20-non-reasoning": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 7e-08, - "source": "https://www.darkbloom.dev/", - "supported_endpoints": [ - "/v1/chat/completions" - ], + "output_cost_per_token": 2.5e-06, + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_native_streaming": true, - "supports_system_messages": true, - "supports_tool_choice": true + "supports_prompt_caching": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true }, - "xai/grok-4.20-0309-non-reasoning": { + "xai/grok-4.20-non-reasoning-latest": { "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, "input_cost_per_token": 1.25e-06, + "input_cost_per_token_batches": 1e-06, "litellm_provider": "xai", "max_input_tokens": 1000000, "max_output_tokens": 1000000, "max_tokens": 1000000, "mode": "chat", "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, "supports_prompt_caching": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true, "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "input_cost_per_image_token": 1.25e-06, "supports_response_schema": true }, - "xai/grok-4.20-multi-agent-0309": { + "xai/grok-4.20-multi-agent": { "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, "input_cost_per_token": 1.25e-06, + "input_cost_per_token_batches": 1e-06, "litellm_provider": "xai", "max_input_tokens": 1000000, "max_output_tokens": 1000000, "max_tokens": 1000000, "mode": "responses", "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", + "supported_endpoints": [ + "/v1/responses" + ], "supports_function_calling": false, "supports_prompt_caching": true, "supports_reasoning": true, @@ -60491,253 +64127,124 @@ "supports_vision": true, "supports_web_search": true, "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true, - "supported_endpoints": [ - "/v1/responses" - ] + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true }, - "xai/grok-build-0.1": { + "xai/grok-4.20-multi-agent-latest": { "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1e-06, + "cache_read_input_token_cost_batches": 1.6e-07, + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_batches": 1e-06, "litellm_provider": "xai", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://docs.x.ai/docs/models", - "supports_function_calling": true, + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "responses", + "output_cost_per_token": 2.5e-06, + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", + "supported_endpoints": [ + "/v1/responses" + ], + "supports_function_calling": false, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_tool_choice": true, - "input_cost_per_token_above_200k_tokens": 2e-06, - "output_cost_per_token_above_200k_tokens": 4e-06, + "supports_tool_choice": false, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true, - "supports_vision": true - }, - "gpt-transcribe": { - "input_cost_per_second": 7.5e-05, - "litellm_provider": "openai", - "mode": "audio_transcription", - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/audio/transcriptions", - "/v1/realtime/transcription_sessions" - ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true - }, - "gpt-live-transcribe": { - "input_cost_per_second": 0.000283333333333, - "litellm_provider": "openai", - "mode": "audio_transcription", - "source": "https://developers.openai.com/api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime", - "/v1/realtime/transcription_sessions" - ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true - }, - "gpt-live-1": { - "input_cost_per_second": 0.000833333333333, - "litellm_provider": "openai", - "mode": "realtime", - "source": "https://developers.openai.com/api/docs/pricing", - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true, - "supports_function_calling": true - }, - "gpt-realtime-translate": { - "input_cost_per_second": 0.000566666666667, - "litellm_provider": "openai", - "max_input_tokens": 16000, - "max_output_tokens": 2000, - "max_tokens": 2000, - "mode": "realtime", - "source": "https://developers.openai.com/api/docs/pricing", - "supported_modalities": [ - "audio" - ], - "supported_output_modalities": [ - "text", - "audio" - ], - "supports_audio_input": true, - "supports_audio_output": true + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true }, - "claude-mythos-5": { - "cache_creation_input_token_cost": 1.25e-05, - "cache_creation_input_token_cost_above_1hr": 2e-05, - "cache_read_input_token_cost": 1e-06, - "input_cost_per_token": 1e-05, - "litellm_provider": "anthropic", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "groq/qwen/qwen3.8-27b": { + "input_cost_per_token": 8e-07, + "litellm_provider": "groq", + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 5e-05, - "prompt_cache_min_tokens": 512, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "source": "https://platform.claude.com/docs/en/about-claude/pricing", - "supports_adaptive_thinking": true, - "thinking_always_on": true, - "supports_mid_conversation_system": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, + "output_cost_per_token": 4e-06, + "source": "https://console.groq.com/docs/model/qwen/qwen3.8-27b", "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_output_config": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, - "provider_specific_entry": { - "us": 1.1 - } + "supports_vision": true }, - "claude-mythos-5-1": { - "cache_creation_input_token_cost": 1.25e-05, - "cache_creation_input_token_cost_above_1hr": 2e-05, - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 1e-05, - "litellm_provider": "anthropic", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "mistral/mistral-medium-3.5": { + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 1.5e-06, + "litellm_provider": "mistral", + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 5e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "supports_adaptive_thinking": true, - "thinking_always_on": true, - "supports_mid_conversation_system": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, - "supports_forced_tool_use": false, + "output_cost_per_token": 7.5e-06, + "reasoning_effort_levels": [ + "none", + "high" + ], + "source": "https://docs.mistral.ai/models/model-cards/mistral-medium-3-5-26-04", + "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_max_reasoning_effort": true, - "provider_specific_entry": { - "us": 1.1 - }, - "supports_output_config": true, - "prompt_cache_min_tokens": 512, - "supports_native_structured_output": true, - "source": "https://platform.claude.com/docs/en/about-claude/pricing" + "supports_vision": true }, - "claude-mythos-preview": { - "cache_creation_input_token_cost": 1.25e-05, - "cache_creation_input_token_cost_above_1hr": 2e-05, - "cache_read_input_token_cost": 1e-06, - "input_cost_per_token": 1e-05, - "litellm_provider": "anthropic", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "mistral/mistral-vibe-cli-latest": { + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 1.5e-06, + "litellm_provider": "mistral", + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 5e-05, - "prompt_cache_min_tokens": 512, - "search_context_cost_per_query": { - "search_context_size_high": 0.01, - "search_context_size_low": 0.01, - "search_context_size_medium": 0.01 - }, - "source": "https://platform.claude.com/docs/en/about-claude/models/overview", - "supports_adaptive_thinking": true, - "thinking_always_on": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, + "output_cost_per_token": 7.5e-06, + "reasoning_effort_levels": [ + "none", + "high" + ], + "source": "https://docs.mistral.ai/models/model-cards/mistral-medium-3-5-26-04", + "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_output_config": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": true, - "provider_specific_entry": { - "us": 1.1 - } + "supports_vision": true }, - "gemini/gemini-robotics-er-2-streaming-preview": { - "input_cost_per_audio_token": 2e-06, - "input_cost_per_token": 2e-06, - "litellm_provider": "gemini", + "mistral/mistral-vibe-cli-with-tools": { + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 1.5e-06, + "litellm_provider": "mistral", + "max_input_tokens": 262144, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 1e-05, - "search_context_cost_per_query": { - "search_context_size_high": 0.014, - "search_context_size_low": 0.014, - "search_context_size_medium": 0.014 - }, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text" + "output_cost_per_token": 7.5e-06, + "reasoning_effort_levels": [ + "none", + "high" ], - "supports_audio_input": true, + "source": "https://docs.mistral.ai/models/model-cards/mistral-medium-3-5-26-04", + "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_video_input": true, - "supports_vision": true, - "supports_web_search": true, - "web_search_billing_unit": "per_query" + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "mistral/mistral-small-2603": { + "mistral/mistral-vibe-cli-fast": { "cache_read_input_token_cost": 1.5e-08, "input_cost_per_token": 1.5e-07, "litellm_provider": "mistral", @@ -60753,283 +64260,120 @@ "source": "https://docs.mistral.ai/models/model-cards/mistral-small-4-0-26-03", "supports_assistant_prefill": true, "supports_function_calling": true, - "supports_reasoning": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true + }, + "mistral/mistral-code-latest": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 3e-07, + "litellm_provider": "mistral", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 9e-07, + "source": "https://docs.mistral.ai/models/model-cards/codestral-25-08", + "supports_assistant_prefill": true, + "supports_function_calling": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "mistral/mistral-code-fim-latest": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 3e-07, + "litellm_provider": "mistral", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 9e-07, + "source": "https://docs.mistral.ai/models/model-cards/codestral-25-08", + "supports_assistant_prefill": true, + "supports_function_calling": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_tool_choice": true }, - "mistral/labs-leanstral-1-5": { - "input_cost_per_token": 0.0, + "mistral/mistral-code-agent-latest": { + "cache_read_input_token_cost": 4e-08, + "input_cost_per_token": 4e-07, "litellm_provider": "mistral", - "max_input_tokens": 262144, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, "mode": "chat", - "output_cost_per_token": 0.0, - "source": "https://docs.mistral.ai/models/model-cards/leanstral-1-5", + "output_cost_per_token": 2e-06, + "source": "https://mistral.ai/news/devstral-2-vibe-cli", + "supports_assistant_prefill": true, "supports_function_calling": true, "supports_response_schema": true, "supports_tool_choice": true }, - "mistral/mistral-moderation-2603": { - "input_cost_per_token": 0.0, - "litellm_provider": "mistral", - "max_input_tokens": 131072, - "mode": "moderation", - "output_cost_per_token": 0.0, - "source": "https://docs.mistral.ai/models/model-cards/mistral-moderation-26-03" - }, - "mistral/voxtral-mini-2602": { - "input_cost_per_second": 5e-05, + "mistral/mistral-ocr-3": { "litellm_provider": "mistral", - "mode": "audio_transcription", - "source": "https://docs.mistral.ai/models/model-cards/voxtral-mini-transcribe-26-02", + "ocr_cost_per_page": 0.002, + "ocr_cost_per_page_batches": 0.001, + "annotation_cost_per_page": 0.003, + "annotation_cost_per_page_batches": 0.0015, + "mode": "ocr", "supported_endpoints": [ - "/v1/audio/transcriptions" - ], - "supported_modalities": [ - "audio" - ], - "supported_output_modalities": [ - "text" + "/v1/ocr", + "/v1/batch" ], - "supports_audio_input": true + "source": "https://mistral.ai/pricing#api-pricing" }, - "mistral/voxtral-mini-transcribe-realtime-2602": { - "input_cost_per_second": 0.0001, + "mistral/mistral-ocr-3-0": { "litellm_provider": "mistral", - "mode": "audio_transcription", - "source": "https://docs.mistral.ai/models/model-cards/voxtral-mini-transcribe-realtime-26-02", + "ocr_cost_per_page": 0.002, + "ocr_cost_per_page_batches": 0.001, + "annotation_cost_per_page": 0.003, + "annotation_cost_per_page_batches": 0.0015, + "mode": "ocr", "supported_endpoints": [ - "/v1/audio/transcriptions" - ], - "supported_modalities": [ - "audio" - ], - "supported_output_modalities": [ - "text" + "/v1/ocr", + "/v1/batch" ], - "supports_audio_input": true + "source": "https://mistral.ai/pricing#api-pricing" }, - "mistral/voxtral-mini-tts-2603": { - "input_cost_per_character": 1.6e-05, + "mistral/mistral-ocr-4": { + "annotation_cost_per_page": 0.005, + "annotation_cost_per_page_batches": 0.0025, "litellm_provider": "mistral", - "mode": "audio_speech", - "source": "https://docs.mistral.ai/models/model-cards/voxtral-tts-26-03", + "mode": "ocr", + "ocr_cost_per_page": 0.004, + "ocr_cost_per_page_batches": 0.002, + "source": "https://docs.mistral.ai/models/model-cards/ocr-4-1", "supported_endpoints": [ - "/v1/audio/speech" - ], - "supported_modalities": [ - "text" - ], - "supported_output_modalities": [ - "audio" - ], - "supports_audio_output": true - }, - "fallback_generalizations": { - "rules": [ - { - "name": "bedrock-claude-ids", - "pattern": "^(?:[a-z-]+\\.)?anthropic\\.claude-", - "description": "A Bedrock-syntax Claude id, for every version: anthropic.claude- at the start of the name, optionally behind a single dotted geo segment (us./eu./au./jp./apac./global./us-gov.). Anchored to the start because routing rules see the raw request string and provider inference feeds the proxy's provider/* wildcard access checks: an id under an unrecognized namespace such as bedrockz/anthropic.claude-... must stay unroutable rather than resolve to bedrock and slip through a bedrock/* key. Routes to bedrock before the bare-id Anthropic rule is consulted.", - "model_info": { - "litellm_provider": "bedrock" - } - }, - { - "name": "anthropic-claude-ids", - "pattern": "^claude-[a-z]+-\\d+(?:[-.]\\d+)?(?:-\\d{8})?$", - "description": "A bare Claude family-major id with an optional minor and an optional 8-digit date suffix, anchored to the whole name, so claude-newfamily-5 routes like claude-newfamily-5-1 does. Routes an unmapped Claude id that carries no provider namespace to the Anthropic API.", - "model_info": { - "litellm_provider": "anthropic" - } - }, - { - "name": "claude-family-baseline", - "pattern": "claude-[a-z]+-\\d+(?:[-.]\\d+)?(?:-\\d{8})?", - "description": "Any Claude family-major id with an optional minor and an optional 8-digit date suffix, under any provider namespace (bare, bedrock-dotted, vertex, databricks, ...), so bare majors like claude-newfamily-5 get the same baseline as claude-newfamily-5-1. Carries the model-family facts every Claude shares; it carries no pricing, so cost stays on the standard unpriced behavior rather than a guessed number.", - "model_info": { - "mode": "chat", - "max_input_tokens": 200000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_vision": true, - "supports_tool_choice": true, - "supports_assistant_prefill": true, - "supports_prompt_caching": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_pdf_input": true, - "supports_system_messages": true - } - }, - { - "name": "claude-adaptive-thinking", - "pattern": "claude-[a-z]+-(?:4[-._](?:[6-9]|[1-9]\\d)(?!\\d)|[5-9](?!\\d)(?:[-._]\\d{1,2}(?!\\d))?)", - "fill_missing_for_providers": ["anthropic", "azure_ai", "bedrock", "bedrock_converse", "vertex_ai-anthropic_models"], - "description": "Claude at version 4.6 or higher, in any id shape that contains claude--: minors 4.6 through 4.99, any later major-minor, and bare 5+ majors so a new family shaped like claude-fable-5 matches. Requiring the claude- prefix keeps non-Claude names such as team-sonnet-5-1 out. The minor is capped at two digits so an 8-digit date suffix such as claude-opus-4-20250514 is never read as a >= 4.6 minor. Two-digit majors are deliberately not matched so ids like claude-opus-41 (4.1) are not read as major 41. Turns on adaptive thinking for new versions and new families with no code change.", - "model_info": { - "supports_adaptive_thinking": true - } - }, - { - "name": "claude-legacy-thinking", - "pattern": "claude-[a-z]+-4[-._]6(?!\\d)", - "fill_missing_for_providers": ["anthropic", "azure_ai", "bedrock", "bedrock_converse", "vertex_ai-anthropic_models"], - "description": "Claude at version 4.6 exactly, in any id shape that contains claude--4-6 (dotted and underscored minors included, dated releases such as claude-sonnet-4-6-20260219 too). The 4.6 family is adaptive-thinking yet still accepts legacy thinking.type=enabled with budget_tokens, so the caller's hard budget cap is forwarded verbatim instead of being rewritten to an uncapped output_config.effort. The lookahead keeps two-digit minors such as 4-60 from matching. 4.7+ and 5+ majors reject the legacy shape and stay on the adaptive translation.", - "model_info": { - "supports_legacy_thinking": true - } - }, - { - "name": "claude-always-on-thinking", - "pattern": "claude-(?:fable|mythos)-", - "description": "Any Claude Fable or Mythos id, under any provider namespace and any version. These families always think and reject thinking.type=disabled with a 400; the Anthropic transformations omit the param instead, so the model falls back to its default adaptive thinking.", - "model_info": { - "thinking_always_on": true - } - }, - { - "name": "claude-mid-conversation-system", - "pattern": "claude-[a-z]+-(?:4[-._](?:[89]|[1-9]\\d)(?!\\d)|[5-9](?!\\d)(?:[-._]\\d{1,2}(?!\\d))?)", - "fill_missing_for_providers": ["anthropic", "azure_ai", "bedrock", "bedrock_converse", "vertex_ai-anthropic_models"], - "description": "Claude at version 4.8 or higher, in any id shape that contains claude--: minors 4.8 through 4.99, any later major-minor, and bare 5+ majors so a new family like claude-fable-5 matches. Two-digit majors are deliberately not matched so ids like claude-opus-41 (4.1) are not read as major 41. Anthropic introduced mid-conversation system messages with Opus 4.8 and every newer Claude keeps them; 4.7 and below reject the system role inside messages.", - "model_info": { - "supports_mid_conversation_system": true - } - }, - { - "name": "claude-tool-search", - "pattern": "claude-[a-z]+-(?:4[-._](?:[5-9]|[1-9]\\d)(?!\\d)|[5-9](?!\\d)(?:[-._]\\d{1,2}(?!\\d))?)", - "fill_missing_for_providers": ["anthropic", "bedrock", "bedrock_converse", "vertex_ai-anthropic_models"], - "description": "Claude at version 4.5 or higher, in any id shape that contains claude--: minors 4.5 through 4.99, any later major-minor, and bare 5+ majors so a new family like claude-fable-5 matches. Two-digit majors are deliberately not matched so ids like claude-opus-41 (4.1) are not read as major 41. Anthropic's tool search docs list every Claude 4.5 and newer model as supported and Opus 4.1 and earlier as unsupported, so the flag follows the version instead of a per-model list. azure_ai is left out on purpose: Anthropic documents tool search as unavailable on Azure-hosted Foundry deployments, and the azure_ai/ key cannot tell those from Anthropic-hosted ones.", - "model_info": { - "supports_tool_search": true - } - }, - { - "name": "wandb-reasoning-baseline", - "pattern": "^wandb/", - "description": "Any Weights & Biases Inference model id, anchored to the wandb/ namespace so only that provider's ids match. W&B's serverless catalog is reasoning-first and grows faster than this registry names it, so an id the map has not described yet is treated as reasoning-capable and keeps the caller's reasoning_effort instead of dropping it or raising UnsupportedParamsError. Rules lose to exact entries, so a mapped non-reasoning model such as wandb/meta-llama/Llama-3.1-8B-Instruct is unaffected. Carries no mode and no pricing, so cost stays on the standard unpriced behavior and the deployment does not read as catalog-mapped to the router's reasoning-effort resolver.", - "model_info": { - "supports_reasoning": true - } - }, - { - "name": "openai-reasoning-family-baseline", - "pattern": "^(?!.*search-api)(?:[a-z0-9_.-]+/)*(?:ft:)?(?:o[1-9]\\d*(?![a-z0-9])|gpt-[5-9](?:\\.\\d+)?(?![0-9.])|(?:gpt-\\d+(?:\\.\\d+)?(?:-[a-z0-9]+)*-)?(?:codex|deep-research|chat-latest)(?![a-z0-9]))", - "fill_missing_for_providers": ["azure", "azure_ai", "openai"], - "description": "OpenAI reasoning families by id shape, under any provider namespace and with an optional ft: prefix: the o-series (o1, o3-pro, o4-mini), gpt-5 through gpt-9 majors including dotted minors and suffixed variants (gpt-5.5-cyber, gpt-6-astra), and the codex, deep-research and chat-latest lines when standalone or on a gpt base. gpt-5-search-api is excluded because it is a search-only surface. Every model here is a reasoning model, and the Responses API drops the caller's reasoning param for any mapped OpenAI model whose info lacks supports_reasoning, so an id the registry has not named yet keeps its reasoning settings instead of silently losing them. Rules lose to exact entries. Carries no mode and no pricing, so cost stays on the standard unpriced behavior.", - "model_info": { - "supports_reasoning": true - } - }, - { - "name": "gemini-chat-baseline", - "pattern": "gemini-(?!.*(?:-tts|-image|-live|-audio|-embedding|-computer-use|-robotics|-transcribe|-translate))(?:2[.-][5-9]|[3-9](?:[.-]\\d{1,2})?)-(?:pro|flash)(?:-lite)?(?![a-z])", - "description": "Any Gemini text-chat id at 2.5 or higher under any namespace, including bare ids, gemini/, vertex_ai/, openrouter/google/, deepinfra/google/, vercel_ai_gateway/google/, oci/google., and databricks-gemini--: gemini-[.minor]-(pro|flash)[-lite] with any trailing preview, date or variant tag. The capability flags were verified against each of those providers' own catalogs and docs. The lookahead excludes the tts, image, live, audio, embedding, computer-use, robotics, transcribe and translate lines, which are different modes with different capabilities. Provider-specific deviations, such as Perplexity's Agent API serving these as mode responses, are carried by their exact map entries, which always win over this rule. Carries no token limits or pricing, so those stay on the standard unmapped behavior rather than a guessed number. Source check 2026-09-15: all 45 first-party 2.5+ text-chat entries in this map carry every field below, and the OpenRouter (openrouter.ai/api/v1/models), Vercel AI Gateway (ai-gateway.vercel.sh/v1/models), DeepInfra (api.deepinfra.com/models/list), OCI and Databricks model docs list reasoning, tools and image input for the same models.", - "model_info": { - "mode": "chat", - "supports_reasoning": true, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_system_messages": true, - "supports_vision": true, - "supports_response_schema": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_web_search": true - } - } + "/v1/ocr", + "/v1/batch" ] }, - "gemini/gemini-3.5-live-translate-preview": { - "input_cost_per_audio_token": 3.5e-06, - "input_cost_per_token": 3.5e-06, - "litellm_provider": "gemini", - "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "realtime", - "output_cost_per_audio_token": 2.1e-05, - "output_cost_per_token": 2.1e-05, - "rpm": 10, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "audio" - ], - "supported_output_modalities": [ - "audio", - "text" - ], - "supports_audio_input": true, - "supports_audio_output": true, - "supports_function_calling": false, - "supports_response_schema": false, - "supports_web_search": false, - "tpm": 250000 - }, - "gemini/gemini-3.5-transcribe": { - "input_cost_per_audio_token": 2e-06, - "input_cost_per_token": 2e-06, - "litellm_provider": "gemini", + "mistral/voxtral-mini-latest": { + "input_cost_per_second": 5e-05, + "litellm_provider": "mistral", "mode": "audio_transcription", - "output_cost_per_token": 1.2e-05, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "source": "https://docs.mistral.ai/models/model-cards/voxtral-mini-transcribe-26-02", "supported_endpoints": [ "/v1/audio/transcriptions" ], - "supported_modalities": [ - "text", - "audio" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true, - "tpm": 800000, - "rpm": 2000, - "supports_function_calling": false - }, - "gemini/gemini-3.5-transcribe-live": { - "input_cost_per_audio_token": 3.5e-06, - "input_cost_per_token": 3.5e-06, - "litellm_provider": "gemini", - "mode": "audio_transcription", - "output_cost_per_token": 2.1e-05, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], "supported_modalities": [ "audio" ], "supported_output_modalities": [ "text" ], - "supports_audio_input": true, - "tpm": 250000, - "rpm": 10, - "supports_function_calling": false + "supports_audio_input": true }, - "vertex_ai/gemini-3.5-transcribe-preview": { - "input_cost_per_audio_token": 2e-06, - "input_cost_per_token": 2e-06, - "litellm_provider": "vertex_ai", + "mistral/voxtral-mini-realtime-2602": { + "input_cost_per_second": 0.0001, + "litellm_provider": "mistral", "mode": "audio_transcription", - "output_cost_per_token": 1.2e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "source": "https://docs.mistral.ai/models/model-cards/voxtral-mini-transcribe-realtime-26-02", "supported_endpoints": [ "/v1/audio/transcriptions" ], "supported_modalities": [ - "text", "audio" ], "supported_output_modalities": [ @@ -61037,15 +64381,13 @@ ], "supports_audio_input": true }, - "vertex_ai/gemini-3.5-transcribe-live-preview": { - "input_cost_per_audio_token": 3.5e-06, - "input_cost_per_token": 3.5e-06, - "litellm_provider": "vertex_ai", + "mistral/voxtral-mini-realtime-latest": { + "input_cost_per_second": 0.0001, + "litellm_provider": "mistral", "mode": "audio_transcription", - "output_cost_per_token": 2.1e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "source": "https://docs.mistral.ai/models/model-cards/voxtral-mini-transcribe-realtime-26-02", "supported_endpoints": [ - "/v1/realtime" + "/v1/audio/transcriptions" ], "supported_modalities": [ "audio" @@ -61055,264 +64397,50 @@ ], "supports_audio_input": true }, - "vertex_ai/gemini-3.5-live-translate-preview": { - "input_cost_per_audio_token": 3.5e-06, - "input_cost_per_second": 8.83333333333e-05, - "input_cost_per_token": 3.5e-06, - "litellm_provider": "vertex_ai", - "mode": "realtime", - "output_cost_per_audio_token": 2.1e-05, - "output_cost_per_token": 2.1e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", - "supported_endpoints": [ - "/v1/realtime" - ], - "supported_modalities": [ - "audio" - ], - "supported_output_modalities": [ - "audio", - "text" - ], - "supports_audio_input": true, - "supports_audio_output": true - }, - "perplexity/pplx-embed-context-v1-0.6b": { - "input_cost_per_token": 8e-09, - "litellm_provider": "perplexity", - "max_input_tokens": 32768, - "max_tokens": 32768, - "mode": "embedding", - "output_cost_per_token": 0.0, - "output_vector_size": 1024, - "source": "https://docs.perplexity.ai/getting-started/pricing" - }, - "perplexity/pplx-embed-context-v1-4b": { - "input_cost_per_token": 5e-08, - "litellm_provider": "perplexity", - "max_input_tokens": 32768, - "max_tokens": 32768, - "mode": "embedding", - "output_cost_per_token": 0.0, - "output_vector_size": 2560, - "source": "https://docs.perplexity.ai/getting-started/pricing" - }, - "voyage/voyage-4-large": { - "input_cost_per_token": 1.2e-07, - "litellm_provider": "voyage", - "max_input_tokens": 32000, - "max_tokens": 32000, - "mode": "embedding", - "output_cost_per_token": 0.0, - "output_vector_size": 1024, - "source": "https://docs.voyageai.com/docs/pricing" - }, - "voyage/voyage-4": { - "input_cost_per_token": 6e-08, - "litellm_provider": "voyage", - "max_input_tokens": 32000, - "max_tokens": 32000, - "mode": "embedding", - "output_cost_per_token": 0.0, - "output_vector_size": 1024, - "source": "https://docs.voyageai.com/docs/pricing" - }, - "voyage/voyage-4-lite": { - "input_cost_per_token": 2e-08, - "litellm_provider": "voyage", - "max_input_tokens": 32000, - "max_tokens": 32000, - "mode": "embedding", - "output_cost_per_token": 0.0, - "output_vector_size": 1024, - "source": "https://docs.voyageai.com/docs/pricing" - }, - "voyage/voyage-code-4": { - "input_cost_per_token": 1.2e-07, - "litellm_provider": "voyage", - "max_input_tokens": 32000, - "max_tokens": 32000, - "mode": "embedding", - "output_cost_per_token": 0.0, - "output_vector_size": 1024, - "source": "https://docs.voyageai.com/docs/pricing" - }, - "voyage/voyage-context-4": { - "input_cost_per_token": 1.2e-07, - "litellm_provider": "voyage", - "max_input_tokens": 120000, - "max_tokens": 120000, - "mode": "embedding", - "output_cost_per_token": 0.0, - "output_vector_size": 1024, - "source": "https://docs.voyageai.com/docs/pricing" - }, - "voyage/voyage-multimodal-3.5": { - "input_cost_per_token": 1.2e-07, - "litellm_provider": "voyage", - "max_input_tokens": 32000, - "max_tokens": 32000, - "mode": "embedding", - "output_cost_per_token": 0.0, - "output_vector_size": 1024, - "source": "https://docs.voyageai.com/docs/pricing", - "supports_embedding_image_input": true - }, - "fireworks_ai/accounts/fireworks/models/deepseek-v4-flash-0731": { - "cache_read_input_token_cost": 7e-09, - "cache_read_input_token_cost_priority": 8.75e-09, - "input_cost_per_token": 2.2e-07, - "input_cost_per_token_priority": 2.75e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 6.6e-07, - "output_cost_per_token_priority": 8.25e-07, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false - }, - "fireworks_ai/accounts/fireworks/models/deepseek-v4p1-flash": { - "cache_read_input_token_cost": 7e-09, - "cache_read_input_token_cost_priority": 8.75e-09, - "input_cost_per_token": 2.2e-07, - "input_cost_per_token_priority": 2.75e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 393216, - "max_tokens": 393216, - "mode": "chat", - "output_cost_per_token": 6.6e-07, - "output_cost_per_token_priority": 8.25e-07, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "fireworks_ai/accounts/fireworks/models/deepseek-v4-flash-vision-exp": { - "cache_read_input_token_cost": 7e-09, - "input_cost_per_token": 2.2e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_tokens": 1048576, - "mode": "chat", - "output_cost_per_token": 6.6e-07, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_response_schema": true - }, - "fireworks_ai/accounts/fireworks/models/kimi-k3": { - "cache_read_input_token_cost": 3e-07, - "cache_read_input_token_cost_priority": 3.75e-07, - "input_cost_per_token": 3e-06, - "input_cost_per_token_priority": 3.75e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "output_cost_per_token_priority": 1.875e-05, - "reasoning_effort_levels": [ - "low", - "high", - "max" - ], - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "fireworks_ai/deepseek-v4-flash-0731": { - "cache_read_input_token_cost": 7e-09, - "cache_read_input_token_cost_priority": 8.75e-09, - "input_cost_per_token": 2.2e-07, - "input_cost_per_token_priority": 2.75e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 6.6e-07, - "output_cost_per_token_priority": 8.25e-07, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false - }, - "fireworks_ai/deepseek-v4p1-flash": { - "cache_read_input_token_cost": 7e-09, - "cache_read_input_token_cost_priority": 8.75e-09, - "input_cost_per_token": 2.2e-07, - "input_cost_per_token_priority": 2.75e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 393216, - "max_tokens": 393216, + "mistral/labs-leanstral-1-5-1": { + "input_cost_per_token": 0.0, + "litellm_provider": "mistral", + "max_input_tokens": 262144, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 6.6e-07, - "output_cost_per_token_priority": 8.25e-07, - "source": "https://api.fireworks.ai/v1/serverless/models", + "output_cost_per_token": 0.0, + "source": "https://docs.mistral.ai/models/model-cards/leanstral-1-5", "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_tool_choice": true }, - "fireworks_ai/deepseek-v4-flash-vision-exp": { - "cache_read_input_token_cost": 7e-09, - "input_cost_per_token": 2.2e-07, + "fireworks_ai/accounts/fireworks/models/glm-5p3": { + "cache_read_input_token_cost": 2.6e-07, + "cache_read_input_token_cost_priority": 3.25e-07, + "input_cost_per_token": 1.4e-06, + "input_cost_per_token_priority": 1.75e-06, "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_tokens": 1048576, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6.6e-07, + "output_cost_per_token": 4.4e-06, + "output_cost_per_token_priority": 5.5e-06, "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_response_schema": true - }, - "fireworks_ai/glm-5p2-fast": { - "cache_read_input_token_cost": 2.1e-07, - "input_cost_per_token": 2.1e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 6.6e-06, - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": false }, - "fireworks_ai/glm-5p2-fast-us": { - "cache_read_input_token_cost": 2.1e-07, + "fireworks_ai/accounts/fireworks/routers/glm-5p3-us": { + "cache_read_input_token_cost": 3.9e-07, + "cache_read_input_token_cost_priority": 4.875e-07, "input_cost_per_token": 2.1e-06, + "input_cost_per_token_priority": 2.625e-06, "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 6.6e-06, + "output_cost_per_token_priority": 8.25e-06, "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, "supports_reasoning": true, @@ -61320,114 +64448,37 @@ "supports_tool_choice": true, "supports_vision": false }, - "fireworks_ai/kimi-k3": { - "cache_read_input_token_cost": 3e-07, - "cache_read_input_token_cost_priority": 3.75e-07, - "input_cost_per_token": 3e-06, - "input_cost_per_token_priority": 3.75e-06, + "fireworks_ai/glm-5p3": { + "cache_read_input_token_cost": 2.6e-07, + "cache_read_input_token_cost_priority": 3.25e-07, + "input_cost_per_token": 1.4e-06, + "input_cost_per_token_priority": 1.75e-06, "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.5e-05, - "output_cost_per_token_priority": 1.875e-05, - "reasoning_effort_levels": [ - "low", - "high", - "max" - ], + "output_cost_per_token": 4.4e-06, + "output_cost_per_token_priority": 5.5e-06, "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true - }, - "fireworks_ai/kimi-k3-fast": { - "cache_read_input_token_cost": 4.5e-07, - "input_cost_per_token": 4.5e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 2.25e-05, - "reasoning_effort_levels": [ - "low", - "high", - "max" - ], - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_vision": false }, - "fireworks_ai/kimi-k3-us": { - "cache_read_input_token_cost": 3.3e-07, - "input_cost_per_token": 3.3e-06, + "fireworks_ai/glm-5p3-us": { + "cache_read_input_token_cost": 3.9e-07, + "cache_read_input_token_cost_priority": 4.875e-07, + "input_cost_per_token": 2.1e-06, + "input_cost_per_token_priority": 2.625e-06, "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 1.65e-05, - "reasoning_effort_levels": [ - "low", - "high", - "max" - ], - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "fireworks_ai/qwen3p8-max": { - "cache_read_input_token_cost": 2.5e-07, - "cache_read_input_token_cost_priority": 3.75e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_priority": 3e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 6e-06, - "output_cost_per_token_priority": 9e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "fireworks_ai/muse-glimmer-30b": { - "cache_read_input_token_cost": 4e-08, - "input_cost_per_token": 3.5e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1.5e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "fireworks_ai/nemotron-lightning-3p5-30b-a3b": { - "cache_read_input_token_cost": 1e-08, - "input_cost_per_token": 5e-08, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2e-07, + "output_cost_per_token": 6.6e-06, + "output_cost_per_token_priority": 8.25e-06, "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, "supports_reasoning": true, @@ -61435,110 +64486,54 @@ "supports_tool_choice": true, "supports_vision": false }, - "fireworks_ai/nemotron-3-ultra-nvfp4": { - "cache_read_input_token_cost": 1.2e-07, - "input_cost_per_token": 6e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 2.4e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false - }, - "fireworks_ai/accounts/fireworks/models/muse-glimmer-30b": { - "cache_read_input_token_cost": 4e-08, - "input_cost_per_token": 3.5e-07, + "fireworks_ai/accounts/fireworks/routers/glm-5p3-fast": { + "cache_read_input_token_cost": 3.9e-07, + "input_cost_per_token": 2.1e-06, "litellm_provider": "fireworks_ai", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "max_input_tokens": 1048576, + "max_tokens": 1048576, "mode": "chat", - "output_cost_per_token": 1.5e-06, + "output_cost_per_token": 6.6e-06, "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true - }, - "fireworks_ai/accounts/fireworks/models/nemotron-lightning-3p5-30b-a3b": { - "cache_read_input_token_cost": 1e-08, - "input_cost_per_token": 5e-08, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 2e-07, - "source": "https://docs.fireworks.ai/serverless/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, "supports_vision": false }, - "fireworks_ai/accounts/fireworks/models/nemotron-3-ultra-nvfp4": { - "cache_read_input_token_cost": 1.2e-07, - "input_cost_per_token": 6e-07, + "fireworks_ai/accounts/fireworks/routers/auto": { "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 2.4e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", + "source": "https://docs.fireworks.ai/nexus/firerouter#example-router-ids", "supports_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_tool_choice": true }, - "fireworks_ai/accounts/fireworks/models/qwen3p8-max": { - "cache_read_input_token_cost": 2.5e-07, - "cache_read_input_token_cost_priority": 3.75e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_priority": 3e-06, + "fireworks_ai/accounts/fireworks/routers/auto-instant": { "litellm_provider": "fireworks_ai", - "max_input_tokens": 262144, "mode": "chat", - "output_cost_per_token": 6e-06, - "output_cost_per_token_priority": 9e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", + "source": "https://docs.fireworks.ai/nexus/firerouter#example-router-ids", "supports_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_tool_choice": true }, - "fireworks_ai/accounts/fireworks/routers/glm-5p2-fast": { - "cache_read_input_token_cost": 2.1e-07, - "input_cost_per_token": 2.1e-06, + "fireworks_ai/accounts/fireworks/routers/firerouter": { "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 6.6e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", + "source": "https://docs.fireworks.ai/nexus/firerouter#example-router-ids", "supports_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_tool_choice": true }, - "fireworks_ai/accounts/fireworks/routers/glm-5p2-fast-us": { - "cache_read_input_token_cost": 2.1e-07, + "fireworks_ai/glm-5p3-fast": { + "cache_read_input_token_cost": 3.9e-07, "input_cost_per_token": 2.1e-06, "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_tokens": 1048576, "mode": "chat", "output_cost_per_token": 6.6e-06, "source": "https://docs.fireworks.ai/serverless/pricing", @@ -61548,4622 +64543,4772 @@ "supports_tool_choice": true, "supports_vision": false }, - "fireworks_ai/accounts/fireworks/routers/kimi-k3-fast": { - "cache_read_input_token_cost": 4.5e-07, - "input_cost_per_token": 4.5e-06, + "fireworks_ai/accounts/fireworks/models/glm-5p3-flash": { + "cache_read_input_token_cost": 3e-08, + "cache_read_input_token_cost_priority": 3.75e-08, + "input_cost_per_token": 1.5e-07, + "input_cost_per_token_priority": 1.875e-07, "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_tokens": 1048576, "mode": "chat", - "output_cost_per_token": 2.25e-05, - "reasoning_effort_levels": [ - "low", - "high", - "max" - ], + "output_cost_per_token": 5e-07, + "output_cost_per_token_priority": 6.25e-07, "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true }, - "fireworks_ai/accounts/fireworks/routers/kimi-k3-us": { - "cache_read_input_token_cost": 3.3e-07, - "input_cost_per_token": 3.3e-06, + "fireworks_ai/accounts/fireworks/routers/glm-5p3-flash-us": { + "cache_read_input_token_cost": 4.5e-08, + "cache_read_input_token_cost_priority": 5.625e-08, + "input_cost_per_token": 2.25e-07, + "input_cost_per_token_priority": 2.8125e-07, "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_tokens": 1048576, "mode": "chat", - "output_cost_per_token": 1.65e-05, - "reasoning_effort_levels": [ - "low", - "high", - "max" - ], + "output_cost_per_token": 7.5e-07, + "output_cost_per_token_priority": 9.375e-07, "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true }, - "novita/zai-org/glm-5.3": { - "cache_read_input_token_cost": 2.6e-07, - "input_cost_per_token": 1.4e-06, - "litellm_provider": "novita", + "fireworks_ai/glm-5p3-flash": { + "cache_read_input_token_cost": 3e-08, + "cache_read_input_token_cost_priority": 3.75e-08, + "input_cost_per_token": 1.5e-07, + "input_cost_per_token_priority": 1.875e-07, + "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_tokens": 1048576, "mode": "chat", - "output_cost_per_token": 4.4e-06, - "source": "https://api.novita.ai/v3/openai/models", + "output_cost_per_token": 5e-07, + "output_cost_per_token_priority": 6.25e-07, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false + "supports_vision": true }, - "novita/deepseek/deepseek-v4-pro-0813": { - "cache_read_input_token_cost": 1.3200000000000002e-07, - "input_cost_per_token": 1.32e-06, - "litellm_provider": "novita", + "fireworks_ai/glm-5p3-flash-us": { + "cache_read_input_token_cost": 4.5e-08, + "cache_read_input_token_cost_priority": 5.625e-08, + "input_cost_per_token": 2.25e-07, + "input_cost_per_token_priority": 2.8125e-07, + "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 393216, - "max_tokens": 393216, + "max_tokens": 1048576, "mode": "chat", - "output_cost_per_token": 3.96e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 7.5e-07, + "output_cost_per_token_priority": 9.375e-07, + "source": "https://docs.fireworks.ai/serverless/pricing", "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false + "supports_vision": true }, - "novita/moonshotai/kimi-k3": { - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 3e-06, - "litellm_provider": "novita", + "fireworks_ai/accounts/fireworks/models/inkling": { + "cache_read_input_token_cost": 1.7e-07, + "cache_read_input_token_cost_priority": 1.7e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_priority": 1e-06, + "litellm_provider": "fireworks_ai", "max_input_tokens": 1048576, - "max_output_tokens": 1048576, "max_tokens": 1048576, "mode": "chat", - "output_cost_per_token": 1.5e-05, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 4.05e-06, + "output_cost_per_token_priority": 4.05e-06, + "source": "https://api.fireworks.ai/v1/serverless/models?format=nested", "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true }, - "novita/tencent/hy3": { - "cache_read_input_token_cost": 3.5e-08, - "input_cost_per_token": 1.4e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 5.8e-07, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "fireworks_ai/accounts/fireworks/models/qwen3-embedding-8b": { + "input_cost_per_token": 1e-07, + "output_cost_per_token": 0.0, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 40960, + "max_output_tokens": 40960, + "max_tokens": 40960, + "mode": "embedding", + "source": "https://api.fireworks.ai/v1/serverless/models" }, - "novita/zai-org/glm-5.2": { + "zai/glm-5.2": { + "cache_creation_input_token_cost": 0, "cache_read_input_token_cost": 2.6e-07, "input_cost_per_token": 1.4e-06, - "litellm_provider": "novita", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "litellm_provider": "zai", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, "mode": "chat", "output_cost_per_token": 4.4e-06, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false - }, - "novita/moonshotai/kimi-k2.7-code": { - "cache_read_input_token_cost": 1.9e-07, - "input_cost_per_token": 9.499999999999999e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 4e-06, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "novita/deepseek/deepseek-v4-flash-vision-exp": { - "cache_read_input_token_cost": 2.8e-08, - "input_cost_per_token": 4.4e-07, - "litellm_provider": "novita", - "max_input_tokens": 1048576, - "max_output_tokens": 393216, - "max_tokens": 393216, - "mode": "chat", - "output_cost_per_token": 1.32e-06, - "source": "https://api.novita.ai/v3/openai/models", + "source": "https://docs.z.ai/guides/overview/pricing", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_tool_choice": true }, - "novita/deepseek/deepseek-v4-flash-0731": { - "cache_read_input_token_cost": 2.8e-08, - "input_cost_per_token": 4.4e-07, - "litellm_provider": "novita", - "max_input_tokens": 1048576, - "max_output_tokens": 393216, - "max_tokens": 393216, + "together_ai/Qwen/Qwen3.8-Flash": { + "input_cost_per_token": 9e-08, + "litellm_provider": "together_ai", + "max_input_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 1.32e-06, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "output_cost_per_token": 2.82e-07, + "source": "https://api.together.ai/v1/models" }, - "novita/mindai/macaron-v1-venti": { - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 1.5e-06, - "litellm_provider": "novita", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "together_ai/moonshotai/Kimi-K2.5-fp4": { + "input_cost_per_token": 5e-07, + "output_cost_per_token": 2.8e-06, + "litellm_provider": "together_ai", + "max_input_tokens": 262144, "mode": "chat", - "output_cost_per_token": 4.5e-06, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "supports_vision": false + "source": "https://api.together.ai/v1/models" }, - "novita/minimax/minimax-m3": { - "cache_read_input_token_cost": 6e-08, + "together_ai/MiniMaxAI/MiniMax-M2.7": { "input_cost_per_token": 3e-07, - "litellm_provider": "novita", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", "output_cost_per_token": 1.2e-06, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "cache_read_input_token_cost": 6e-08, + "litellm_provider": "together_ai", + "max_input_tokens": 196608, + "mode": "chat", + "source": "https://api.together.ai/v1/models" }, - "novita/deepseek/deepseek-v4-flash": { - "cache_read_input_token_cost": 2.8e-08, - "input_cost_per_token": 1.4e-07, - "litellm_provider": "novita", - "max_input_tokens": 1048576, - "max_output_tokens": 393216, - "max_tokens": 393216, + "together_ai/deepseek-ai/DeepSeek-R1-0528": { + "input_cost_per_token": 3e-06, + "output_cost_per_token": 7e-06, + "litellm_provider": "together_ai", + "max_input_tokens": 163840, "mode": "chat", - "output_cost_per_token": 2.8e-07, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "source": "https://api.together.ai/v1/models" }, - "novita/deepseek/deepseek-v4-pro": { - "cache_read_input_token_cost": 1.35e-07, - "input_cost_per_token": 1.6000000000000001e-06, - "litellm_provider": "novita", - "max_input_tokens": 1048576, - "max_output_tokens": 393216, - "max_tokens": 393216, + "together_ai/mistralai/Ministral-3-14B-Instruct-2512": { + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 262144, "mode": "chat", - "output_cost_per_token": 3.2000000000000003e-06, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "source": "https://api.together.ai/v1/models" }, - "novita/inclusionai/ling-3.0-flash-fast": { - "cache_read_input_token_cost": 1.2e-08, + "together_ai/nvidia/NVIDIA-Nemotron-Nano-9B-v2": { + "deprecation_date": "2026-02-25", "input_cost_per_token": 6e-08, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "output_cost_per_token": 2.5e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.8e-07, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "supports_vision": false + "source": "https://api.together.ai/v1/models" }, - "novita/qwen/qwen3.8-max": { - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 2e-06, - "litellm_provider": "novita", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, + "together_ai/mistralai/Mistral-7B-Instruct-v0.3": { + "input_cost_per_token": 2e-07, + "output_cost_per_token": 2e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 32768, "mode": "chat", - "output_cost_per_token": 6e-06, - "source": "https://novita.ai/pricing", + "source": "https://api.together.ai/v1/models" + }, + "cerebras/gemma-4-31b": { + "input_cost_per_token": 9.9e-07, + "litellm_provider": "cerebras", + "max_input_tokens": 131072, + "max_output_tokens": 40960, + "max_tokens": 40960, + "mode": "chat", + "output_cost_per_token": 1.49e-06, + "source": "https://api.cerebras.ai/public/v1/models/gemma-4-31b", "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_parallel_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true }, - "novita/inclusionai/ling-3.0-flash": { - "cache_read_input_token_cost": 1.2e-08, - "input_cost_per_token": 6e-08, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "elevenlabs/scribe_v2": { + "input_cost_per_second": 6.11e-05, + "litellm_provider": "elevenlabs", + "mode": "audio_transcription", + "output_cost_per_second": 0.0, + "source": "https://elevenlabs.io/pricing/api", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ] + }, + "scaleway/glm-5.2": { + "input_cost_per_token": 1.8e-06, + "litellm_provider": "scaleway", + "max_input_tokens": 256000, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1.8e-07, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 5.5e-06, + "source": "https://www.scaleway.com/en/pricing/model-as-a-service/", "supports_function_calling": true, - "supports_prompt_caching": true, "supports_reasoning": true, - "supports_tool_choice": true, "supports_vision": false }, - "novita/mindai/macaron-v1-tall": { + "scaleway/deepseek-v4-flash-0731": { "cache_read_input_token_cost": 8e-08, - "input_cost_per_token": 4.5000000000000003e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, + "input_cost_per_token": 4e-07, + "litellm_provider": "scaleway", + "max_input_tokens": 256000, "max_output_tokens": 32768, "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 2.6e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 8e-07, + "source": "https://www.scaleway.com/en/pricing/model-as-a-service/", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_tool_choice": true, "supports_vision": false }, - "novita/stepfun/step-3.7-flash": { - "cache_read_input_token_cost": 4e-08, - "input_cost_per_token": 2.0000000000000002e-07, - "litellm_provider": "novita", + "azure_ai/kimi-k2.7-code": { + "cache_read_input_token_cost": 1.9e-07, + "deprecation_date": "2026-10-03", + "input_cost_per_token": 9.5e-07, + "litellm_provider": "azure_ai", "max_input_tokens": 262144, - "max_output_tokens": 256000, - "max_tokens": 256000, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 1.15e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 4e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true }, - "novita/nvidia/nemotron-3-nano-30b-a3b": { - "input_cost_per_token": 5.0000000000000004e-08, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "output_cost_per_token": 2.0000000000000002e-07, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false - }, - "novita/baidu/cobuddy": { - "cache_read_input_token_cost": 7e-08, - "input_cost_per_token": 2.8e-07, - "litellm_provider": "novita", - "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, + "azure_ai/deepseek-v4.1-flash": { + "cache_read_input_token_cost": 6e-09, + "input_cost_per_token": 3e-07, + "litellm_provider": "azure_ai", + "max_input_tokens": 1000000, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", - "output_cost_per_token": 1.13e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 1.2e-06, "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_tool_choice": true, - "supports_vision": false + "deprecation_date": "2026-12-15", + "source": "https://techcommunity.microsoft.com/blog/azure-ai-foundry-blog/deepseek-v4-1-flash-is-coming-to-microsoft-foundry/4556431" }, - "novita/xiaomimimo/mimo-v2.5": { - "cache_read_input_token_cost": 3.4e-09, - "input_cost_per_token": 1.6800000000000002e-07, - "litellm_provider": "novita", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "azure_ai/MAI-Image-2.6": { + "input_cost_per_image_token": 8e-06, + "input_cost_per_token": 5e-06, + "litellm_provider": "azure_ai", + "mode": "image_generation", + "output_cost_per_image_token": 3.8e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/images/generations", + "/v1/images/edits" + ] + }, + "azure_ai/MAI-Image-2.6-Flash": { + "input_cost_per_image_token": 2.5e-06, + "input_cost_per_token": 1.75e-06, + "litellm_provider": "azure_ai", + "mode": "image_generation", + "output_cost_per_image_token": 1.9e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/images/generations", + "/v1/images/edits" + ] + }, + "azure_ai/FW-DeepSeek-V4.1-Flash": { + "cache_read_input_token_cost": 8e-09, + "input_cost_per_token": 3.75e-07, + "litellm_provider": "azure_ai", + "max_input_tokens": 1000000, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", - "output_cost_per_token": 3.3600000000000004e-07, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 1.5e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_tool_choice": true }, - "novita/qwen/qwen3.7-max": { - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "novita", + "azure_ai/FW-DeepSeek-V4-Flash": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 1.5e-07, + "litellm_provider": "azure_ai", "max_input_tokens": 1000000, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", - "output_cost_per_token": 3.75e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 3.1e-07, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_tool_choice": true }, - "novita/xiaomimimo/mimo-v2.5-pro": { - "cache_read_input_token_cost": 4.3e-09, - "input_cost_per_token": 5.22e-07, - "litellm_provider": "novita", + "azure_ai/FW-GLM-5.3": { + "cache_read_input_token_cost": 3.25e-07, + "input_cost_per_token": 1.75e-06, + "litellm_provider": "azure_ai", "max_input_tokens": 1048576, "max_output_tokens": 131072, "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.044e-06, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false - }, - "novita/qwen/qwen3.6-27b": { - "input_cost_per_token": 6e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "chat", - "output_cost_per_token": 3.6000000000000003e-06, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true - }, - "novita/moonshotai/kimi-k2.6": { - "cache_read_input_token_cost": 1.6e-07, - "input_cost_per_token": 8.000000000000001e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, - "mode": "chat", - "output_cost_per_token": 3.4e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 5.5e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_tool_choice": true }, - "novita/zai-org/glm-5.1": { - "cache_read_input_token_cost": 2.6e-07, - "input_cost_per_token": 1.38e-06, - "litellm_provider": "novita", - "max_input_tokens": 204800, + "azure_ai/FW-GLM-5.3-Flash": { + "cache_read_input_token_cost": 3.8e-08, + "input_cost_per_token": 1.88e-07, + "litellm_provider": "azure_ai", + "max_input_tokens": 1048576, "max_output_tokens": 131072, "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 4.4e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 6.25e-07, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_tool_choice": true }, - "novita/minimax/minimax-m2.7-highspeed": { - "cache_read_input_token_cost": 6e-08, - "input_cost_per_token": 6e-07, - "litellm_provider": "novita", - "max_input_tokens": 204800, + "azure_ai/FW-GPT-OSS-120B": { + "deprecation_date": "2027-07-01", + "cache_read_input_token_cost": 8.2e-08, + "input_cost_per_token": 1.65e-07, + "litellm_provider": "azure_ai", + "max_input_tokens": 131072, "max_output_tokens": 131072, "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 2.4e-06, - "source": "https://api.novita.ai/v3/openai/models", + "output_cost_per_token": 6.6e-07, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_function_calling": true, + "supports_parallel_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_tool_choice": true }, - "novita/zai-org/glm-5v-turbo": { - "cache_read_input_token_cost": 2.4e-07, - "input_cost_per_token": 1.2e-06, - "litellm_provider": "novita", - "max_input_tokens": 204800, - "max_output_tokens": 131072, - "max_tokens": 131072, + "azure_ai/Cohere-command-a-plus-05-2026": { + "deprecation_date": "2026-10-16", + "input_cost_per_token": 8e-07, + "litellm_provider": "azure_ai", + "max_input_tokens": 128000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 4e-06, - "source": "https://api.novita.ai/v3/openai/models", + "output_cost_per_token": 3.2e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", "supports_function_calling": true, - "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_tool_choice": true }, - "novita/google/gemma-4-26b-a4b-it": { - "input_cost_per_token": 1.3e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 131072, - "max_tokens": 131072, + "azure_ai/mistral-medium-3-5": { + "input_cost_per_token": 1.5e-06, + "litellm_provider": "azure_ai", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 4.0000000000000003e-07, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_reasoning": true, + "output_cost_per_token": 7.5e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], "supports_response_schema": true, - "supports_tool_choice": true, "supports_vision": true }, - "novita/google/gemma-4-31b-it": { - "input_cost_per_token": 1.4e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 131072, - "max_tokens": 131072, + "azure_ai/deepseek-r1": { + "deprecation_date": "2026-08-13", + "input_cost_per_token": 1.35e-06, + "output_cost_per_token": 5.4e-06, + "litellm_provider": "azure_ai", "mode": "chat", - "output_cost_per_token": 4.0000000000000003e-07, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "novita/zai-org/glm-5-turbo": { - "cache_read_input_token_cost": 2.4e-07, - "input_cost_per_token": 1.2e-06, - "litellm_provider": "novita", - "max_input_tokens": 202800, - "max_output_tokens": 131072, - "max_tokens": 131072, + "azure_ai/deepseek-v3-0324": { + "deprecation_date": "2026-07-13", + "input_cost_per_token": 1.14e-06, + "output_cost_per_token": 4.56e-06, + "litellm_provider": "azure_ai", "mode": "chat", - "output_cost_per_token": 4e-06, - "source": "https://api.novita.ai/v3/openai/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "novita/minimax/minimax-m2.7": { - "cache_read_input_token_cost": 6e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "novita", - "max_input_tokens": 204800, - "max_output_tokens": 131072, - "max_tokens": 131072, + "azure_ai/deepseek-v3.1": { + "deprecation_date": "2026-07-13", + "input_cost_per_token": 1.23e-06, + "output_cost_per_token": 4.94e-06, + "litellm_provider": "azure_ai", "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "novita/minimax/minimax-m2.5-highspeed": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token": 6e-07, - "litellm_provider": "novita", - "max_input_tokens": 204800, - "max_output_tokens": 131100, - "max_tokens": 131100, + "azure_ai/grok-3": { + "deprecation_date": "2026-05-01", + "input_cost_per_token": 3e-06, + "output_cost_per_token": 1.5e-05, + "litellm_provider": "azure_ai", "mode": "chat", - "output_cost_per_token": 2.4e-06, - "source": "https://novita.ai/pricing", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "novita/qwen/qwen3.5-27b": { - "input_cost_per_token": 3e-07, - "litellm_provider": "novita", + "azure_ai/grok-3-mini": { + "deprecation_date": "2026-05-01", + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 1.27e-06, + "litellm_provider": "azure_ai", + "mode": "chat", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + }, + "azure_ai/grok-4-fast-non-reasoning": { + "deprecation_date": "2026-05-01", + "input_cost_per_token": 2e-07, + "output_cost_per_token": 5e-07, + "litellm_provider": "azure_ai", + "mode": "chat", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + }, + "azure_ai/grok-4-fast-reasoning": { + "deprecation_date": "2026-05-01", + "input_cost_per_token": 2e-07, + "output_cost_per_token": 5e-07, + "litellm_provider": "azure_ai", + "mode": "chat", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + }, + "bedrock/us-gov-west-1/nvidia.nemotron-nano-3-30b": { + "input_cost_per_token": 7.2e-08, + "litellm_provider": "bedrock", "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 2.4e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 2.88e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, + "supports_native_structured_output": true, + "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, - "novita/qwen/qwen3.5-122b-a10b": { - "input_cost_per_token": 4.0000000000000003e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "bedrock/us-gov-west-1/nvidia.nemotron-nano-12b-v2": { + "input_cost_per_token": 2.4e-07, + "litellm_provider": "bedrock", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 3.2000000000000003e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 7.2e-07, + "supports_system_messages": true, + "supports_vision": true, + "supports_audio_input": false, "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true }, - "novita/qwen/qwen3.5-35b-a3b": { - "input_cost_per_token": 2.5e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "bedrock/us-gov-west-1/nvidia.nemotron-nano-9b-v2": { + "input_cost_per_token": 7.2e-08, + "litellm_provider": "bedrock", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 2.76e-07, + "supports_system_messages": true, + "supports_audio_input": false, "supports_function_calling": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_vision": false }, - "novita/qwen/qwen3.5-397b-a17b": { - "input_cost_per_token": 6e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "bedrock/us-gov-west-1/nvidia.nemotron-super-3-120b": { + "input_cost_per_token": 1.8e-07, + "litellm_provider": "bedrock", + "max_input_tokens": 256000, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 3.6000000000000003e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 7.8e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_reasoning": true, - "supports_response_schema": true, + "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true + "supports_audio_input": false, + "supports_response_schema": true, + "supports_vision": false }, - "novita/minimax/minimax-m2.5": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "novita", - "max_input_tokens": 204800, - "max_output_tokens": 131100, - "max_tokens": 131100, + "bedrock/us-gov-west-1/openai.gpt-oss-20b-1:0": { + "input_cost_per_token": 8.4e-08, + "litellm_provider": "bedrock", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 3.6e-07, "supports_function_calling": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_tool_choice": true }, - "novita/zai-org/glm-5": { - "cache_read_input_token_cost": 2.0000000000000002e-07, - "input_cost_per_token": 1e-06, - "litellm_provider": "novita", - "max_input_tokens": 202800, - "max_output_tokens": 131072, - "max_tokens": 131072, + "bedrock/us-gov-west-1/openai.gpt-oss-120b-1:0": { + "input_cost_per_token": 1.8e-07, + "litellm_provider": "bedrock", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3.2000000000000003e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 7.2e-07, "supports_function_calling": true, - "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_tool_choice": true }, - "novita/qwen/qwen3-coder-next": { - "input_cost_per_token": 2.0000000000000002e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "bedrock/us-gov-west-1/anthropic.claude-sonnet-5": { + "bedrock_converse_supports_strict_tools": false, + "bedrock_output_config_effort_ceiling": "xhigh", + "cache_creation_input_token_cost": 3e-06, + "cache_creation_input_token_cost_above_1hr": 4.8e-06, + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 2.4e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.5e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 1.2e-05, + "prompt_cache_min_tokens": 1024, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": false - }, - "novita/deepseek/deepseek-ocr-2": { - "input_cost_per_token": 3e-08, - "litellm_provider": "novita", - "max_input_tokens": 8192, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 3e-08, - "source": "https://novita.ai/pricing", - "supports_vision": true + "supports_vision": true, + "supports_xhigh_reasoning_effort": true }, - "novita/moonshotai/kimi-k2.5": { - "cache_read_input_token_cost": 1.0000000000000001e-07, - "input_cost_per_token": 6e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, + "bedrock/us-gov-west-1/anthropic.claude-opus-4-8": { + "bedrock_converse_supports_strict_tools": false, + "bedrock_output_config_effort_ceiling": "xhigh", + "cache_creation_input_token_cost": 7.5e-06, + "cache_creation_input_token_cost_above_1hr": 1.2e-05, + "cache_read_input_token_cost": 6e-07, + "input_cost_per_token": 6e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 3e-05, + "prompt_cache_min_tokens": 1024, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "supports_xhigh_reasoning_effort": true }, - "novita/zai-org/glm-4.7-h": { - "cache_read_input_token_cost": 1.1e-07, - "input_cost_per_token": 6e-07, - "litellm_provider": "novita", - "max_input_tokens": 204800, - "max_output_tokens": 131072, - "max_tokens": 131072, + "bedrock/us-gov-west-1/anthropic.claude-opus-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 7.5e-06, + "cache_creation_input_token_cost_above_1hr": 1.2e-05, + "cache_read_input_token_cost": 6e-07, + "input_cost_per_token": 6e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.2e-06, - "source": "https://api.novita.ai/v3/openai/models", + "output_cost_per_token": 3e-05, + "prompt_cache_min_tokens": 512, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": false + "supports_vision": true, + "supports_xhigh_reasoning_effort": true }, - "novita/zai-org/glm-4.7-flash": { - "cache_read_input_token_cost": 1e-08, - "input_cost_per_token": 7e-08, - "litellm_provider": "novita", - "max_input_tokens": 200000, + "bedrock/us-gov-west-1/anthropic.claude-opus-5-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 6e-06, + "cache_creation_input_token_cost_above_1hr": 9.6e-06, + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 4.8e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 4.0000000000000003e-07, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 2.4e-05, + "prompt_cache_min_tokens": 512, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": false + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "thinking_always_on": true, + "supports_forced_tool_use": false, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "novita/qwen/qwen3.6-35b-a3b": { - "input_cost_per_token": 2.48e-07, - "litellm_provider": "novita", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "bedrock/us-gov-west-1/anthropic.claude-fable-5-1": { + "cache_creation_input_token_cost": 1.5e-05, + "cache_creation_input_token_cost_above_1hr": 2.4e-05, + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 1.2e-05, + "litellm_provider": "bedrock", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.4850000000000002e-06, - "source": "https://novita.ai/pricing", + "output_cost_per_token": 6e-05, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_forced_tool_use": false, "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512 }, - "novita/deepseek/deepseek_v3": { - "input_cost_per_token": 8.900000000000001e-07, - "litellm_provider": "novita", - "max_input_tokens": 64000, - "max_output_tokens": 16000, - "max_tokens": 16000, + "bedrock/us-gov-east-1/nvidia.nemotron-nano-3-30b": { + "input_cost_per_token": 7.2e-08, + "litellm_provider": "bedrock", + "max_input_tokens": 262144, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 8.900000000000001e-07, - "source": "https://api.novita.ai/v3/openai/models", + "output_cost_per_token": 2.88e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, + "supports_native_structured_output": true, + "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, "supports_vision": false }, - "novita/deepseek/deepseek-r1": { - "input_cost_per_token": 4e-06, - "litellm_provider": "novita", - "max_input_tokens": 64000, - "max_output_tokens": 16000, - "max_tokens": 16000, + "bedrock/us-gov-east-1/nvidia.nemotron-nano-12b-v2": { + "input_cost_per_token": 2.4e-07, + "litellm_provider": "bedrock", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 4e-06, - "source": "https://api.novita.ai/v3/openai/models", + "output_cost_per_token": 7.2e-07, + "supports_system_messages": true, + "supports_vision": true, + "supports_audio_input": false, "supports_function_calling": true, - "supports_reasoning": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_response_schema": true }, - "novita/deepseek/deepseek-v3/community": { - "input_cost_per_token": 8.900000000000001e-07, - "litellm_provider": "novita", - "max_input_tokens": 64000, - "max_output_tokens": 8000, - "max_tokens": 8000, + "bedrock/us-gov-east-1/nvidia.nemotron-nano-9b-v2": { + "input_cost_per_token": 7.2e-08, + "litellm_provider": "bedrock", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 8.900000000000001e-07, - "source": "https://api.novita.ai/v3/openai/models", + "output_cost_per_token": 2.76e-07, + "supports_system_messages": true, + "supports_audio_input": false, "supports_function_calling": true, - "supports_tool_choice": true, + "supports_response_schema": true, "supports_vision": false }, - "novita/deepseek/deepseek-r1/community": { - "input_cost_per_token": 4e-06, - "litellm_provider": "novita", - "max_input_tokens": 64000, - "max_output_tokens": 8000, - "max_tokens": 8000, + "bedrock/us-gov-east-1/nvidia.nemotron-super-3-120b": { + "input_cost_per_token": 1.8e-07, + "litellm_provider": "bedrock", + "max_input_tokens": 256000, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 4e-06, - "source": "https://api.novita.ai/v3/openai/models", + "output_cost_per_token": 7.8e-07, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": true, "supports_reasoning": true, + "supports_system_messages": true, "supports_tool_choice": true, + "supports_audio_input": false, + "supports_response_schema": true, "supports_vision": false }, - "novita/thudm/glm-4-32b-0414": { - "input_cost_per_token": 5.5e-07, - "litellm_provider": "novita", - "max_input_tokens": 32000, - "max_output_tokens": 32000, - "max_tokens": 32000, + "bedrock/us-gov-east-1/openai.gpt-oss-20b-1:0": { + "input_cost_per_token": 8.4e-08, + "litellm_provider": "bedrock", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.66e-06, - "source": "https://api.novita.ai/v3/openai/models", + "output_cost_per_token": 3.6e-07, "supports_function_calling": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_tool_choice": true }, - "novita/meta-llama/llama-3.2-1b-instruct": { - "input_cost_per_token": 2e-08, - "litellm_provider": "novita", - "max_input_tokens": 131000, - "max_output_tokens": 32000, - "max_tokens": 32000, + "bedrock/us-gov-east-1/openai.gpt-oss-120b-1:0": { + "input_cost_per_token": 1.8e-07, + "litellm_provider": "bedrock", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2e-08, - "source": "https://api.novita.ai/v3/openai/models", - "supports_response_schema": true, - "supports_vision": false - }, - "wandb/deepseek-ai/DeepSeek-V4-Flash": { + "output_cost_per_token": 7.2e-07, + "supports_function_calling": true, "supports_reasoning": true, - "max_tokens": 1048576, - "max_input_tokens": 1049000, - "input_cost_per_token": 1.4e-07, - "output_cost_per_token": 2.8e-07, - "cache_read_input_token_cost": 7e-08, - "deprecation_date": "2026-10-05", - "supports_prompt_caching": true, - "litellm_provider": "wandb", - "mode": "chat", - "supports_vision": false, - "source": "https://wandb.ai/site/pricing/tokens/" + "supports_response_schema": true, + "supports_tool_choice": true }, - "wandb/deepseek-ai/DeepSeek-V4-Flash-0731": { - "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 1.3e-07, - "output_cost_per_token": 2.8e-07, - "cache_read_input_token_cost": 7e-08, - "supports_prompt_caching": true, - "litellm_provider": "wandb", + "bedrock/us-gov-east-1/anthropic.claude-sonnet-5": { + "bedrock_converse_supports_strict_tools": false, + "bedrock_output_config_effort_ceiling": "xhigh", + "cache_creation_input_token_cost": 3e-06, + "cache_creation_input_token_cost_above_1hr": 4.8e-06, + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 2.4e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "supports_vision": false, - "source": "https://wandb.ai/site/pricing/tokens/" - }, - "wandb/deepseek-ai/DeepSeek-V4-Pro": { - "supports_reasoning": true, - "max_tokens": 1048576, - "max_input_tokens": 1049000, - "input_cost_per_token": 1.15e-06, - "output_cost_per_token": 2.55e-06, - "cache_read_input_token_cost": 2e-07, - "deprecation_date": "2026-10-05", + "output_cost_per_token": 1.2e-05, + "prompt_cache_min_tokens": 1024, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, "supports_prompt_caching": true, - "litellm_provider": "wandb", - "mode": "chat", - "supports_vision": false, - "source": "https://wandb.ai/site/pricing/tokens/" - }, - "wandb/google/gemma-4-31B-it": { "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 3.4e-07, - "litellm_provider": "wandb", - "mode": "chat", + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, "supports_vision": true, - "source": "https://wandb.ai/site/pricing/tokens/" - }, - "wandb/ibm-granite/granite-4.1-8b": { - "deprecation_date": "2026-10-05", - "max_tokens": 131072, - "max_input_tokens": 131000, - "input_cost_per_token": 5e-08, - "output_cost_per_token": 1e-07, - "litellm_provider": "wandb", - "mode": "chat", - "supports_vision": false, - "source": "https://wandb.ai/site/pricing/tokens/" + "supports_xhigh_reasoning_effort": true }, - "wandb/JetBrains/Mellum2-12B-A2.5B-Instruct": { - "deprecation_date": "2026-10-05", - "max_tokens": 131072, - "max_input_tokens": 131000, - "input_cost_per_token": 5e-08, - "output_cost_per_token": 1e-07, - "litellm_provider": "wandb", + "bedrock/us-gov-east-1/anthropic.claude-opus-4-8": { + "bedrock_converse_supports_strict_tools": false, + "bedrock_output_config_effort_ceiling": "xhigh", + "cache_creation_input_token_cost": 7.5e-06, + "cache_creation_input_token_cost_above_1hr": 1.2e-05, + "cache_read_input_token_cost": 6e-07, + "input_cost_per_token": 6e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "supports_vision": false, - "source": "https://wandb.ai/site/pricing/tokens/" + "output_cost_per_token": 3e-05, + "prompt_cache_min_tokens": 1024, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true }, - "wandb/meta-llama/Llama-3.1-70B-Instruct": { - "deprecation_date": "2026-10-05", + "bedrock/us-gov-east-1/anthropic.claude-opus-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 7.5e-06, + "cache_creation_input_token_cost_above_1hr": 1.2e-05, + "cache_read_input_token_cost": 6e-07, + "input_cost_per_token": 6e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, "max_tokens": 128000, - "max_input_tokens": 131000, - "input_cost_per_token": 8e-07, - "output_cost_per_token": 8e-07, - "litellm_provider": "wandb", "mode": "chat", - "supports_vision": false, - "source": "https://wandb.ai/site/pricing/tokens/" - }, - "wandb/MiniMaxAI/MiniMax-M3": { - "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 2.3e-07, - "output_cost_per_token": 9.6e-07, - "cache_read_input_token_cost": 5e-08, + "output_cost_per_token": 3e-05, + "prompt_cache_min_tokens": 512, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, "supports_prompt_caching": true, - "litellm_provider": "wandb", - "mode": "chat", - "supports_vision": true, - "source": "https://wandb.ai/site/pricing/tokens/" - }, - "wandb/moonshotai/Kimi-K2.7-Code": { "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 7.1e-07, - "output_cost_per_token": 3.5e-06, - "cache_read_input_token_cost": 1.5e-07, - "supports_prompt_caching": true, - "litellm_provider": "wandb", - "mode": "chat", + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, "supports_vision": true, - "source": "https://wandb.ai/site/pricing/tokens/" + "supports_xhigh_reasoning_effort": true }, - "wandb/moonshotai/Kimi-K2.6": { - "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 6.5e-07, - "output_cost_per_token": 3.41e-06, - "cache_read_input_token_cost": 1.5e-07, - "supports_prompt_caching": true, - "litellm_provider": "wandb", + "bedrock/us-gov-east-1/anthropic.claude-opus-5-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 6e-06, + "cache_creation_input_token_cost_above_1hr": 9.6e-06, + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 4.8e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "supports_vision": true, - "source": "https://wandb.ai/site/pricing/tokens/" - }, - "wandb/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B": { - "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 7e-08, - "output_cost_per_token": 2e-07, - "cache_read_input_token_cost": 4e-08, + "output_cost_per_token": 2.4e-05, + "prompt_cache_min_tokens": 512, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, "supports_prompt_caching": true, - "litellm_provider": "wandb", - "mode": "chat", - "supports_vision": false, - "source": "https://wandb.ai/site/pricing/tokens/" - }, - "wandb/nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B": { "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 5e-07, - "output_cost_per_token": 2.15e-06, - "cache_read_input_token_cost": 1e-07, - "supports_prompt_caching": true, - "litellm_provider": "wandb", - "mode": "chat", - "supports_vision": false, - "source": "https://wandb.ai/site/pricing/tokens/" + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "thinking_always_on": true, + "supports_forced_tool_use": false, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "wandb/OpenPipe/Qwen3-14B-Instruct": { - "deprecation_date": "2026-10-05", - "max_tokens": 32768, - "max_input_tokens": 32800, - "input_cost_per_token": 5e-08, - "output_cost_per_token": 2.2e-07, - "litellm_provider": "wandb", + "bedrock/us-gov-east-1/anthropic.claude-fable-5-1": { + "cache_creation_input_token_cost": 1.5e-05, + "cache_creation_input_token_cost_above_1hr": 2.4e-05, + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 1.2e-05, + "litellm_provider": "bedrock", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "supports_vision": false, - "source": "https://wandb.ai/site/pricing/tokens/" - }, - "wandb/Qwen/Qwen3.8-27B": { - "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 4e-07, - "output_cost_per_token": 3e-06, - "cache_read_input_token_cost": 1.5e-07, + "output_cost_per_token": 6e-05, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_forced_tool_use": false, + "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, - "litellm_provider": "wandb", - "mode": "chat", + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, "supports_vision": true, - "source": "https://wandb.ai/site/pricing/tokens/" + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512 }, - "wandb/Qwen/Qwen3.6-35B-A3B": { + "bedrock_mantle/us-gov-west-1/openai.gpt-5.6-terra": { + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_minimal_reasoning_effort": false, + "supports_prompt_caching": true, "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 1.25e-06, - "litellm_provider": "wandb", - "mode": "chat", + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_xhigh_reasoning_effort": true, "supports_vision": true, - "source": "https://wandb.ai/site/pricing/tokens/" + "input_cost_per_token": 2.64e-06, + "input_cost_per_token_above_272k_tokens": 5.28e-06, + "cache_creation_input_token_cost": 3.3e-06, + "cache_creation_input_token_cost_above_272k_tokens": 6.6e-06, + "cache_read_input_token_cost": 2.64e-07, + "cache_read_input_token_cost_above_272k_tokens": 5.28e-07, + "output_cost_per_token": 1.584e-05, + "output_cost_per_token_above_272k_tokens": 2.376e-05 }, - "wandb/Qwen/Qwen3.6-27B": { - "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 6e-07, - "output_cost_per_token": 3.6e-06, - "cache_read_input_token_cost": 1.2e-07, - "deprecation_date": "2026-10-05", + "bedrock_mantle/us-gov-west-1/openai.gpt-5.6-luna": { + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_minimal_reasoning_effort": false, "supports_prompt_caching": true, - "litellm_provider": "wandb", - "mode": "chat", + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_xhigh_reasoning_effort": true, "supports_vision": true, - "source": "https://wandb.ai/site/pricing/tokens/" + "input_cost_per_token": 2.64e-07, + "input_cost_per_token_above_272k_tokens": 5.28e-07, + "cache_creation_input_token_cost": 3.3e-07, + "cache_creation_input_token_cost_above_272k_tokens": 6.6e-07, + "cache_read_input_token_cost": 2.64e-08, + "cache_read_input_token_cost_above_272k_tokens": 5.28e-08, + "output_cost_per_token": 1.584e-06, + "output_cost_per_token_above_272k_tokens": 2.376e-06 }, - "wandb/Qwen/Qwen3.5-35B-A3B": { - "deprecation_date": "2026-10-05", + "bedrock_mantle/us-gov-west-1/openai.gpt-5.4": { + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_minimal_reasoning_effort": false, + "supports_prompt_caching": true, "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 1.25e-06, - "litellm_provider": "wandb", - "mode": "chat", + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_xhigh_reasoning_effort": true, "supports_vision": true, - "source": "https://wandb.ai/site/pricing/tokens/" + "input_cost_per_token": 3.3e-06, + "cache_read_input_token_cost": 3.3e-07, + "output_cost_per_token": 1.98e-05 }, - "wandb/Qwen/Qwen3-30B-A3B-Instruct-2507": { - "deprecation_date": "2026-10-05", - "max_tokens": 262144, - "max_input_tokens": 262000, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 3e-07, - "litellm_provider": "wandb", + "bedrock_mantle/us-gov-west-1/xai.grok-4.3": { + "use_openai_responses_path": true, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1048576, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "supports_vision": false, - "source": "https://wandb.ai/site/pricing/tokens/" + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "source": "https://aws.amazon.com/bedrock/pricing/", + "input_cost_per_token": 1.5e-06, + "output_cost_per_token": 3e-06, + "cache_read_input_token_cost": 2.4e-07 }, - "wandb/deepseek-ai/DeepSeek-V4-Pro-0813": { - "litellm_provider": "wandb", + "bedrock_mantle/us-gov-west-1/xai.grok-4.6": { + "use_openai_responses_path": true, + "input_cost_per_token": 2.64e-06, + "output_cost_per_token": 7.92e-06, + "cache_read_input_token_cost": 6.6e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "supports_reasoning": true, - "input_cost_per_token": 1.31e-06, - "output_cost_per_token": 3.96e-06, - "cache_read_input_token_cost": 4.4e-08, - "max_input_tokens": 1049000, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, "supports_prompt_caching": true, - "source": "https://wandb.ai/site/pricing/tokens/" + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "wandb/ibm-granite/granite-4.2-8b": { - "litellm_provider": "wandb", + "bedrock_mantle/us-gov-west-1/google.gemma-4-e2b": { + "input_cost_per_token": 4.8e-08, + "output_cost_per_token": 9.6e-08, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 128000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": false, "supports_reasoning": true, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 1.5e-07, - "cache_read_input_token_cost": 5e-08, - "max_input_tokens": 131000, - "supports_prompt_caching": true, - "source": "https://wandb.ai/site/pricing/tokens/" + "supports_tool_choice": true, + "supports_vision": true }, - "wandb/zai-org/GLM-5.2": { + "bedrock_mantle/us-gov-west-1/google.gemma-4-26b-a4b": { + "input_cost_per_token": 1.56e-07, + "output_cost_per_token": 4.8e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, + "mode": "chat", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": false, "supports_reasoning": true, - "max_tokens": 262144, - "max_input_tokens": 1049000, - "input_cost_per_token": 7.6e-07, - "output_cost_per_token": 2.42e-06, - "cache_read_input_token_cost": 1.4e-07, - "supports_prompt_caching": true, - "litellm_provider": "wandb", + "supports_tool_choice": true, + "supports_vision": true + }, + "bedrock_mantle/us-gov-west-1/google.gemma-4-31b": { + "input_cost_per_token": 1.68e-07, + "output_cost_per_token": 4.8e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, "mode": "chat", - "supports_vision": false, - "source": "https://wandb.ai/site/pricing/tokens/" + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supports_function_calling": true, + "supports_parallel_function_calling": false, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true }, - "deepinfra/openai/gpt-oss-120b-Turbo": { - "max_tokens": 131072, + "bedrock_mantle/us-gov-west-1/openai.gpt-oss-20b": { + "input_cost_per_token": 8.4e-08, + "output_cost_per_token": 3.6e-07, + "litellm_provider": "bedrock_mantle", "max_input_tokens": 131072, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "litellm_provider": "deepinfra", + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, + "supports_parallel_function_calling": true, "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_response_schema": true, + "supports_tool_choice": true }, - "deepinfra/MiniMaxAI/MiniMax-M2.7": { - "max_tokens": 196608, - "max_input_tokens": 196608, - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 1e-06, - "cache_read_input_token_cost": 5e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "bedrock_mantle/us-gov-west-1/openai.gpt-oss-120b": { + "input_cost_per_token": 1.8e-07, + "output_cost_per_token": 7.2e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, + "supports_parallel_function_calling": true, "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_response_schema": true, + "supports_tool_choice": true }, - "deepinfra/Qwen/Qwen3.8-27B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 4e-07, - "output_cost_per_token": 3e-06, - "cache_read_input_token_cost": 4e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "bedrock_mantle/us-gov-west-1/anthropic.claude-opus-5-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 6e-06, + "cache_creation_input_token_cost_above_1hr": 9.6e-06, + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 4.8e-06, + "litellm_provider": "bedrock_mantle", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "output_cost_per_token": 2.4e-05, + "prompt_cache_min_tokens": 512, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "supports_xhigh_reasoning_effort": true, + "thinking_always_on": true, + "supports_forced_tool_use": false, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-anthropic-claude-opus-5-5.html" }, - "deepinfra/google/gemma-4-31B-it-Ultra": { - "max_tokens": 131072, - "max_input_tokens": 131072, - "input_cost_per_token": 2.7e-07, - "output_cost_per_token": 7.6e-07, - "litellm_provider": "deepinfra", + "bedrock_mantle/us-gov-west-1/anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "bedrock_output_config_effort_ceiling": "xhigh", + "cache_creation_input_token_cost": 3e-06, + "cache_creation_input_token_cost_above_1hr": 4.8e-06, + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 2.4e-06, + "litellm_provider": "bedrock_mantle", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "output_cost_per_token": 1.2e-05, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "supports_xhigh_reasoning_effort": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-anthropic-claude-sonnet-5-5.html" }, - "deepinfra/moonshotai/Kimi-K2.5": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 4.5e-07, - "output_cost_per_token": 2.25e-06, - "cache_read_input_token_cost": 7e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "bedrock_mantle/us-gov-east-1/openai.gpt-5.4": { + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "responses", + "use_openai_responses_path": true, + "supported_endpoints": [ + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, + "supports_minimal_reasoning_effort": false, + "supports_prompt_caching": true, "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_xhigh_reasoning_effort": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 3.3e-06, + "cache_read_input_token_cost": 3.3e-07, + "output_cost_per_token": 1.98e-05 }, - "deepinfra/zai-org/GLM-4.7-Flash": { - "max_tokens": 202752, - "max_input_tokens": 202752, - "input_cost_per_token": 6e-08, - "output_cost_per_token": 4e-07, - "cache_read_input_token_cost": 1e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "bedrock_mantle/us-gov-east-1/xai.grok-4.6": { + "use_openai_responses_path": true, + "input_cost_per_token": 2.64e-06, + "output_cost_per_token": 7.92e-06, + "cache_read_input_token_cost": 6.6e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "deepinfra/zai-org/GLM-4.6": { - "max_tokens": 202752, - "max_input_tokens": 202752, - "input_cost_per_token": 5e-07, - "output_cost_per_token": 2e-06, - "cache_read_input_token_cost": 1e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "bedrock_mantle/us-gov-east-1/openai.gpt-oss-20b": { + "input_cost_per_token": 8.4e-08, + "output_cost_per_token": 3.6e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, + "supports_parallel_function_calling": true, "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_response_schema": true, + "supports_tool_choice": true }, - "deepinfra/anthropic/claude-opus-4-8": { - "input_cost_per_token": 5e-06, - "litellm_provider": "deepinfra", - "max_input_tokens": 1000000, - "max_tokens": 1000000, + "bedrock_mantle/us-gov-east-1/openai.gpt-oss-120b": { + "input_cost_per_token": 1.8e-07, + "output_cost_per_token": 7.2e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 2.5e-05, - "prompt_cache_min_tokens": 1024, - "source": "https://deepinfra.com/pricing", - "supports_adaptive_thinking": true, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], "supports_function_calling": true, + "supports_parallel_function_calling": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, - "supports_tool_choice": true, - "supports_vision": true + "supports_tool_choice": true }, - "deepinfra/anthropic/claude-sonnet-4-6": { - "max_tokens": 1000000, - "max_input_tokens": 1000000, - "input_cost_per_token": 3e-06, - "output_cost_per_token": 1.5e-05, - "litellm_provider": "deepinfra", + "bedrock_mantle/deepseek.v3.1": { + "input_cost_per_token": 5.8e-07, + "output_cost_per_token": 1.68e-06, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 128000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", - "prompt_cache_min_tokens": 1024, + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_adaptive_thinking": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-deepseek-deepseek-v3-1.html" }, - "deepinfra/google/gemini-3.5-flash": { - "max_tokens": 1000000, - "max_input_tokens": 1000000, - "input_cost_per_token": 1.5e-06, - "output_cost_per_token": 9e-06, - "litellm_provider": "deepinfra", + "bedrock_mantle/moonshotai.kimi-k2-thinking": { + "input_cost_per_token": 6e-07, + "output_cost_per_token": 2.5e-06, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 256000, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing", - "supports_audio_input": true + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-moonshot-ai-kimi-k2-thinking.html" }, - "deepinfra/XiaomiMiMo/MiMo-V2.5": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 4e-07, - "output_cost_per_token": 2e-06, - "cache_read_input_token_cost": 8e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "bedrock_mantle/qwen.qwen3-235b-a22b-2507": { + "input_cost_per_token": 2.2e-07, + "output_cost_per_token": 8.8e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 256000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-qwen-qwen3-235b-a22b-2507.html" }, - "deepinfra/Qwen/Qwen3-Max": { - "max_tokens": 256000, - "max_input_tokens": 256000, - "input_cost_per_token": 1.2e-06, - "output_cost_per_token": 6e-06, - "cache_read_input_token_cost": 2.4e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "bedrock_mantle/qwen.qwen3-32b": { + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 32000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_reasoning": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-qwen-qwen3-32b.html" }, - "deepinfra/google/gemma-4-31B-it-turbo": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 9e-08, - "output_cost_per_token": 3.4e-07, - "cache_read_input_token_cost": 5e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "bedrock_mantle/qwen.qwen3-coder-30b-a3b-instruct": { + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 256000, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, "supports_tool_choice": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-qwen-qwen3-coder-30b-a3b-instruct.html" }, - "deepinfra/thinkingmachines/Inkling-Small": { - "max_tokens": 524288, - "max_input_tokens": 524288, + "bedrock_mantle/qwen.qwen3-coder-480b-a35b-instruct": { "input_cost_per_token": 4.5e-07, - "output_cost_per_token": 1.2e-06, - "cache_read_input_token_cost": 1e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "output_cost_per_token": 1.8e-06, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 128000, + "max_output_tokens": 16000, + "max_tokens": 16000, "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-qwen-qwen3-coder-480b-a35b-instruct.html" }, - "deepinfra/meta-models/Muse-Glimmer-30B": { - "max_tokens": 131072, - "max_input_tokens": 131072, - "input_cost_per_token": 3e-07, + "bedrock_mantle/qwen.qwen3-next-80b-a3b-instruct": { + "input_cost_per_token": 1.4e-07, "output_cost_per_token": 1.2e-06, - "cache_read_input_token_cost": 4e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 256000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-qwen-qwen3-next-80b-a3b.html" }, - "deepinfra/Qwen/Qwen3-Max-Thinking": { - "max_tokens": 256000, + "bedrock_mantle/qwen.qwen3-vl-235b-a22b-instruct": { + "input_cost_per_token": 5.3e-07, + "output_cost_per_token": 2.66e-06, + "litellm_provider": "bedrock_mantle", "max_input_tokens": 256000, - "input_cost_per_token": 1.2e-06, - "output_cost_per_token": 6e-06, - "cache_read_input_token_cost": 2.4e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", + "supported_endpoints": [ + "/v1/chat/completions" + ], "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_vision": true, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-qwen-qwen3-vl-235b-a22b.html" }, - "deepinfra/Qwen/Qwen3-VL-235B-A22B-Instruct": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 8.8e-07, - "cache_read_input_token_cost": 1.1e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "azure/us-gov/gpt-5.1": { + "cache_read_input_token_cost": 1.71875e-07, + "default_reasoning_effort": "none", + "input_cost_per_token": 1.71875e-06, + "litellm_provider": "azure", + "max_input_tokens": 272000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "output_cost_per_token": 1.375e-05, + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text", + "image" + ], "supports_function_calling": true, - "supports_tool_choice": true, + "supports_native_streaming": true, + "supports_none_reasoning_effort": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true }, - "deepinfra/Qwen/Qwen3-VL-30B-A3B-Instruct": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "litellm_provider": "deepinfra", + "azure/us-gov/o3-mini": { + "cache_read_input_token_cost": 7.57e-07, + "input_cost_per_token": 1.513e-06, + "litellm_provider": "azure", + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, "mode": "chat", - "supports_function_calling": true, - "supports_tool_choice": true, + "output_cost_per_token": 6.05e-06, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "supports_tool_choice": true, + "supports_vision": false }, - "deepinfra/Qwen/Qwen3.5-27B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 2.6e-07, - "output_cost_per_token": 2.6e-06, - "litellm_provider": "deepinfra", + "azure/us-gov/text-embedding-3-large": { + "input_cost_per_token": 1.63e-07, + "litellm_provider": "azure", + "max_input_tokens": 8191, + "max_tokens": 8191, + "mode": "embedding", + "output_cost_per_token": 0.0 + }, + "azure/us-gov/text-embedding-3-small": { + "input_cost_per_token": 2.5e-08, + "litellm_provider": "azure", + "max_input_tokens": 8191, + "max_tokens": 8191, + "mode": "embedding", + "output_cost_per_token": 0.0 + }, + "cloudflare/@cf/openai/whisper": { + "input_cost_per_second": 7.5e-06, + "litellm_provider": "cloudflare", + "mode": "audio_transcription", + "output_cost_per_second": 0.0, + "rpm": 720, + "source": "https://developers.cloudflare.com/workers-ai/models/whisper/", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ] + }, + "cloudflare/@cf/openai/whisper-large-v3-turbo": { + "input_cost_per_second": 8.5e-06, + "litellm_provider": "cloudflare", + "mode": "audio_transcription", + "output_cost_per_second": 0.0, + "rpm": 720, + "source": "https://developers.cloudflare.com/workers-ai/models/whisper-large-v3-turbo/", + "supported_endpoints": [ + "/v1/audio/transcriptions" + ] + }, + "gemini/lyria-3.5-clip-preview": { + "input_cost_per_token": 0, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "output_cost_per_image": 0.04, + "output_cost_per_token": 0, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "audio" + ], + "supports_audio_input": false, + "supports_audio_output": true, + "supports_function_calling": false, + "supports_prompt_caching": false, + "supports_response_schema": false, + "supports_system_messages": false, + "supports_vision": false, + "supports_web_search": false }, - "deepinfra/Qwen/Qwen3.6-35B-A3B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 9.5e-07, - "litellm_provider": "deepinfra", + "gemini/lyria-3.5-pro-preview": { + "input_cost_per_token": 0, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "output_cost_per_token": 0, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "audio" + ], + "supports_audio_input": false, + "supports_audio_output": true, + "supports_function_calling": false, + "supports_prompt_caching": false, + "supports_response_schema": false, + "supports_system_messages": false, + "supports_vision": false, + "supports_web_search": false, + "output_cost_per_image": 0.08 }, - "deepinfra/nvidia/Nemotron-Content-Safety-3.5": { - "max_tokens": 131072, + "gemini/lyria-3.5": { + "input_cost_per_token": 0, + "litellm_provider": "gemini", "max_input_tokens": 131072, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "deepinfra", + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "output_cost_per_token": 0, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "audio" + ], + "supports_audio_input": false, + "supports_audio_output": true, + "supports_function_calling": false, + "supports_prompt_caching": false, + "supports_response_schema": false, + "supports_system_messages": false, + "supports_vision": false, + "supports_web_search": false, + "output_cost_per_image": 0.08 }, - "deepinfra/anthropic/claude-opus-5": { - "input_cost_per_token": 5e-06, - "litellm_provider": "deepinfra", - "max_input_tokens": 1000000, - "max_tokens": 1000000, + "gemini/lyria-realtime-exp": { + "input_cost_per_token": 0, + "litellm_provider": "gemini", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 2.5e-05, + "output_cost_per_token": 0, + "source": "https://ai.google.dev/gemini-api/docs/models/lyria-realtime-exp", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "audio" + ], + "supports_audio_input": false, + "supports_audio_output": true, + "supports_function_calling": false, + "supports_prompt_caching": false, + "supports_response_schema": false, + "supports_system_messages": false, + "supports_vision": false, + "supports_web_search": false, + "output_cost_per_image": 0.08 + }, + "perplexity/anthropic/claude-fable-5": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_web_search": true, + "supports_function_calling": true, + "input_cost_per_token": 1e-05, + "output_cost_per_token": 5e-05, + "cache_read_input_token_cost": 1e-06, + "source": "https://docs.perplexity.ai/docs/agent-api/models" + }, + "perplexity/anthropic/claude-opus-5": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_adaptive_thinking": true, "prompt_cache_min_tokens": 512, - "source": "https://deepinfra.com/pricing", + "supports_web_search": true, + "supports_function_calling": true, + "input_cost_per_token": 5e-06, + "output_cost_per_token": 2.5e-05, + "cache_read_input_token_cost": 5e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" + }, + "perplexity/anthropic/claude-opus-4-8": { + "litellm_provider": "perplexity", + "mode": "responses", "supports_adaptive_thinking": true, + "supports_web_search": true, "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_sampling_params": false, - "supports_tool_choice": true, - "supports_vision": true + "input_cost_per_token": 5e-06, + "output_cost_per_token": 2.5e-05, + "cache_read_input_token_cost": 5e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/thinkingmachines/Inkling": { - "max_tokens": 524288, - "max_input_tokens": 524288, - "input_cost_per_token": 9.5e-07, - "output_cost_per_token": 4.05e-06, - "cache_read_input_token_cost": 1.6e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/anthropic/claude-sonnet-5": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_adaptive_thinking": true, + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1e-05, + "cache_read_input_token_cost": 2e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/moonshotai/Kimi-K2.6": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 7.5e-07, - "output_cost_per_token": 3.5e-06, - "cache_read_input_token_cost": 1.5e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/anthropic/claude-sonnet-4-6": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 3e-06, + "output_cost_per_token": 1.5e-05, + "cache_read_input_token_cost": 3e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/deepseek-ai/DeepSeek-V4-Pro-0813": { - "max_tokens": 1048576, - "max_input_tokens": 1048576, - "input_cost_per_token": 1.3e-06, - "output_cost_per_token": 2.6e-06, - "cache_read_input_token_cost": 1e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/openai/gpt-5.6-sol": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 4e-06, + "output_cost_per_token": 2e-05, + "cache_read_input_token_cost": 4e-07, + "input_cost_per_token_above_272k_tokens": 8e-06, + "output_cost_per_token_above_272k_tokens": 3e-05, + "cache_read_input_token_cost_above_272k_tokens": 8e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/Qwen/Qwen3.7-Max": { - "max_tokens": 256000, - "max_input_tokens": 256000, - "input_cost_per_token": 2.5e-06, - "output_cost_per_token": 7.5e-06, - "cache_read_input_token_cost": 5e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/openai/gpt-5.6-terra": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1.2e-05, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token_above_272k_tokens": 4e-06, + "output_cost_per_token_above_272k_tokens": 1.8e-05, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/ByteDance/Seed-2.0-mini": { - "max_tokens": 256000, - "max_input_tokens": 256000, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 4e-07, + "perplexity/openai/gpt-5.6-luna": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, + "supports_function_calling": true, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 1.2e-06, "cache_read_input_token_cost": 2e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "input_cost_per_token_above_272k_tokens": 4e-07, + "output_cost_per_token_above_272k_tokens": 1.8e-06, + "cache_read_input_token_cost_above_272k_tokens": 4e-08, + "source": "https://docs.perplexity.ai/docs/agent-api/models" + }, + "perplexity/openai/gpt-5.5": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 5e-06, + "output_cost_per_token": 3e-05, + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token_above_272k_tokens": 1e-05, + "output_cost_per_token_above_272k_tokens": 4.5e-05, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/Qwen/Qwen3.8-2.4T-A95B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 2e-06, - "output_cost_per_token": 6e-06, - "cache_read_input_token_cost": 2e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/openai/gpt-5.4": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 2.5e-06, + "output_cost_per_token": 1.5e-05, + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token_above_272k_tokens": 5e-06, + "output_cost_per_token_above_272k_tokens": 2.25e-05, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/MiniMaxAI/MiniMax-M3": { - "max_tokens": 524288, - "max_input_tokens": 524288, - "input_cost_per_token": 2.8e-07, - "output_cost_per_token": 1.1e-06, - "cache_read_input_token_cost": 5.6e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/openai/gpt-5.4-mini": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 7.5e-07, + "output_cost_per_token": 4.5e-06, + "cache_read_input_token_cost": 7.5e-08, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/google/gemini-3.1-flash-lite": { - "max_tokens": 1000000, - "max_input_tokens": 1000000, - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 1.5e-06, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/openai/gpt-5.4-nano": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing", - "supports_audio_input": true + "input_cost_per_token": 2e-07, + "output_cost_per_token": 1.25e-06, + "cache_read_input_token_cost": 2e-08, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/google/gemini-3.7-flash": { - "max_tokens": 1000000, - "max_input_tokens": 1000000, - "input_cost_per_token": 7.5e-07, - "output_cost_per_token": 3.75e-06, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/openai/gpt-5": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing", - "supports_audio_input": true + "input_cost_per_token": 1.25e-06, + "output_cost_per_token": 1e-05, + "cache_read_input_token_cost": 1.25e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/inclusionAI/Ling-3.0-flash": { - "max_tokens": 131072, - "max_input_tokens": 131072, - "input_cost_per_token": 6e-08, - "output_cost_per_token": 1.8e-07, - "cache_read_input_token_cost": 1.2e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/google/gemini-3.1-pro-preview": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1.2e-05, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token_above_200k_tokens": 4e-06, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/stepfun-ai/Step-3.7-Flash": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 1.15e-06, - "cache_read_input_token_cost": 4e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/google/gemini-3.1-flash-lite": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 1.5e-06, + "cache_read_input_token_cost": 2.5e-08, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/Qwen/Qwen3.5-35B-A3B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 1.4e-07, - "output_cost_per_token": 1e-06, - "cache_read_input_token_cost": 5e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/google/gemini-3.5-flash": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 1.5e-06, + "output_cost_per_token": 9e-06, + "cache_read_input_token_cost": 1.5e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/ByteDance/Seed-1.8": { - "max_tokens": 256000, - "max_input_tokens": 256000, - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 2e-06, - "cache_read_input_token_cost": 5e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/google/gemini-3.5-flash-lite": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 3e-07, + "output_cost_per_token": 2.5e-06, + "cache_read_input_token_cost": 3e-08, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/tencent/Hy3": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 1.4e-07, - "output_cost_per_token": 5.8e-07, - "cache_read_input_token_cost": 3.5e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/google/gemini-3.6-flash": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 1.5e-06, + "output_cost_per_token": 7.5e-06, + "cache_read_input_token_cost": 1.5e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/ByteDance/Seed-2.0-code": { - "max_tokens": 256000, - "max_input_tokens": 256000, - "input_cost_per_token": 5e-07, - "output_cost_per_token": 3e-06, - "cache_read_input_token_cost": 1e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/google/gemini-3.7-flash": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 7.5e-07, + "output_cost_per_token": 3.75e-06, + "cache_read_input_token_cost": 7.5e-08, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/ByteDance/Seed-2.0-pro": { - "max_tokens": 256000, - "max_input_tokens": 256000, - "input_cost_per_token": 5e-07, - "output_cost_per_token": 3e-06, - "cache_read_input_token_cost": 1e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/xai/grok-4.6": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 2e-06, + "output_cost_per_token": 6e-06, + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token_above_200k_tokens": 4e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "cache_read_input_token_cost_above_200k_tokens": 1e-06, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/zai-org/GLM-5": { - "max_tokens": 202752, - "max_input_tokens": 202752, - "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.08e-06, - "cache_read_input_token_cost": 1.2e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/xai/grok-4.5": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 2e-06, + "output_cost_per_token": 6e-06, + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token_above_200k_tokens": 4e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/nvidia/Nemotron-3-Nano-30B-A3B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 5e-08, - "output_cost_per_token": 2e-07, - "cache_read_input_token_cost": 2.5e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/xai/grok-4.3": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 1.25e-06, + "output_cost_per_token": 2.5e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/moonshotai/Kimi-K2.7-Code": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 6.8e-07, - "output_cost_per_token": 3.4e-06, - "cache_read_input_token_cost": 1.36e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/xai/grok-4.20-reasoning": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 1.25e-06, + "output_cost_per_token": 2.5e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/anthropic/claude-sonnet-5": { - "input_cost_per_token": 2e-06, - "litellm_provider": "deepinfra", - "max_input_tokens": 1000000, - "max_tokens": 1000000, - "mode": "chat", - "output_cost_per_token": 1e-05, - "prompt_cache_min_tokens": 1024, - "source": "https://deepinfra.com/pricing", - "supports_adaptive_thinking": true, + "perplexity/xai/grok-4.20-non-reasoning": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_sampling_params": false, - "supports_tool_choice": true, - "supports_vision": true + "input_cost_per_token": 1.25e-06, + "output_cost_per_token": 2.5e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/Qwen/Qwen3.5-397B-A17B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 4.5e-07, - "output_cost_per_token": 3e-06, - "cache_read_input_token_cost": 2.2e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/xai/grok-4.20-multi-agent": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, + "supports_function_calling": true, + "input_cost_per_token": 1.25e-06, + "output_cost_per_token": 2.5e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "source": "https://docs.perplexity.ai/docs/agent-api/models" + }, + "perplexity/perplexity/glm-5.3": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, + "supports_function_calling": true, + "input_cost_per_token": 1.4e-06, + "output_cost_per_token": 4.4e-06, + "cache_read_input_token_cost": 2.6e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" + }, + "perplexity/perplexity/glm-5.3-flash": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 5e-07, + "cache_read_input_token_cost": 3e-08, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/deepseek-ai/DeepSeek-V4-Flash-0731": { - "max_tokens": 1048576, - "max_input_tokens": 1048576, - "input_cost_per_token": 8e-08, - "output_cost_per_token": 1.8e-07, - "cache_read_input_token_cost": 1.6e-08, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/perplexity/nemotron-3.5-lightning-30b-a3b": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 1.15e-08, + "output_cost_per_token": 1.7e-07, + "cache_read_input_token_cost": 1.15e-09, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/google/gemma-4-E4B-it": { - "max_tokens": 131072, - "max_input_tokens": 131072, - "input_cost_per_token": 2e-08, - "output_cost_per_token": 1e-07, - "litellm_provider": "deepinfra", - "mode": "chat", + "perplexity/perplexity/nemotron-3-ultra-550b-a55b": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_web_search": true, "supports_function_calling": true, - "supports_tool_choice": true, "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 2.5e-06, + "cache_read_input_token_cost": 2.5e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "deepinfra/deepseek-ai/DeepSeek-V3.2": { - "max_tokens": 163840, - "max_input_tokens": 163840, - "input_cost_per_token": 2.6e-07, - "output_cost_per_token": 3.8e-07, - "cache_read_input_token_cost": 1.3e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "openrouter/anthropic/claude-fable-5": { + "input_cost_per_token": 1e-05, + "output_cost_per_token": 5e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "supports_sampling_params": false, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" - }, - "deepinfra/Qwen/Qwen3.8-Max": { - "max_tokens": 256000, - "max_input_tokens": 256000, - "input_cost_per_token": 1.65e-06, - "output_cost_per_token": 4.951e-06, - "cache_read_input_token_cost": 2.06e-07, + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 1e-06, "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "cache_creation_input_token_cost": 1.25e-05, + "cache_creation_input_token_cost_above_1hr": 2e-05, + "prompt_cache_min_tokens": 512, + "supports_web_search": true }, - "deepinfra/anthropic/claude-fable-5": { + "openrouter/anthropic/claude-fable-5.1": { "input_cost_per_token": 1e-05, - "litellm_provider": "deepinfra", + "output_cost_per_token": 5e-05, + "litellm_provider": "openrouter", "max_input_tokens": 1000000, - "max_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 5e-05, - "prompt_cache_min_tokens": 512, - "source": "https://deepinfra.com/pricing", + "supports_sampling_params": false, "supports_adaptive_thinking": true, + "thinking_always_on": true, + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, - "supports_tool_choice": true, "supports_vision": true, - "thinking_always_on": true - }, - "deepinfra/nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 5e-07, - "output_cost_per_token": 2.2e-06, - "cache_read_input_token_cost": 1e-07, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2.5e-07, "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "cache_creation_input_token_cost": 1.25e-05, + "cache_creation_input_token_cost_above_1hr": 2e-05, + "prompt_cache_min_tokens": 512, + "supports_web_search": true + }, + "openrouter/anthropic/claude-opus-4.8": { + "input_cost_per_token": 5e-06, + "output_cost_per_token": 2.5e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "supports_sampling_params": false, + "supports_adaptive_thinking": true, + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 5e-07, + "supports_prompt_caching": true, + "cache_creation_input_token_cost": 6.25e-06, + "cache_creation_input_token_cost_above_1hr": 1e-05, + "supports_web_search": true }, - "deepinfra/Qwen/Qwen3.5-122B-A10B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 2.9e-07, - "output_cost_per_token": 2.4e-06, - "litellm_provider": "deepinfra", + "openrouter/anthropic/claude-sonnet-5": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "supports_sampling_params": false, + "supports_adaptive_thinking": true, + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing" - }, - "deepinfra/zai-org/GLM-5.1": { - "max_tokens": 202752, - "max_input_tokens": 202752, - "input_cost_per_token": 1.05e-06, - "output_cost_per_token": 3.5e-06, - "cache_read_input_token_cost": 2.05e-07, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2e-07, "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_1hr": 4e-06, + "supports_web_search": true }, - "deepinfra/deepseek-ai/DeepSeek-V4-Pro": { - "max_tokens": 1048576, + "openrouter/google/gemini-2.5-flash-lite": { + "cache_creation_input_token_cost": 8.33333333333333e-08, + "cache_read_input_audio_token_cost": 3e-08, + "input_cost_per_token": 1e-07, + "output_cost_per_token": 4e-07, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "input_cost_per_token": 1.3e-06, - "output_cost_per_token": 2.6e-06, - "cache_read_input_token_cost": 1e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "max_output_tokens": 65535, + "max_tokens": 65535, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": true, + "cache_read_input_token_cost": 1e-08, + "deprecation_date": "2026-10-20", + "input_cost_per_audio_token": 3e-07, + "supports_prompt_caching": true, + "supports_web_search": true, + "supports_video_input": true }, - "deepinfra/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 8.5e-08, - "output_cost_per_token": 4e-07, - "litellm_provider": "deepinfra", + "openrouter/google/gemini-3.5-flash": { + "cache_creation_input_token_cost": 8.33333333333333e-08, + "cache_read_input_audio_token_cost": 3e-07, + "input_cost_per_token": 1.5e-06, + "output_cost_per_token": 9e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_response_schema": true, + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": true, + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_audio_token": 3e-06, + "supports_prompt_caching": true, + "supports_web_search": true, + "supports_video_input": true }, - "deepinfra/zai-org/GLM-5.2": { - "max_tokens": 1048576, + "openrouter/google/gemini-3.5-flash-lite": { + "cache_creation_input_token_cost": 8.33333333333333e-08, + "cache_read_input_audio_token_cost": 3e-08, + "input_cost_per_token": 3e-07, + "output_cost_per_token": 2.5e-06, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "input_cost_per_token": 7.5e-07, - "output_cost_per_token": 2.4e-06, - "cache_read_input_token_cost": 1.4e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_response_schema": true, + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": true, + "cache_read_input_token_cost": 3e-08, + "input_cost_per_audio_token": 3e-07, + "supports_prompt_caching": true, + "supports_web_search": true, + "supports_video_input": true }, - "deepinfra/moonshotai/Kimi-K3": { - "max_tokens": 1048576, + "openrouter/google/gemini-3.6-flash": { + "cache_creation_input_token_cost": 4.16666666666667e-08, + "cache_read_input_audio_token_cost": 7.5e-08, + "input_cost_per_token": 7.5e-07, + "output_cost_per_token": 3.75e-06, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "input_cost_per_token": 2.85e-06, - "output_cost_per_token": 1.425e-05, - "cache_read_input_token_cost": 2.85e-07, - "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, + "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "supports_pdf_input": true, + "supports_audio_input": true, + "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_audio_token": 7.5e-07, + "supports_prompt_caching": true, + "supports_web_search": true, + "supports_video_input": true }, - "deepinfra/anthropic/claude-opus-4-7": { - "input_cost_per_token": 5e-06, - "litellm_provider": "deepinfra", - "max_input_tokens": 1000000, - "max_tokens": 1000000, + "openrouter/google/gemini-3.7-flash": { + "cache_creation_input_token_cost": 4.16666666666667e-08, + "cache_read_input_audio_token_cost": 7.5e-08, + "input_cost_per_token": 7.5e-07, + "output_cost_per_token": 3.75e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 2.5e-05, - "prompt_cache_min_tokens": 2048, - "source": "https://deepinfra.com/pricing", - "supports_adaptive_thinking": true, + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, - "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": true, + "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_audio_token": 7.5e-07, + "supports_prompt_caching": true, + "supports_web_search": true, + "supports_video_input": true }, - "deepinfra/Qwen/Qwen3.6-27B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 3.2e-07, - "output_cost_per_token": 3.2e-06, - "litellm_provider": "deepinfra", + "openrouter/google/gemini-3.8-flash": { + "cache_creation_input_token_cost": 4.16666666666667e-08, + "cache_read_input_audio_token_cost": 7.5e-08, + "input_cost_per_token": 7.5e-07, + "output_cost_per_token": 3.75e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "supports_pdf_input": true, + "supports_audio_input": true, + "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_audio_token": 7.5e-07, + "supports_prompt_caching": true, + "supports_web_search": true, + "supports_video_input": true }, - "deepinfra/google/gemma-4-26B-A4B-it": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 7e-08, - "output_cost_per_token": 3.4e-07, - "litellm_provider": "deepinfra", + "openrouter/openai/gpt-4o-mini": { + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, + "supports_reasoning": false, "supports_response_schema": true, - "supports_reasoning": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 7.5e-08, + "supports_prompt_caching": true, + "supports_web_search": true }, - "deepinfra/google/gemini-3.1-pro": { - "max_tokens": 1000000, - "max_input_tokens": 1000000, - "input_cost_per_token": 2e-06, - "output_cost_per_token": 1.2e-05, - "litellm_provider": "deepinfra", + "openrouter/openai/gpt-5.1": { + "input_cost_per_token": 1.25e-06, + "output_cost_per_token": 1e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing", - "supports_audio_input": true - }, - "deepinfra/XiaomiMiMo/MiMo-V2.5-Pro": { - "max_tokens": 1048576, - "max_input_tokens": 1048576, - "input_cost_per_token": 1e-06, - "output_cost_per_token": 3e-06, - "cache_read_input_token_cost": 2e-07, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 1.25e-07, "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_web_search": true }, - "deepinfra/anthropic/claude-haiku-4-5": { - "max_tokens": 200000, - "max_input_tokens": 200000, - "input_cost_per_token": 1e-06, - "output_cost_per_token": 5e-06, - "litellm_provider": "deepinfra", + "openrouter/openai/gpt-5.3-codex": { + "input_cost_per_token": 1.75e-06, + "output_cost_per_token": 1.4e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "prompt_cache_min_tokens": 4096, + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing" - }, - "deepinfra/deepseek-ai/DeepSeek-V4-Flash": { - "max_tokens": 1048576, - "max_input_tokens": 1048576, - "input_cost_per_token": 9e-08, - "output_cost_per_token": 1.8e-07, - "cache_read_input_token_cost": 1.8e-08, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 1.75e-07, "supports_prompt_caching": true, - "litellm_provider": "deepinfra", - "mode": "chat", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_web_search": true }, - "deepinfra/openai/gpt-oss-120b-Ultra": { - "max_tokens": 131072, - "max_input_tokens": 131072, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 9.5e-07, - "litellm_provider": "deepinfra", + "openrouter/openai/gpt-5.4": { + "input_cost_per_token": 2.5e-06, + "output_cost_per_token": 1.5e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_response_schema": true, + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2.5e-07, + "cache_read_input_token_cost_above_272k_tokens": 5e-07, + "input_cost_per_token_above_272k_tokens": 5e-06, + "output_cost_per_token_above_272k_tokens": 2.25e-05, + "supports_prompt_caching": true, + "supports_web_search": true }, - "deepinfra/Qwen/Qwen3.5-9B": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 1.5e-07, - "litellm_provider": "deepinfra", + "openrouter/openai/gpt-5.4-mini": { + "input_cost_per_token": 7.5e-07, + "output_cost_per_token": 4.5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, + "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing" - }, - "deepinfra/MiniMaxAI/MiniMax-M2.7-Turbo": { - "max_tokens": 196608, - "max_input_tokens": 196608, - "input_cost_per_token": 3.8e-07, - "output_cost_per_token": 1.7e-06, - "cache_read_input_token_cost": 7e-08, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 7.5e-08, "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "supports_web_search": true + }, + "openrouter/openai/gpt-5.4-nano": { + "input_cost_per_token": 2e-07, + "output_cost_per_token": 1.25e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" - }, - "deepinfra/zai-org/GLM-4.7": { - "max_tokens": 202752, - "max_input_tokens": 202752, - "input_cost_per_token": 4e-07, - "output_cost_per_token": 1.75e-06, - "cache_read_input_token_cost": 8e-08, + "supports_response_schema": true, + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2e-08, "supports_prompt_caching": true, - "litellm_provider": "deepinfra", + "supports_web_search": true + }, + "openrouter/openai/gpt-5.5": { + "input_cost_per_token": 5e-06, + "output_cost_per_token": 3e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, - "supports_vision": false, - "source": "https://deepinfra.com/pricing" + "supports_response_schema": true, + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_272k_tokens": 1e-06, + "input_cost_per_token_above_272k_tokens": 1e-05, + "output_cost_per_token_above_272k_tokens": 4.5e-05, + "supports_prompt_caching": true, + "supports_web_search": true }, - "deepinfra/google/gemma-4-31B-it": { - "max_tokens": 262144, - "max_input_tokens": 262144, - "input_cost_per_token": 1.3e-07, - "output_cost_per_token": 3.8e-07, - "litellm_provider": "deepinfra", + "openrouter/openai/gpt-5.6-luna": { + "cache_creation_input_token_cost": 2.5e-07, + "cache_creation_input_token_cost_above_272k_tokens": 5e-07, + "input_cost_per_token": 2e-07, + "output_cost_per_token": 1.2e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_tool_choice": true, - "supports_response_schema": true, "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "source": "https://deepinfra.com/pricing" + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2e-08, + "cache_read_input_token_cost_above_272k_tokens": 4e-08, + "input_cost_per_token_above_272k_tokens": 4e-07, + "output_cost_per_token_above_272k_tokens": 1.8e-06, + "supports_prompt_caching": true, + "supports_web_search": true }, - "gemini/gemini-omni-1.1-flash": { - "input_cost_per_audio_token": 1.5e-06, - "input_cost_per_token": 1.5e-06, - "litellm_provider": "gemini", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "openrouter/openai/gpt-5.6-luna-pro": { + "input_cost_per_token": 2e-07, + "output_cost_per_token": 1.2e-06, + "cache_read_input_token_cost": 2e-08, + "cache_creation_input_token_cost": 2.5e-07, + "cache_creation_input_token_cost_above_272k_tokens": 5e-07, + "input_cost_per_token_above_272k_tokens": 4e-07, + "output_cost_per_token_above_272k_tokens": 1.8e-06, + "cache_read_input_token_cost_above_272k_tokens": 4e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_reasoning_token": 9e-06, - "output_cost_per_token": 9e-06, - "output_cost_per_video_token": 1.75e-05, - "rpm": 2000, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_endpoints": [ - "/v1beta/interactions" - ], - "supported_modalities": [ - "text", - "image", - "audio", - "video" - ], - "supported_output_modalities": [ - "text", - "video" - ], - "supports_audio_input": true, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_tool_choice": true, "supports_reasoning": true, - "supports_system_messages": true, - "supports_video_input": true, + "supports_response_schema": true, "supports_vision": true, - "tpm": 800000 + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_web_search": true }, - "xai/grok-4.20": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, + "openrouter/openai/gpt-5.6-terra": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1.2e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, - "supports_reasoning": true, "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "supports_web_search": true, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "input_cost_per_token_above_272k_tokens": 4e-06, + "output_cost_per_token_above_272k_tokens": 1.8e-05, "supports_prompt_caching": true, - "supports_response_schema": true + "supports_web_search": true }, - "xai/grok-4.20-reasoning": { + "openrouter/openai/gpt-5.6-terra-pro": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1.2e-05, "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, + "output_cost_per_token_above_272k_tokens": 1.8e-05, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_reasoning": true, "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "supports_web_search": true, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_response_schema": true + "supports_web_search": true }, - "xai/grok-4.20-reasoning-latest": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, + "openrouter/openai/o3": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 8e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, - "supports_reasoning": true, "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "supports_web_search": true, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 5e-07, "supports_prompt_caching": true, - "supports_response_schema": true - }, - "xai/grok-imagine-image": { - "input_cost_per_image": 0.02, - "litellm_provider": "xai", - "mode": "image_generation", - "source": "https://docs.x.ai/docs/models", - "supported_endpoints": [ - "/v1/images/generations" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "image" - ] - }, - "xai/grok-imagine-image-2026-03-02": { - "input_cost_per_image": 0.02, - "litellm_provider": "xai", - "mode": "image_generation", - "source": "https://docs.x.ai/docs/models", - "supported_endpoints": [ - "/v1/images/generations" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "image" - ] - }, - "xai/grok-imagine-image-quality": { - "deprecation_date": "2026-11-02", - "input_cost_per_image": 0.05, - "litellm_provider": "xai", - "mode": "image_generation", - "source": "https://docs.x.ai/docs/models", - "supported_endpoints": [ - "/v1/images/generations" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "image" - ] - }, - "xai/grok-imagine-image-quality-20260403": { - "deprecation_date": "2026-11-02", - "input_cost_per_image": 0.05, - "litellm_provider": "xai", - "mode": "image_generation", - "source": "https://docs.x.ai/docs/models", - "supported_endpoints": [ - "/v1/images/generations" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "image" - ] - }, - "xai/grok-imagine-image-quality-latest": { - "deprecation_date": "2026-11-02", - "input_cost_per_image": 0.05, - "litellm_provider": "xai", - "mode": "image_generation", - "source": "https://docs.x.ai/docs/models", - "supported_endpoints": [ - "/v1/images/generations" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "image" - ] - }, - "xai/grok-imagine-image-pro": { - "input_cost_per_image": 0.05, - "litellm_provider": "xai", - "mode": "image_generation", - "source": "https://docs.x.ai/docs/models", - "supported_endpoints": [ - "/v1/images/generations" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "image" - ], - "deprecation_date": "2026-05-15" - }, - "xai/grok-imagine-image-2.0": { - "input_cost_per_image": 0.06, - "litellm_provider": "xai", - "mode": "image_generation", - "source": "https://docs.x.ai/docs/models", - "supported_endpoints": [ - "/v1/images/generations" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "image" - ] - }, - "xai/grok-imagine-video": { - "input_cost_per_image": 0.002, - "litellm_provider": "xai", - "mode": "video_generation", - "output_cost_per_second": 0.05, - "output_cost_per_second_480p": 0.05, - "output_cost_per_second_720p": 0.07, - "source": "https://docs.x.ai/docs/models/grok-imagine-video", - "supported_modalities": [ - "text", - "image", - "video" - ], - "supported_output_modalities": [ - "video" - ] - }, - "xai/grok-imagine-video-1.5": { - "input_cost_per_image": 0.01, - "litellm_provider": "xai", - "mode": "video_generation", - "output_cost_per_second": 0.08, - "output_cost_per_second_1080p": 0.25, - "output_cost_per_second_480p": 0.08, - "output_cost_per_second_720p": 0.14, - "source": "https://docs.x.ai/docs/models/grok-imagine-video-1.5", - "supported_modalities": [ - "text", - "image", - "audio" - ], - "supported_output_modalities": [ - "video" - ] - }, - "xai/grok-imagine-video-1.5-2026-05-30": { - "input_cost_per_image": 0.01, - "litellm_provider": "xai", - "mode": "video_generation", - "output_cost_per_second": 0.08, - "output_cost_per_second_1080p": 0.25, - "output_cost_per_second_480p": 0.08, - "output_cost_per_second_720p": 0.14, - "source": "https://docs.x.ai/docs/models/grok-imagine-video-1.5", - "supported_modalities": [ - "text", - "image", - "audio" - ], - "supported_output_modalities": [ - "video" - ] - }, - "xai/grok-imagine-video-1.5-preview": { - "input_cost_per_image": 0.01, - "litellm_provider": "xai", - "mode": "video_generation", - "output_cost_per_second": 0.08, - "output_cost_per_second_1080p": 0.25, - "output_cost_per_second_480p": 0.08, - "output_cost_per_second_720p": 0.14, - "source": "https://docs.x.ai/docs/models/grok-imagine-video-1.5", - "supported_modalities": [ - "text", - "image", - "audio" - ], - "supported_output_modalities": [ - "video" - ] - }, - "xai/grok-voice-transcribe-1.0": { - "input_cost_per_second": 2.778e-05, - "litellm_provider": "xai", - "metadata": { - "calculation": "$0.10/3600 seconds = $0.00002778 per second", - "original_pricing_per_hour": 0.1 - }, - "mode": "audio_transcription", - "output_cost_per_second": 0.0, - "source": "https://docs.x.ai/developers/pricing", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ] - }, - "xai/grok-voice-transcribe-2.0": { - "input_cost_per_second": 2.778e-05, - "litellm_provider": "xai", - "metadata": { - "calculation": "$0.10/3600 seconds = $0.00002778 per second", - "original_pricing_per_hour": 0.1 - }, - "mode": "audio_transcription", - "output_cost_per_second": 0.0, - "source": "https://docs.x.ai/developers/pricing", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ] - }, - "low/1024-x-1024/grok-imagine-image-2.0": { - "input_cost_per_image": 0.04, - "litellm_provider": "xai", - "mode": "image_generation", - "source": "https://docs.x.ai/docs/models", - "supported_endpoints": [ - "/v1/images/generations" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "image" - ] + "supports_web_search": true }, - "xai/grok-4.20-non-reasoning": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, + "openrouter/openai/o4-mini": { + "input_cost_per_token": 1.1e-06, + "output_cost_per_token": 4.4e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, "mode": "chat", - "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, - "supports_prompt_caching": true, "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "supports_web_search": true, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2.75e-07, + "supports_prompt_caching": true, + "supports_web_search": true }, - "xai/grok-4.20-non-reasoning-latest": { - "cache_read_input_token_cost": 2e-07, + "openrouter/x-ai/grok-4.20": { "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, - "mode": "chat", "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", + "litellm_provider": "openrouter", + "max_input_tokens": 2000000, + "max_output_tokens": 1800000, + "max_tokens": 1800000, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, - "supports_prompt_caching": true, "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "supports_web_search": true, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, "input_cost_per_token_above_200k_tokens": 2.5e-06, "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true + "supports_prompt_caching": true, + "supports_web_search": true }, - "xai/grok-4.20-multi-agent": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, - "mode": "responses", + "openrouter/x-ai/grok-4.20-multi-agent": { + "input_cost_per_token": 1.25e-06, "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", - "supported_endpoints": [ - "/v1/responses" - ], + "litellm_provider": "openrouter", + "max_input_tokens": 2000000, + "max_output_tokens": 1800000, + "max_tokens": 1800000, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": false, - "supports_prompt_caching": true, - "supports_reasoning": true, "supports_tool_choice": false, + "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "supports_web_search": true, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, "input_cost_per_token_above_200k_tokens": 2.5e-06, "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true + "supports_prompt_caching": true, + "supports_web_search": true }, - "xai/grok-4.20-multi-agent-latest": { - "cache_read_input_token_cost": 2e-07, + "openrouter/x-ai/grok-4.3": { "input_cost_per_token": 1.25e-06, - "litellm_provider": "xai", - "max_input_tokens": 1000000, - "max_output_tokens": 1000000, - "max_tokens": 1000000, - "mode": "responses", "output_cost_per_token": 2.5e-06, - "source": "https://docs.x.ai/docs/models", - "supported_endpoints": [ - "/v1/responses" - ], - "supports_function_calling": false, - "supports_prompt_caching": true, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 900000, + "max_tokens": 900000, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_function_calling": true, + "supports_tool_choice": true, "supports_reasoning": true, - "supports_tool_choice": false, + "supports_response_schema": true, "supports_vision": true, - "supports_web_search": true, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, "input_cost_per_token_above_200k_tokens": 2.5e-06, "output_cost_per_token_above_200k_tokens": 5e-06, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "supports_response_schema": true + "supports_prompt_caching": true, + "supports_web_search": true }, - "groq/qwen/qwen3.8-27b": { - "input_cost_per_token": 8e-07, - "litellm_provider": "groq", - "max_input_tokens": 131042, - "max_output_tokens": 16384, - "max_tokens": 16384, + "openrouter/x-ai/grok-4.5": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 6e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 500000, + "max_output_tokens": 450000, + "max_tokens": 450000, "mode": "chat", - "output_cost_per_token": 4e-06, - "source": "https://console.groq.com/docs/model/qwen/qwen3.8-27b", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 3e-07, + "cache_read_input_token_cost_above_200k_tokens": 6e-07, + "input_cost_per_token_above_200k_tokens": 4e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "supports_prompt_caching": true, + "supports_web_search": true }, - "mistral/mistral-medium-3.5": { - "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_token": 1.5e-06, - "litellm_provider": "mistral", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, + "openrouter/x-ai/grok-4.6": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 6e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 500000, + "max_output_tokens": 450000, + "max_tokens": 450000, "mode": "chat", - "output_cost_per_token": 7.5e-06, - "reasoning_effort_levels": [ - "none", - "high" - ], - "source": "https://docs.mistral.ai/models/model-cards/mistral-medium-3-5-26-04", - "supports_assistant_prefill": true, + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_200k_tokens": 1e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "supports_prompt_caching": true, + "supports_web_search": true + }, + "openrouter/x-ai/grok-build-0.1": { + "input_cost_per_token": 1e-06, + "output_cost_per_token": 2e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 256000, + "max_output_tokens": 230400, + "max_tokens": 230400, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_function_calling": true, "supports_tool_choice": true, - "supports_vision": true + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_token_above_200k_tokens": 2e-06, + "output_cost_per_token_above_200k_tokens": 4e-06, + "supports_prompt_caching": true, + "supports_web_search": true }, - "mistral/mistral-vibe-cli-latest": { - "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_token": 1.5e-06, - "litellm_provider": "mistral", - "max_input_tokens": 262144, + "baseten/zai-org/GLM-5.3": { + "cache_read_input_token_cost": 1.4e-07, + "input_cost_per_token": 1.4e-06, + "litellm_provider": "baseten", + "max_input_tokens": 1048576, "max_output_tokens": 262144, "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 7.5e-06, - "reasoning_effort_levels": [ - "none", - "high" + "output_cost_per_token": 4.4e-06, + "source": "https://inference.baseten.co/v1/models", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" ], - "source": "https://docs.mistral.ai/models/model-cards/mistral-medium-3-5-26-04", - "supports_assistant_prefill": true, "supports_function_calling": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true }, - "mistral/mistral-vibe-cli-with-tools": { - "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_token": 1.5e-06, - "litellm_provider": "mistral", - "max_input_tokens": 262144, + "baseten/zai-org/GLM-5.3-Fast": { + "cache_read_input_token_cost": 2.1e-07, + "input_cost_per_token": 2.1e-06, + "litellm_provider": "baseten", + "max_input_tokens": 1048576, "max_output_tokens": 262144, "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 7.5e-06, - "reasoning_effort_levels": [ - "none", - "high" + "output_cost_per_token": 6.6e-06, + "source": "https://inference.baseten.co/v1/models", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" ], - "source": "https://docs.mistral.ai/models/model-cards/mistral-medium-3-5-26-04", - "supports_assistant_prefill": true, "supports_function_calling": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true }, - "mistral/mistral-vibe-cli-fast": { - "cache_read_input_token_cost": 1.5e-08, - "input_cost_per_token": 1.5e-07, - "litellm_provider": "mistral", - "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, + "openrouter/minimax/minimax-m3": { + "input_cost_per_token": 3e-07, + "output_cost_per_token": 1.2e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 512000, + "max_tokens": 512000, "mode": "chat", - "output_cost_per_token": 6e-07, - "reasoning_effort_levels": [ - "none", - "high" - ], - "source": "https://docs.mistral.ai/models/model-cards/mistral-small-4-0-26-03", - "supports_assistant_prefill": true, + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_vision": true, + "cache_read_input_token_cost": 6e-08, + "supports_audio_input": false, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_web_search": false + }, + "openrouter/qwen/qwen3.7-plus": { + "input_cost_per_token": 3.2e-07, + "input_cost_per_token_above_256k_tokens": 9.6e-07, + "cache_creation_input_token_cost_above_256k_tokens": 1.2e-06, + "cache_read_input_token_cost_above_256k_tokens": 1.92e-07, + "output_cost_per_token_above_256k_tokens": 3.84e-06, + "output_cost_per_token": 1.28e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_function_calling": true, "supports_tool_choice": true, - "supports_vision": true + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "cache_read_input_token_cost": 6.4e-08, + "supports_prompt_caching": true, + "cache_creation_input_token_cost": 4e-07, + "supports_audio_input": false, + "supports_pdf_input": false, + "supports_web_search": false }, - "mistral/mistral-code-latest": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "mistral", - "max_input_tokens": 128000, + "openrouter/openai/gpt-6-astra": { + "input_cost_per_token": 1e-05, + "output_cost_per_token": 5e-05, + "cache_read_input_token_cost": 1e-06, + "cache_creation_input_token_cost": 1.25e-05, + "input_cost_per_token_above_272k_tokens": 2e-05, + "output_cost_per_token_above_272k_tokens": 7.5e-05, + "cache_read_input_token_cost_above_272k_tokens": 2e-06, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 9e-07, - "source": "https://docs.mistral.ai/models/model-cards/codestral-25-08", - "supports_assistant_prefill": true, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_tool_choice": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_vision": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_web_search": true }, - "mistral/mistral-code-fim-latest": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "mistral", - "max_input_tokens": 128000, + "openrouter/openai/gpt-6-astra-pro": { + "input_cost_per_token": 1e-05, + "output_cost_per_token": 5e-05, + "cache_read_input_token_cost": 1e-06, + "cache_creation_input_token_cost": 1.25e-05, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-05, + "input_cost_per_token_above_272k_tokens": 2e-05, + "output_cost_per_token_above_272k_tokens": 7.5e-05, + "cache_read_input_token_cost_above_272k_tokens": 2e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 9e-07, - "source": "https://docs.mistral.ai/models/model-cards/codestral-25-08", - "supports_assistant_prefill": true, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_tool_choice": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_vision": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_web_search": true }, - "mistral/mistral-code-agent-latest": { - "cache_read_input_token_cost": 4e-08, - "input_cost_per_token": 4e-07, - "litellm_provider": "mistral", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, + "openrouter/qwen/qwen3.8-flash": { + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 4.7e-07, + "cache_read_input_token_cost": 1.6e-08, + "cache_creation_input_token_cost": 2e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://mistral.ai/news/devstral-2-vibe-cli", - "supports_assistant_prefill": true, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true - }, - "mistral/mistral-ocr-3": { - "litellm_provider": "mistral", - "ocr_cost_per_page": 0.002, - "ocr_cost_per_page_batches": 0.001, - "annotation_cost_per_page": 0.003, - "annotation_cost_per_page_batches": 0.0015, - "mode": "ocr", - "supported_endpoints": [ - "/v1/ocr", - "/v1/batch" - ], - "source": "https://mistral.ai/pricing#api-pricing" + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": false }, - "mistral/mistral-ocr-3-0": { - "litellm_provider": "mistral", - "ocr_cost_per_page": 0.002, - "ocr_cost_per_page_batches": 0.001, - "annotation_cost_per_page": 0.003, - "annotation_cost_per_page_batches": 0.0015, - "mode": "ocr", - "supported_endpoints": [ - "/v1/ocr", - "/v1/batch" - ], - "source": "https://mistral.ai/pricing#api-pricing" + "openrouter/z-ai/glm-5.3-flash": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 1.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1310720, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 5e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "mistral/mistral-ocr-4": { - "annotation_cost_per_page": 0.005, - "annotation_cost_per_page_batches": 0.0025, - "litellm_provider": "mistral", - "mode": "ocr", - "ocr_cost_per_page": 0.004, - "ocr_cost_per_page_batches": 0.002, - "source": "https://docs.mistral.ai/models/model-cards/ocr-4-1", - "supported_endpoints": [ - "/v1/ocr", - "/v1/batch" - ] + "openrouter/deepseek/deepseek-v4-flash-vision-exp": { + "input_cost_per_token": 2.156e-07, + "output_cost_per_token": 6.468e-07, + "cache_read_input_token_cost": 6.86e-09, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": false }, - "mistral/voxtral-mini-latest": { - "input_cost_per_second": 5e-05, - "litellm_provider": "mistral", - "mode": "audio_transcription", - "source": "https://docs.mistral.ai/models/model-cards/voxtral-mini-transcribe-26-02", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ], - "supported_modalities": [ - "audio" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true + "openrouter/z-ai/glm-5.3": { + "input_cost_per_token": 2.219e-07, + "output_cost_per_token": 3.39e-06, + "cache_read_input_token_cost": 1.775e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": false, + "supports_vision": false, + "supports_prompt_caching": true, + "supports_web_search": false }, - "mistral/voxtral-mini-realtime-2602": { - "input_cost_per_second": 0.0001, - "litellm_provider": "mistral", - "mode": "audio_transcription", - "source": "https://docs.mistral.ai/models/model-cards/voxtral-mini-transcribe-realtime-26-02", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ], - "supported_modalities": [ - "audio" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true + "openrouter/qwen/qwen3.8-27b": { + "input_cost_per_token": 4.2e-07, + "output_cost_per_token": 3e-06, + "cache_read_input_token_cost": 8.5e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": false }, - "mistral/voxtral-mini-realtime-latest": { - "input_cost_per_second": 0.0001, - "litellm_provider": "mistral", - "mode": "audio_transcription", - "source": "https://docs.mistral.ai/models/model-cards/voxtral-mini-transcribe-realtime-26-02", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ], - "supported_modalities": [ - "audio" - ], - "supported_output_modalities": [ - "text" - ], - "supports_audio_input": true + "openrouter/qwen/qwen3.8-2.4t-a95b": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 6e-06, + "cache_read_input_token_cost": 2.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": false, + "supports_prompt_caching": true, + "supports_web_search": false }, - "mistral/labs-leanstral-1-5-1": { + "openrouter/nvidia/nemotron-3.5-lightning:free": { "input_cost_per_token": 0.0, - "litellm_provider": "mistral", - "max_input_tokens": 262144, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": false, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/qwen/qwen3.8-max": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 6e-06, + "cache_read_input_token_cost": 2.5e-07, + "cache_creation_input_token_cost": 2.5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, "max_output_tokens": 131072, "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 0.0, - "source": "https://docs.mistral.ai/models/model-cards/leanstral-1-5", + "source": "https://openrouter.ai/qwen/qwen3.8-max", "supports_function_calling": true, + "supports_tool_choice": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_vision": true, + "supports_prompt_caching": true }, - "fireworks_ai/accounts/fireworks/models/glm-5p3": { - "cache_read_input_token_cost": 2.6e-07, - "cache_read_input_token_cost_priority": 3.25e-07, - "input_cost_per_token": 1.4e-06, - "input_cost_per_token_priority": 1.75e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/qwen/qwen3.8-max-0902": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 6e-06, + "cache_read_input_token_cost": 2.5e-07, + "cache_creation_input_token_cost": 2.5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 4.4e-06, - "output_cost_per_token_priority": 5.5e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_vision": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_web_search": false }, - "fireworks_ai/glm-5p3": { - "cache_read_input_token_cost": 2.6e-07, - "cache_read_input_token_cost_priority": 3.25e-07, - "input_cost_per_token": 1.4e-06, - "input_cost_per_token_priority": 1.75e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/qwen/qwen3.8-max-prime": { + "input_cost_per_token": 4e-06, + "output_cost_per_token": 1.2e-05, + "cache_read_input_token_cost": 5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 4.4e-06, - "output_cost_per_token_priority": 5.5e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_vision": true, + "supports_video_input": true, + "supports_prompt_caching": true }, - "fireworks_ai/accounts/fireworks/routers/glm-5p3-fast": { - "cache_read_input_token_cost": 3.9e-07, - "input_cost_per_token": 2.1e-06, - "litellm_provider": "fireworks_ai", + "openrouter/deepseek/deepseek-v4-flash-0731": { + "cache_read_input_token_cost": 1.08e-08, + "input_cost_per_token": 1.08e-08, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "max_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 6.6e-06, - "source": "https://api.fireworks.ai/v1/serverless/models", + "output_cost_per_token": 1.28e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false + "supports_vision": false, + "supports_web_search": false }, - "fireworks_ai/glm-5p3-fast": { - "cache_read_input_token_cost": 3.9e-07, - "input_cost_per_token": 2.1e-06, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_tokens": 1048576, + "openrouter/qwen/qwen3.7-flash": { + "input_cost_per_token": 3e-08, + "input_cost_per_token_above_32k_tokens": 1e-07, + "cache_creation_input_token_cost_above_32k_tokens": 1.25e-07, + "cache_read_input_token_cost_above_32k_tokens": 2e-08, + "output_cost_per_token_above_32k_tokens": 4e-07, + "output_cost_per_token": 1.3e-07, + "cache_read_input_token_cost": 6e-09, + "cache_creation_input_token_cost": 3.8e-08, + "input_cost_per_token_above_256k_tokens": 2e-07, + "output_cost_per_token_above_256k_tokens": 8e-07, + "cache_read_input_token_cost_above_256k_tokens": 4e-08, + "cache_creation_input_token_cost_above_256k_tokens": 2.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 6.6e-06, - "source": "https://docs.fireworks.ai/serverless/pricing", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": false }, - "fireworks_ai/accounts/fireworks/models/glm-5p3-flash": { - "cache_read_input_token_cost": 3e-08, - "cache_read_input_token_cost_priority": 3.75e-08, - "input_cost_per_token": 1.5e-07, - "input_cost_per_token_priority": 1.875e-07, - "litellm_provider": "fireworks_ai", + "openrouter/poolside/laguna-s-2.1": { + "input_cost_per_token": 9e-08, + "output_cost_per_token": 1.8e-07, + "cache_read_input_token_cost": 9e-09, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "max_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 5e-07, - "output_cost_per_token_priority": 6.25e-07, - "source": "https://api.fireworks.ai/v1/serverless/models", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_response_schema": true, + "supports_pdf_input": false, "supports_tool_choice": true, - "supports_vision": true + "supports_reasoning": true, + "supports_vision": false, + "supports_prompt_caching": true, + "supports_response_schema": false, + "supports_web_search": false }, - "fireworks_ai/glm-5p3-flash": { - "cache_read_input_token_cost": 3e-08, - "cache_read_input_token_cost_priority": 3.75e-08, - "input_cost_per_token": 1.5e-07, - "input_cost_per_token_priority": 1.875e-07, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 1048576, - "max_tokens": 1048576, + "openrouter/poolside/laguna-s-2.1:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 5e-07, - "output_cost_per_token_priority": 6.25e-07, - "source": "https://api.fireworks.ai/v1/serverless/models", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_response_schema": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_tool_choice": true, - "supports_vision": true + "supports_reasoning": true, + "supports_response_schema": false, + "supports_vision": false, + "supports_web_search": false }, - "fireworks_ai/accounts/fireworks/models/inkling": { - "cache_read_input_token_cost": 1.7e-07, - "input_cost_per_token": 1e-06, - "litellm_provider": "fireworks_ai", + "openrouter/moonshotai/kimi-k3": { + "cache_read_input_token_cost": 4.357e-07, + "input_cost_per_token": 4.357e-07, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "max_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 4.05e-06, - "source": "https://fireworks.ai/models/fireworks/inkling", + "output_cost_per_token": 1e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true - }, - "fireworks_ai/accounts/fireworks/models/qwen3-embedding-8b": { - "input_cost_per_token": 1e-07, - "output_cost_per_token": 0.0, - "litellm_provider": "fireworks_ai", - "max_input_tokens": 40960, - "max_output_tokens": 40960, - "max_tokens": 40960, - "mode": "embedding", - "source": "https://api.fireworks.ai/v1/serverless/models" + "supports_vision": true, + "supports_web_search": false }, - "zai/glm-5.2": { - "cache_creation_input_token_cost": 0, - "cache_read_input_token_cost": 2.6e-07, - "input_cost_per_token": 1.4e-06, - "litellm_provider": "zai", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, + "openrouter/poolside/laguna-xs-2.1": { + "input_cost_per_token": 6e-08, + "output_cost_per_token": 1.2e-07, + "cache_read_input_token_cost": 3e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 4.4e-06, - "source": "https://docs.z.ai/guides/overview/pricing", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, - "supports_tool_choice": true - }, - "together_ai/Qwen/Qwen3.8-Flash": { - "input_cost_per_token": 1.5e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 1000000, - "max_tokens": 1000000, - "mode": "chat", - "output_cost_per_token": 4.7e-07, - "source": "https://api.together.ai/v1/models" + "supports_vision": false, + "supports_prompt_caching": true, + "supports_response_schema": false, + "supports_web_search": false }, - "together_ai/moonshotai/Kimi-K2.6": { - "deprecation_date": "2026-08-19", - "input_cost_per_token": 1.2e-06, - "output_cost_per_token": 4.5e-06, - "cache_read_input_token_cost": 2e-07, - "litellm_provider": "together_ai", + "openrouter/poolside/laguna-xs-2.1:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "source": "https://api.together.ai/v1/models" + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": false, + "supports_vision": false, + "supports_web_search": false }, - "together_ai/moonshotai/Kimi-K2.5-fp4": { - "input_cost_per_token": 5e-07, - "output_cost_per_token": 2.8e-06, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, + "openrouter/google/gemini-3.1-flash-lite-image": { + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 1.5e-06, + "output_cost_per_image_token": 3e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 65536, + "max_output_tokens": 58982, + "max_tokens": 58982, "mode": "chat", - "source": "https://api.together.ai/v1/models" + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": false, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "together_ai/MiniMaxAI/MiniMax-M2.7": { - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, - "cache_read_input_token_cost": 6e-08, - "litellm_provider": "together_ai", - "max_input_tokens": 196608, + "openrouter/google/gemini-3.1-flash-image": { + "input_cost_per_token": 5e-07, + "output_cost_per_token": 3e-06, + "output_cost_per_image_token": 6e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "source": "https://api.together.ai/v1/models" + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": false, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "together_ai/zai-org/GLM-5": { - "deprecation_date": "2026-06-22", - "input_cost_per_token": 1e-06, - "output_cost_per_token": 3.2e-06, - "litellm_provider": "together_ai", - "max_input_tokens": 202752, + "openrouter/google/gemini-3-pro-image": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1.2e-05, + "cache_read_input_token_cost": 2e-07, + "cache_creation_input_token_cost": 3.75e-07, + "cache_read_input_audio_token_cost": 2e-07, + "input_cost_per_audio_token": 2e-06, + "output_cost_per_image_token": 0.00012, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "source": "https://api.together.ai/v1/models" + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": true }, - "together_ai/zai-org/GLM-5.1": { - "deprecation_date": "2026-07-10", - "input_cost_per_token": 1.4e-06, - "output_cost_per_token": 4.4e-06, + "openrouter/z-ai/glm-5.2": { "cache_read_input_token_cost": 2.6e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 202752, - "mode": "chat", - "source": "https://api.together.ai/v1/models" - }, - "together_ai/deepseek-ai/DeepSeek-R1-0528": { - "input_cost_per_token": 3e-06, - "output_cost_per_token": 7e-06, - "litellm_provider": "together_ai", - "max_input_tokens": 163840, - "mode": "chat", - "source": "https://api.together.ai/v1/models" - }, - "together_ai/Qwen/Qwen3-Coder-Next-FP8": { - "deprecation_date": "2026-05-14", - "input_cost_per_token": 5e-07, - "output_cost_per_token": 1.2e-06, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, + "input_cost_per_token": 4.1e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 3.99e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "together_ai/Qwen/Qwen3-VL-32B-Instruct": { - "deprecation_date": "2026-02-25", - "input_cost_per_token": 5e-07, - "output_cost_per_token": 1.5e-06, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, + "openrouter/z-ai/glm-5.2:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 32768, + "max_output_tokens": 29491, + "max_tokens": 29491, "mode": "chat", - "source": "https://api.together.ai/v1/models" + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": false, + "supports_reasoning": true, + "supports_response_schema": false, + "supports_vision": false, + "supports_web_search": false }, - "together_ai/Qwen/Qwen3-VL-8B-Instruct": { - "deprecation_date": "2026-04-16", - "input_cost_per_token": 1.8e-07, - "output_cost_per_token": 6.8e-07, - "litellm_provider": "together_ai", + "openrouter/moonshotai/kimi-k2.7-code": { + "cache_read_input_token_cost": 1.8e-07, + "input_cost_per_token": 6.712e-07, + "litellm_provider": "openrouter", "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 3.35e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "together_ai/mistralai/Ministral-3-14B-Instruct-2512": { + "openrouter/nvidia/nemotron-3.5-content-safety": { "input_cost_per_token": 2e-07, "output_cost_per_token": 2e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 262144, - "mode": "chat", - "source": "https://api.together.ai/v1/models" - }, - "together_ai/nvidia/NVIDIA-Nemotron-Nano-9B-v2": { - "input_cost_per_token": 6e-08, - "output_cost_per_token": 2.5e-07, - "litellm_provider": "together_ai", + "litellm_provider": "openrouter", "max_input_tokens": 131072, + "max_output_tokens": 117964, + "max_tokens": 117964, "mode": "chat", - "source": "https://api.together.ai/v1/models" + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": false, + "supports_reasoning": true, + "supports_response_schema": false, + "supports_vision": true, + "supports_web_search": false }, - "together_ai/mistralai/Mistral-7B-Instruct-v0.3": { - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "together_ai", - "max_input_tokens": 32768, + "openrouter/nvidia/nemotron-3.5-content-safety:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "source": "https://api.together.ai/v1/models" + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": false, + "supports_reasoning": true, + "supports_response_schema": false, + "supports_vision": true, + "supports_web_search": false }, - "together_ai/Qwen/QwQ-32B": { - "deprecation_date": "2025-11-13", - "input_cost_per_token": 1.2e-06, - "output_cost_per_token": 1.2e-06, - "litellm_provider": "together_ai", - "max_input_tokens": 131072, + "openrouter/nvidia/nemotron-3-ultra-550b-a55b": { + "input_cost_per_token": 6e-07, + "output_cost_per_token": 2.4e-06, + "cache_read_input_token_cost": 1.2e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 182520, + "max_tokens": 182520, "mode": "chat", - "source": "https://api.together.ai/v1/models" + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": false, + "supports_prompt_caching": true, + "supports_web_search": false }, - "cerebras/gemma-4-31b": { - "input_cost_per_token": 9.9e-07, - "litellm_provider": "cerebras", - "max_input_tokens": 131072, - "max_output_tokens": 40960, - "max_tokens": 40960, + "openrouter/nvidia/nemotron-3-ultra-550b-a55b:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.49e-06, - "source": "https://api.cerebras.ai/public/v1/models/gemma-4-31b", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_tool_choice": true, - "supports_vision": true - }, - "elevenlabs/scribe_v2": { - "input_cost_per_second": 6.11e-05, - "litellm_provider": "elevenlabs", - "mode": "audio_transcription", - "output_cost_per_second": 0.0, - "source": "https://elevenlabs.io/pricing/api", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ] + "supports_reasoning": true, + "supports_response_schema": false, + "supports_vision": false, + "supports_web_search": false }, - "scaleway/glm-5.2": { - "input_cost_per_token": 1.8e-06, - "litellm_provider": "scaleway", - "max_input_tokens": 256000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "openrouter/minimax/minimax-m3:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 5.5e-06, - "source": "https://www.scaleway.com/en/pricing/model-as-a-service/", + "source": "https://openrouter.ai/minimax/minimax-m3:free", "supports_function_calling": true, + "supports_tool_choice": true, "supports_reasoning": true, - "supports_vision": false + "supports_response_schema": true, + "supports_vision": true }, - "scaleway/deepseek-v4-flash-0731": { - "cache_read_input_token_cost": 8e-08, - "input_cost_per_token": 4e-07, - "litellm_provider": "scaleway", - "max_input_tokens": 256000, - "max_output_tokens": 32768, - "max_tokens": 32768, + "openrouter/qwen/qwen3.7-max": { + "input_cost_per_token": 1.475e-06, + "output_cost_per_token": 4.425e-06, + "cache_read_input_token_cost": 2.95e-07, + "cache_creation_input_token_cost": 1.84375e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 8e-07, - "source": "https://www.scaleway.com/en/pricing/model-as-a-service/", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, - "supports_vision": false + "supports_response_schema": true, + "supports_vision": false, + "supports_prompt_caching": true, + "supports_web_search": false }, - "azure_ai/kimi-k2.7-code": { - "cache_read_input_token_cost": 1.9e-07, - "deprecation_date": "2026-10-03", - "input_cost_per_token": 9.5e-07, - "litellm_provider": "azure_ai", + "openrouter/mistralai/mistral-medium-3-5": { + "input_cost_per_token": 1.5e-06, + "output_cost_per_token": 7.5e-06, + "litellm_provider": "openrouter", "max_input_tokens": 262144, - "max_output_tokens": 262144, - "max_tokens": 262144, + "max_output_tokens": 209715, + "max_tokens": 209715, "mode": "chat", - "output_cost_per_token": 4e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, "supports_tool_choice": true, - "supports_vision": true + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_pdf_input": true, + "supports_prompt_caching": false, + "supports_web_search": false }, - "bedrock/us-gov-west-1/nvidia.nemotron-nano-3-30b": { - "input_cost_per_token": 7.2e-08, - "litellm_provider": "bedrock", - "max_input_tokens": 262144, - "max_output_tokens": 8192, - "max_tokens": 8192, + "openrouter/nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 256000, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 2.88e-07, - "source": "https://aws.amazon.com/bedrock/pricing/", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, - "supports_native_structured_output": true, - "supports_system_messages": true, - "supports_tool_choice": true - }, - "bedrock/us-gov-west-1/nvidia.nemotron-nano-12b-v2": { - "input_cost_per_token": 2.4e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 7.2e-07, - "supports_system_messages": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_vision": true, + "supports_audio_input": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_response_schema": false, + "supports_web_search": false }, - "bedrock/us-gov-west-1/nvidia.nemotron-nano-9b-v2": { - "input_cost_per_token": 7.2e-08, - "litellm_provider": "bedrock", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "openrouter/qwen/qwen3.5-plus-20260420": { + "input_cost_per_token": 3e-07, + "output_cost_per_token": 1.8e-06, + "cache_creation_input_token_cost": 3.75e-07, + "input_cost_per_token_above_256k_tokens": 3.75e-07, + "output_cost_per_token_above_256k_tokens": 2.25e-06, + "cache_creation_input_token_cost_above_256k_tokens": 4.6875e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 2.76e-07, - "supports_system_messages": true + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": false }, - "bedrock/us-gov-west-1/nvidia.nemotron-super-3-120b": { - "input_cost_per_token": 1.8e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 256000, - "max_output_tokens": 32768, - "max_tokens": 32768, + "openrouter/qwen/qwen3.6-flash": { + "input_cost_per_token": 1.875e-07, + "output_cost_per_token": 1.125e-06, + "cache_creation_input_token_cost": 2.34375e-07, + "input_cost_per_token_above_256k_tokens": 7.5e-07, + "output_cost_per_token_above_256k_tokens": 3e-06, + "cache_creation_input_token_cost_above_256k_tokens": 9.375e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 7.8e-07, - "source": "https://aws.amazon.com/bedrock/pricing/", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": true, "supports_reasoning": true, - "supports_system_messages": true, - "supports_tool_choice": true + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": false }, - "bedrock/us-gov-west-1/openai.gpt-oss-20b-1:0": { - "input_cost_per_token": 8.4e-08, - "litellm_provider": "bedrock", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/qwen/qwen3.6-35b-a3b": { + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 1e-06, + "cache_read_input_token_cost": 5e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 3.6e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": false }, - "bedrock/us-gov-west-1/openai.gpt-oss-120b-1:0": { - "input_cost_per_token": 1.8e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/qwen/qwen3.6-max-preview": { + "cache_creation_input_token_cost": 1.28375e-06, + "cache_creation_input_token_cost_above_128k_tokens": 1.975e-06, + "deprecation_date": "2026-10-09", + "input_cost_per_token": 1.027e-06, + "input_cost_per_token_above_128k_tokens": 1.58e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 7.2e-07, + "output_cost_per_token": 6.162e-06, + "output_cost_per_token_above_128k_tokens": 9.48e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "bedrock/us-gov-west-1/anthropic.claude-sonnet-5": { - "bedrock_converse_supports_strict_tools": false, - "bedrock_output_config_effort_ceiling": "xhigh", - "cache_creation_input_token_cost": 3e-06, - "cache_creation_input_token_cost_above_1hr": 4.8e-06, - "cache_read_input_token_cost": 2.4e-07, - "input_cost_per_token": 2.4e-06, - "litellm_provider": "bedrock", - "supports_tool_search": true, - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/qwen/qwen3.6-27b": { + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 3.2e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 81920, + "max_tokens": 81920, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "prompt_cache_min_tokens": 1024, - "supports_adaptive_thinking": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, + "output_cost_per_token": 3.2e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_mid_conversation_system": true, - "supports_native_structured_output": false, - "supports_output_config": true, - "supports_parallel_tool_use_config": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_xhigh_reasoning_effort": true + "supports_web_search": false }, - "bedrock/us-gov-west-1/anthropic.claude-opus-4-8": { - "bedrock_converse_supports_strict_tools": false, - "bedrock_output_config_effort_ceiling": "xhigh", - "cache_creation_input_token_cost": 7.5e-06, - "cache_creation_input_token_cost_above_1hr": 1.2e-05, - "cache_read_input_token_cost": 6e-07, - "input_cost_per_token": 6e-06, - "litellm_provider": "bedrock", - "supports_tool_search": true, - "max_input_tokens": 1000000, + "openrouter/openai/gpt-5.5-pro": { + "input_cost_per_token": 3e-05, + "output_cost_per_token": 0.00018, + "input_cost_per_token_above_272k_tokens": 6e-05, + "output_cost_per_token_above_272k_tokens": 0.00027, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3e-05, - "prompt_cache_min_tokens": 1024, - "supports_adaptive_thinking": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_mid_conversation_system": true, - "supports_native_structured_output": true, - "supports_output_config": true, - "supports_parallel_tool_use_config": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, - "supports_tool_choice": true, "supports_vision": true, - "supports_xhigh_reasoning_effort": true + "supports_pdf_input": true, + "supports_prompt_caching": false, + "supports_web_search": true }, - "bedrock/us-gov-west-1/anthropic.claude-opus-5": { - "bedrock_converse_supports_strict_tools": false, - "cache_creation_input_token_cost": 7.5e-06, - "cache_creation_input_token_cost_above_1hr": 1.2e-05, - "cache_read_input_token_cost": 6e-07, - "input_cost_per_token": 6e-06, - "litellm_provider": "bedrock", - "supports_tool_search": true, - "max_input_tokens": 1000000, + "openrouter/openai/gpt-chat-latest": { + "input_cost_per_token": 5e-06, + "output_cost_per_token": 3e-05, + "cache_read_input_token_cost": 5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 400000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3e-05, - "prompt_cache_min_tokens": 512, - "supports_adaptive_thinking": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_mid_conversation_system": true, - "supports_native_structured_output": false, - "supports_output_config": true, - "supports_parallel_tool_use_config": true, + "supports_tool_choice": true, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_vision": true, "supports_pdf_input": true, "supports_prompt_caching": true, + "supports_web_search": true + }, + "openrouter/deepseek/deepseek-v4-flash": { + "cache_read_input_token_cost": 8.372e-09, + "input_cost_per_token": 4.186e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 8.372e-08, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/moonshotai/kimi-k2.6": { + "input_cost_per_token": 4.3415e-07, + "output_cost_per_token": 1.828e-06, + "cache_read_input_token_cost": 7.312e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": false, "supports_vision": true, - "supports_xhigh_reasoning_effort": true + "supports_prompt_caching": true, + "supports_web_search": false }, - "bedrock/us-gov-west-1/anthropic.claude-fable-5-1": { - "cache_creation_input_token_cost": 1.5e-05, - "cache_creation_input_token_cost_above_1hr": 2.4e-05, - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 1.2e-05, - "litellm_provider": "bedrock", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/google/gemma-4-26b-a4b-it": { + "cache_read_input_token_cost": 4.25e-08, + "input_cost_per_token": 7.65e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 6e-05, - "supports_adaptive_thinking": true, - "thinking_always_on": true, - "supports_mid_conversation_system": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, - "supports_forced_tool_use": false, + "output_cost_per_token": 2.55e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": false, - "supports_max_reasoning_effort": true, - "supports_output_config": true, - "bedrock_output_config_effort_ceiling": "xhigh", - "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 512 + "supports_web_search": false }, - "bedrock/us-gov-east-1/nvidia.nemotron-nano-3-30b": { - "input_cost_per_token": 7.2e-08, - "litellm_provider": "bedrock", + "openrouter/google/gemma-4-26b-a4b-it:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", "max_input_tokens": 262144, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 2.88e-07, - "source": "https://aws.amazon.com/bedrock/pricing/", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_native_structured_output": true, - "supports_system_messages": true, - "supports_tool_choice": true - }, - "bedrock/us-gov-east-1/nvidia.nemotron-nano-12b-v2": { - "input_cost_per_token": 2.4e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 7.2e-07, - "supports_system_messages": true, - "supports_vision": true - }, - "bedrock/us-gov-east-1/nvidia.nemotron-nano-9b-v2": { - "input_cost_per_token": 7.2e-08, - "litellm_provider": "bedrock", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 2.76e-07, - "supports_system_messages": true + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": false }, - "bedrock/us-gov-east-1/nvidia.nemotron-super-3-120b": { - "input_cost_per_token": 1.8e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 256000, - "max_output_tokens": 32768, - "max_tokens": 32768, + "openrouter/google/gemma-4-31b-it": { + "input_cost_per_token": 9e-08, + "output_cost_per_token": 3.4e-07, + "cache_read_input_token_cost": 5e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 7.8e-07, - "source": "https://aws.amazon.com/bedrock/pricing/", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, - "supports_system_messages": true, - "supports_tool_choice": true + "supports_response_schema": true, + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": false }, - "bedrock/us-gov-east-1/openai.gpt-oss-20b-1:0": { - "input_cost_per_token": 8.4e-08, - "litellm_provider": "bedrock", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/google/gemma-4-31b-it:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 3.6e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_vision": true, + "supports_web_search": false }, - "bedrock/us-gov-east-1/openai.gpt-oss-120b-1:0": { - "input_cost_per_token": 1.8e-07, - "litellm_provider": "bedrock", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/z-ai/glm-5v-turbo": { + "input_cost_per_token": 1.2e-06, + "output_cost_per_token": 4e-06, + "cache_read_input_token_cost": 2.4e-07, + "deprecation_date": "2098-12-31", + "litellm_provider": "openrouter", + "max_input_tokens": 202752, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 7.2e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": false }, - "bedrock/us-gov-east-1/anthropic.claude-sonnet-5": { - "bedrock_converse_supports_strict_tools": false, - "bedrock_output_config_effort_ceiling": "xhigh", - "cache_creation_input_token_cost": 3e-06, - "cache_creation_input_token_cost_above_1hr": 4.8e-06, - "cache_read_input_token_cost": 2.4e-07, - "input_cost_per_token": 2.4e-06, - "litellm_provider": "bedrock", - "supports_tool_search": true, - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/minimax/minimax-m2.7": { + "cache_read_input_token_cost": 4.2e-08, + "input_cost_per_token": 2.1e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 204800, + "max_output_tokens": 176947, + "max_tokens": 176947, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "prompt_cache_min_tokens": 1024, - "supports_adaptive_thinking": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, + "output_cost_per_token": 8.4e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_mid_conversation_system": true, - "supports_native_structured_output": false, - "supports_output_config": true, - "supports_parallel_tool_use_config": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true + "supports_vision": false, + "supports_web_search": false }, - "bedrock/us-gov-east-1/anthropic.claude-opus-4-8": { - "bedrock_converse_supports_strict_tools": false, - "bedrock_output_config_effort_ceiling": "xhigh", - "cache_creation_input_token_cost": 7.5e-06, - "cache_creation_input_token_cost_above_1hr": 1.2e-05, - "cache_read_input_token_cost": 6e-07, - "input_cost_per_token": 6e-06, - "litellm_provider": "bedrock", - "supports_tool_search": true, - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/minimax/minimax-m2.7:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 196608, + "max_output_tokens": 176947, + "max_tokens": 176947, "mode": "chat", - "output_cost_per_token": 3e-05, - "prompt_cache_min_tokens": 1024, - "supports_adaptive_thinking": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, + "source": "https://openrouter.ai/minimax/minimax-m2.7:free", "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_mid_conversation_system": true, - "supports_native_structured_output": true, - "supports_output_config": true, - "supports_parallel_tool_use_config": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, - "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true + "supports_vision": false }, - "bedrock/us-gov-east-1/anthropic.claude-opus-5": { - "bedrock_converse_supports_strict_tools": false, - "cache_creation_input_token_cost": 7.5e-06, - "cache_creation_input_token_cost_above_1hr": 1.2e-05, - "cache_read_input_token_cost": 6e-07, - "input_cost_per_token": 6e-06, - "litellm_provider": "bedrock", - "supports_tool_search": true, - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/mistralai/mistral-small-2603": { + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "cache_read_input_token_cost": 1.5e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 209715, + "max_tokens": 209715, "mode": "chat", - "output_cost_per_token": 3e-05, - "prompt_cache_min_tokens": 512, - "supports_adaptive_thinking": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_max_reasoning_effort": true, - "supports_mid_conversation_system": true, - "supports_native_structured_output": false, - "supports_output_config": true, - "supports_parallel_tool_use_config": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, - "supports_tool_choice": true, "supports_vision": true, - "supports_xhigh_reasoning_effort": true + "supports_prompt_caching": true, + "supports_web_search": false }, - "bedrock/us-gov-east-1/anthropic.claude-fable-5-1": { - "cache_creation_input_token_cost": 1.5e-05, - "cache_creation_input_token_cost_above_1hr": 2.4e-05, - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 1.2e-05, - "litellm_provider": "bedrock", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/z-ai/glm-5-turbo": { + "input_cost_per_token": 1.2e-06, + "output_cost_per_token": 4e-06, + "cache_read_input_token_cost": 2.4e-07, + "deprecation_date": "2098-12-31", + "litellm_provider": "openrouter", + "max_input_tokens": 202752, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 6e-05, - "supports_adaptive_thinking": true, - "thinking_always_on": true, - "supports_mid_conversation_system": true, - "supports_assistant_prefill": false, - "supports_computer_use": true, - "supports_forced_tool_use": false, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_sampling_params": false, - "supports_tool_choice": true, - "supports_vision": true, - "supports_xhigh_reasoning_effort": true, - "supports_native_structured_output": false, - "supports_max_reasoning_effort": true, - "supports_output_config": true, - "bedrock_output_config_effort_ceiling": "xhigh", - "supports_parallel_tool_use_config": true, - "prompt_cache_min_tokens": 512 + "supports_vision": false, + "supports_prompt_caching": true, + "supports_web_search": false }, - "bedrock_mantle/us-gov-west-1/openai.gpt-5.6-terra": { - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "openrouter/nvidia/nemotron-3-super-120b-a12b": { + "input_cost_per_token": 8e-08, + "output_cost_per_token": 4.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_minimal_reasoning_effort": false, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_xhigh_reasoning_effort": true, - "supports_vision": true, - "input_cost_per_token": 2.64e-06, - "input_cost_per_token_above_272k_tokens": 5.28e-06, - "cache_creation_input_token_cost": 3.3e-06, - "cache_creation_input_token_cost_above_272k_tokens": 6.6e-06, - "cache_read_input_token_cost": 2.64e-07, - "cache_read_input_token_cost_above_272k_tokens": 5.28e-07, - "output_cost_per_token": 1.584e-05, - "output_cost_per_token_above_272k_tokens": 2.376e-05 + "supports_vision": false, + "supports_web_search": false }, - "bedrock_mantle/us-gov-west-1/openai.gpt-5.6-luna": { - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "openrouter/nvidia/nemotron-3-super-120b-a12b:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_minimal_reasoning_effort": false, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/qwen/qwen3.5-9b": { + "input_cost_per_token": 1e-07, + "output_cost_per_token": 1.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_tool_choice": true, - "supports_xhigh_reasoning_effort": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": true, - "input_cost_per_token": 2.64e-07, - "input_cost_per_token_above_272k_tokens": 5.28e-07, - "cache_creation_input_token_cost": 3.3e-07, - "cache_creation_input_token_cost_above_272k_tokens": 6.6e-07, - "cache_read_input_token_cost": 2.64e-08, - "cache_read_input_token_cost_above_272k_tokens": 5.28e-08, - "output_cost_per_token": 1.584e-06, - "output_cost_per_token_above_272k_tokens": 2.376e-06 + "supports_web_search": false }, - "bedrock_mantle/us-gov-west-1/openai.gpt-5.4": { - "litellm_provider": "bedrock_mantle", + "openrouter/openai/gpt-5.4-pro": { + "input_cost_per_token": 3e-05, + "output_cost_per_token": 0.00018, + "input_cost_per_token_above_272k_tokens": 6e-05, + "output_cost_per_token_above_272k_tokens": 0.00027, + "litellm_provider": "openrouter", "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_minimal_reasoning_effort": false, - "supports_prompt_caching": true, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_xhigh_reasoning_effort": true, "supports_vision": true, - "input_cost_per_token": 3.3e-06, - "cache_read_input_token_cost": 3.3e-07, - "output_cost_per_token": 1.98e-05 + "supports_pdf_input": true, + "supports_prompt_caching": false, + "supports_web_search": true }, - "bedrock_mantle/us-gov-west-1/xai.grok-4.3": { - "use_openai_responses_path": true, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1048576, - "max_output_tokens": 16384, - "max_tokens": 16384, + "openrouter/google/gemini-3.1-flash-image-preview": { + "input_cost_per_token": 5e-07, + "output_cost_per_token": 3e-06, + "output_cost_per_image_token": 6e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 65536, + "max_output_tokens": 58982, + "max_tokens": 58982, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supports_function_calling": true, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, "supports_vision": true, - "source": "https://aws.amazon.com/bedrock/pricing/", - "input_cost_per_token": 1.5e-06, - "output_cost_per_token": 3e-06, - "cache_read_input_token_cost": 2.4e-07 + "supports_web_search": true }, - "bedrock_mantle/us-gov-west-1/xai.grok-4.6": { - "use_openai_responses_path": true, - "input_cost_per_token": 2.64e-06, - "output_cost_per_token": 7.92e-06, - "cache_read_input_token_cost": 6.6e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 500000, - "max_output_tokens": 500000, - "max_tokens": 500000, + "openrouter/google/gemini-3.1-pro-preview-customtools": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1.2e-05, + "cache_read_input_token_cost": 2e-07, + "cache_creation_input_token_cost": 3.75e-07, + "cache_read_input_audio_token_cost": 2e-07, + "input_cost_per_audio_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true - }, - "bedrock_mantle/us-gov-west-1/google.gemma-4-e2b": { - "input_cost_per_token": 4.8e-08, - "output_cost_per_token": 9.6e-08, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 128000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supports_function_calling": true, - "supports_parallel_function_calling": false, "supports_reasoning": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": true, + "supports_prompt_caching": true, + "supports_web_search": true, + "supports_video_input": true }, - "bedrock_mantle/us-gov-west-1/google.gemma-4-26b-a4b": { - "input_cost_per_token": 1.56e-07, - "output_cost_per_token": 4.8e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, + "openrouter/qwen/qwen3-max-thinking": { + "deprecation_date": "2026-10-09", + "input_cost_per_token": 7.8e-07, + "input_cost_per_token_above_128k_tokens": 1.95e-06, + "input_cost_per_token_above_32k_tokens": 1.56e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], + "output_cost_per_token": 3.9e-06, + "output_cost_per_token_above_128k_tokens": 9.75e-06, + "output_cost_per_token_above_32k_tokens": 7.8e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_parallel_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true + "supports_vision": false, + "supports_web_search": false }, - "bedrock_mantle/us-gov-west-1/google.gemma-4-31b": { - "input_cost_per_token": 1.68e-07, - "output_cost_per_token": 4.8e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, + "openrouter/qwen/qwen3-coder-next": { + "input_cost_per_token": 1.2e-07, + "output_cost_per_token": 8e-07, + "cache_read_input_token_cost": 7e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_parallel_function_calling": false, - "supports_reasoning": true, + "supports_pdf_input": false, "supports_tool_choice": true, - "supports_vision": true + "supports_response_schema": true, + "supports_vision": false, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_web_search": false }, - "bedrock_mantle/us-gov-west-1/openai.gpt-oss-20b": { - "input_cost_per_token": 8.4e-08, - "output_cost_per_token": 3.6e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "openrouter/minimax/minimax-m2-her": { + "input_cost_per_token": 3e-07, + "output_cost_per_token": 1.2e-06, + "cache_read_input_token_cost": 3e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 65536, + "max_output_tokens": 2048, + "max_tokens": 2048, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_tool_choice": false, + "supports_vision": false, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_web_search": false }, - "bedrock_mantle/us-gov-west-1/openai.gpt-oss-120b": { - "input_cost_per_token": 1.8e-07, - "output_cost_per_token": 7.2e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "openrouter/openai/gpt-audio": { + "input_cost_per_token": 2.5e-06, + "output_cost_per_token": 1e-05, + "input_cost_per_audio_token": 3.2e-05, + "output_cost_per_audio_token": 6.4e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, - "supports_parallel_function_calling": true, - "supports_reasoning": true, + "supports_tool_choice": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_vision": false, + "supports_audio_input": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_web_search": false }, - "bedrock_mantle/us-gov-east-1/openai.gpt-5.4": { - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "responses", - "use_openai_responses_path": true, - "supported_endpoints": [ - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "openrouter/openai/gpt-audio-mini": { + "input_cost_per_token": 6e-07, + "output_cost_per_token": 2.4e-06, + "input_cost_per_audio_token": 6e-07, + "output_cost_per_audio_token": 2.4e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, - "supports_minimal_reasoning_effort": false, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, - "supports_xhigh_reasoning_effort": true, - "supports_vision": true, - "input_cost_per_token": 3.3e-06, - "cache_read_input_token_cost": 3.3e-07, - "output_cost_per_token": 1.98e-05 + "supports_response_schema": true, + "supports_vision": false, + "supports_audio_input": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_web_search": false }, - "bedrock_mantle/us-gov-east-1/xai.grok-4.6": { - "use_openai_responses_path": true, - "input_cost_per_token": 2.64e-06, - "output_cost_per_token": 7.92e-06, - "cache_read_input_token_cost": 6.6e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 500000, - "max_output_tokens": 500000, - "max_tokens": 500000, + "openrouter/nvidia/nemotron-3-nano-30b-a3b": { + "input_cost_per_token": 5e-08, + "output_cost_per_token": 2e-07, + "cache_read_input_token_cost": 3e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_vision": false, + "supports_prompt_caching": true, + "supports_web_search": false }, - "bedrock_mantle/us-gov-east-1/openai.gpt-oss-20b": { - "input_cost_per_token": 8.4e-08, - "output_cost_per_token": 3.6e-07, - "litellm_provider": "bedrock_mantle", + "openrouter/z-ai/glm-4.6v": { + "input_cost_per_token": 3e-07, + "output_cost_per_token": 9e-07, + "cache_read_input_token_cost": 5e-08, + "litellm_provider": "openrouter", "max_input_tokens": 131072, "max_output_tokens": 32768, "max_tokens": 32768, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_parallel_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": false }, - "bedrock_mantle/us-gov-east-1/openai.gpt-oss-120b": { - "input_cost_per_token": 1.8e-07, - "output_cost_per_token": 7.2e-07, - "litellm_provider": "bedrock_mantle", - "max_input_tokens": 131072, + "openrouter/google/gemini-3-pro-image-preview": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1.2e-05, + "cache_read_input_token_cost": 2e-07, + "cache_creation_input_token_cost": 3.75e-07, + "cache_read_input_audio_token_cost": 2e-07, + "input_cost_per_audio_token": 2e-06, + "output_cost_per_image_token": 0.00012, + "litellm_provider": "openrouter", + "max_input_tokens": 65536, "max_output_tokens": 32768, "max_tokens": 32768, "mode": "chat", - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/responses" - ], - "supports_function_calling": true, - "supports_parallel_function_calling": true, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_tool_choice": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": true }, - "azure/us-gov/gpt-5.1": { - "cache_read_input_token_cost": 1.71875e-07, - "default_reasoning_effort": "none", - "input_cost_per_token": 1.71875e-06, - "litellm_provider": "azure", - "max_input_tokens": 272000, + "openrouter/openai/gpt-5.1-codex": { + "input_cost_per_token": 1.25e-06, + "output_cost_per_token": 1e-05, + "cache_read_input_token_cost": 1.3e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 400000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.375e-05, - "supported_endpoints": [ - "/v1/chat/completions", - "/v1/batch", - "/v1/responses" - ], - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text", - "image" - ], + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_native_streaming": true, - "supports_none_reasoning_effort": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_system_messages": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": true }, - "azure/us-gov/o3-mini": { - "cache_read_input_token_cost": 7.57e-07, - "input_cost_per_token": 1.513e-06, - "litellm_provider": "azure", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, + "openrouter/openai/gpt-5.1-codex-mini": { + "input_cost_per_token": 2.5e-07, + "output_cost_per_token": 2e-06, + "cache_read_input_token_cost": 3e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6.05e-06, - "supports_prompt_caching": true, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false - }, - "azure/us-gov/text-embedding-3-large": { - "input_cost_per_token": 1.63e-07, - "litellm_provider": "azure", - "max_input_tokens": 8191, - "max_tokens": 8191, - "mode": "embedding", - "output_cost_per_token": 0.0 - }, - "azure/us-gov/text-embedding-3-small": { - "input_cost_per_token": 2.5e-08, - "litellm_provider": "azure", - "max_input_tokens": 8191, - "max_tokens": 8191, - "mode": "embedding", - "output_cost_per_token": 0.0 - }, - "cloudflare/@cf/openai/whisper": { - "input_cost_per_second": 7.5e-06, - "litellm_provider": "cloudflare", - "mode": "audio_transcription", - "output_cost_per_second": 0.0, - "rpm": 720, - "source": "https://developers.cloudflare.com/workers-ai/models/whisper/", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ] - }, - "cloudflare/@cf/openai/whisper-large-v3-turbo": { - "input_cost_per_second": 8.5e-06, - "litellm_provider": "cloudflare", - "mode": "audio_transcription", - "output_cost_per_second": 0.0, - "rpm": 720, - "source": "https://developers.cloudflare.com/workers-ai/models/whisper-large-v3-turbo/", - "supported_endpoints": [ - "/v1/audio/transcriptions" - ] + "supports_vision": true, + "supports_prompt_caching": true, + "supports_web_search": true }, - "gemini/lyria-3.5-clip-preview": { - "input_cost_per_token": 0, - "litellm_provider": "gemini", - "max_input_tokens": 131072, - "max_output_tokens": 8192, - "max_tokens": 8192, + "openrouter/moonshotai/kimi-k2-thinking": { + "input_cost_per_token": 6e-07, + "output_cost_per_token": 2.5e-06, + "cache_read_input_token_cost": 1.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 98304, + "max_tokens": 98304, "mode": "chat", - "output_cost_per_image": 0.04, - "output_cost_per_token": 0, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_modalities": [ - "text" - ], - "supported_output_modalities": [ - "audio" - ], + "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_audio_output": true, - "supports_function_calling": false, - "supports_prompt_caching": false, - "supports_response_schema": false, - "supports_system_messages": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, "supports_vision": false, + "supports_prompt_caching": true, "supports_web_search": false }, - "gemini/lyria-3.5-pro-preview": { - "input_cost_per_token": 0, - "litellm_provider": "gemini", - "max_input_tokens": 131072, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 0, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_modalities": [ - "text" - ], - "supported_output_modalities": [ - "audio" - ], - "supports_audio_input": false, - "supports_audio_output": true, - "supports_function_calling": false, - "supports_prompt_caching": false, - "supports_response_schema": false, - "supports_system_messages": false, - "supports_vision": false, - "supports_web_search": false, - "output_cost_per_image": 0.08 - }, - "gemini/lyria-3.5": { - "input_cost_per_token": 0, - "litellm_provider": "gemini", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "openrouter/mistralai/voxtral-small-24b-2507": { + "input_cost_per_token": 1e-07, + "output_cost_per_token": 3e-07, + "cache_read_input_token_cost": 1e-08, + "input_cost_per_audio_token": 0.0001, + "litellm_provider": "openrouter", + "max_input_tokens": 32768, + "max_output_tokens": 26214, + "max_tokens": 26214, "mode": "chat", - "output_cost_per_token": 0, - "source": "https://ai.google.dev/gemini-api/docs/pricing", - "supported_modalities": [ - "text" - ], - "supported_output_modalities": [ - "audio" - ], - "supports_audio_input": false, - "supports_audio_output": true, - "supports_function_calling": false, - "supports_prompt_caching": false, - "supports_response_schema": false, - "supports_system_messages": false, - "supports_vision": false, - "supports_web_search": false, - "output_cost_per_image": 0.08 - }, - "perplexity/anthropic/claude-fable-5": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_adaptive_thinking": true, - "thinking_always_on": true, - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 1e-05, - "output_cost_per_token": 5e-05, - "cache_read_input_token_cost": 1e-06, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/anthropic/claude-opus-5": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_adaptive_thinking": true, - "prompt_cache_min_tokens": 512, - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 5e-06, - "output_cost_per_token": 2.5e-05, - "cache_read_input_token_cost": 5e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/anthropic/claude-opus-4-8": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_adaptive_thinking": true, - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 5e-06, - "output_cost_per_token": 2.5e-05, - "cache_read_input_token_cost": 5e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/anthropic/claude-sonnet-5": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_adaptive_thinking": true, - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 2e-06, - "output_cost_per_token": 1e-05, - "cache_read_input_token_cost": 2e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/anthropic/claude-sonnet-4-6": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 3e-06, - "output_cost_per_token": 1.5e-05, - "cache_read_input_token_cost": 3e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/openai/gpt-5.6-sol": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 5e-06, - "output_cost_per_token": 3e-05, - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token_above_272k_tokens": 1e-05, - "output_cost_per_token_above_272k_tokens": 4.5e-05, - "cache_read_input_token_cost_above_272k_tokens": 1e-06, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/openai/gpt-5.6-terra": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 2e-06, - "output_cost_per_token": 1.2e-05, - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token_above_272k_tokens": 4e-06, - "output_cost_per_token_above_272k_tokens": 1.8e-05, - "cache_read_input_token_cost_above_272k_tokens": 4e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/openai/gpt-5.6-luna": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 1.2e-06, - "cache_read_input_token_cost": 2e-08, - "input_cost_per_token_above_272k_tokens": 4e-07, - "output_cost_per_token_above_272k_tokens": 1.8e-06, - "cache_read_input_token_cost_above_272k_tokens": 4e-08, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/openai/gpt-5.5": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 5e-06, - "output_cost_per_token": 3e-05, - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token_above_272k_tokens": 1e-05, - "output_cost_per_token_above_272k_tokens": 4.5e-05, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/openai/gpt-5.4": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 2.5e-06, - "output_cost_per_token": 1.5e-05, - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token_above_272k_tokens": 5e-06, - "output_cost_per_token_above_272k_tokens": 2.25e-05, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/openai/gpt-5.4-mini": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 7.5e-07, - "output_cost_per_token": 4.5e-06, - "cache_read_input_token_cost": 7.5e-08, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/openai/gpt-5.4-nano": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 1.25e-06, - "cache_read_input_token_cost": 2e-08, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/openai/gpt-5": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 1e-05, - "cache_read_input_token_cost": 1.25e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_vision": false, + "supports_pdf_input": true, + "supports_audio_input": true, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_web_search": false }, - "perplexity/google/gemini-3.1-pro-preview": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/openai/gpt-oss-safeguard-20b": { + "input_cost_per_token": 7.5e-08, + "output_cost_per_token": 3e-07, + "cache_read_input_token_cost": 3.75e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "input_cost_per_token": 2e-06, - "output_cost_per_token": 1.2e-05, - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token_above_200k_tokens": 4e-06, - "output_cost_per_token_above_200k_tokens": 1.8e-05, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": false, + "supports_prompt_caching": true, + "supports_web_search": false }, - "perplexity/google/gemini-3.1-flash-lite": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/qwen/qwen3-vl-32b-instruct": { + "deprecation_date": "2026-10-09", + "input_cost_per_token": 1.04e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 4.16e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 1.5e-06, - "cache_read_input_token_cost": 2.5e-08, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "perplexity/google/gemini-3.5-flash": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/qwen/qwen3-vl-8b-thinking": { + "deprecation_date": "2026-10-09", + "input_cost_per_token": 1.8e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 2.1e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "input_cost_per_token": 1.5e-06, - "output_cost_per_token": 9e-06, - "cache_read_input_token_cost": 1.5e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "perplexity/google/gemini-3.5-flash-lite": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/qwen/qwen3-vl-8b-instruct": { + "deprecation_date": "2026-10-09", + "input_cost_per_token": 1.17e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 4.55e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false + }, + "openrouter/google/gemini-2.5-flash-image": { "input_cost_per_token": 3e-07, "output_cost_per_token": 2.5e-06, "cache_read_input_token_cost": 3e-08, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/google/gemini-3.6-flash": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, - "supports_function_calling": true, - "input_cost_per_token": 1.5e-06, - "output_cost_per_token": 7.5e-06, - "cache_read_input_token_cost": 1.5e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "cache_creation_input_token_cost": 8.33333333333333e-08, + "cache_read_input_audio_token_cost": 1e-07, + "deprecation_date": "2027-03-15", + "input_cost_per_audio_token": 1e-06, + "output_cost_per_image_token": 3e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 32768, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_tool_choice": false, + "supports_response_schema": true, + "supports_vision": true, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_web_search": true }, - "perplexity/google/gemini-3.7-flash": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/qwen/qwen3-vl-30b-a3b-thinking": { + "deprecation_date": "2026-10-09", + "input_cost_per_token": 2e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 2.4e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "input_cost_per_token": 7.5e-07, - "output_cost_per_token": 3.75e-06, - "cache_read_input_token_cost": 7.5e-08, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "perplexity/xai/grok-4.6": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/qwen/qwen3-vl-30b-a3b-instruct": { + "input_cost_per_token": 1.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 6e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "input_cost_per_token": 2e-06, - "output_cost_per_token": 6e-06, - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token_above_200k_tokens": 4e-06, - "output_cost_per_token_above_200k_tokens": 1.2e-05, - "cache_read_input_token_cost_above_200k_tokens": 1e-06, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "perplexity/xai/grok-4.5": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/openai/gpt-5-pro": { + "input_cost_per_token": 1.5e-05, + "output_cost_per_token": 0.00012, + "litellm_provider": "openrouter", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "input_cost_per_token": 2e-06, - "output_cost_per_token": 6e-06, - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token_above_200k_tokens": 4e-06, - "output_cost_per_token_above_200k_tokens": 1.2e-05, - "cache_read_input_token_cost_above_200k_tokens": 6e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_pdf_input": true, + "supports_prompt_caching": false, + "supports_web_search": true }, - "perplexity/xai/grok-4.3": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/qwen/qwen3-vl-235b-a22b-thinking": { + "deprecation_date": "2026-10-09", + "input_cost_per_token": 4e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 4e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 2.5e-06, - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "perplexity/xai/grok-4.20-reasoning": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/qwen/qwen3-vl-235b-a22b-instruct": { + "input_cost_per_token": 2.1e-07, + "output_cost_per_token": 1.9e-06, + "cache_read_input_token_cost": 1e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 2.5e-06, - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_web_search": false }, - "perplexity/xai/grok-4.20-non-reasoning": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/qwen/qwen3-max": { + "cache_creation_input_token_cost": 9.75e-07, + "cache_creation_input_token_cost_above_128k_tokens": 2.4375e-06, + "cache_creation_input_token_cost_above_32k_tokens": 1.95e-06, + "cache_read_input_token_cost": 1.56e-07, + "cache_read_input_token_cost_above_128k_tokens": 3.9e-07, + "cache_read_input_token_cost_above_32k_tokens": 3.12e-07, + "deprecation_date": "2026-10-09", + "input_cost_per_token": 7.8e-07, + "input_cost_per_token_above_128k_tokens": 1.95e-06, + "input_cost_per_token_above_32k_tokens": 1.56e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 3.9e-06, + "output_cost_per_token_above_128k_tokens": 9.75e-06, + "output_cost_per_token_above_32k_tokens": 7.8e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 2.5e-06, - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "perplexity/xai/grok-4.20-multi-agent": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/deepseek/deepseek-v3.1-terminus": { + "cache_read_input_token_cost": 1.35e-07, + "deprecation_date": "2026-09-28", + "input_cost_per_token": 3e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 163840, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 1e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 2.5e-06, - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "perplexity/perplexity/glm-5.3": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/qwen/qwen3-coder-flash": { + "input_cost_per_token": 1.95e-07, + "input_cost_per_token_above_32k_tokens": 3.25e-07, + "cache_creation_input_token_cost_above_32k_tokens": 4.0625e-07, + "cache_read_input_token_cost_above_32k_tokens": 6.5e-08, + "output_cost_per_token_above_32k_tokens": 1.625e-06, + "output_cost_per_token": 9.75e-07, + "cache_read_input_token_cost": 3.9e-08, + "cache_creation_input_token_cost": 2.4375e-07, + "input_cost_per_token_above_128k_tokens": 5.2e-07, + "output_cost_per_token_above_128k_tokens": 2.6e-06, + "cache_read_input_token_cost_above_128k_tokens": 1.04e-07, + "cache_creation_input_token_cost_above_128k_tokens": 6.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "input_cost_per_token": 1.4e-06, - "output_cost_per_token": 4.4e-06, - "cache_read_input_token_cost": 2.6e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_vision": false, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_web_search": false }, - "perplexity/perplexity/glm-5.3-flash": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, - "supports_function_calling": true, + "openrouter/qwen/qwen3-next-80b-a3b-thinking": { "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 5e-07, - "cache_read_input_token_cost": 3e-08, - "source": "https://docs.perplexity.ai/docs/agent-api/models" - }, - "perplexity/perplexity/nemotron-3.5-lightning-30b-a3b": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "output_cost_per_token": 1.2e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": true, "supports_reasoning": true, - "input_cost_per_token": 1.15e-08, - "output_cost_per_token": 1.7e-07, - "cache_read_input_token_cost": 1.15e-09, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_response_schema": true, + "supports_vision": false, + "supports_web_search": false }, - "perplexity/perplexity/nemotron-3-ultra-550b-a55b": { - "litellm_provider": "perplexity", - "mode": "responses", - "supports_web_search": true, + "openrouter/qwen/qwen3-next-80b-a3b-instruct": { + "input_cost_per_token": 1e-07, + "output_cost_per_token": 1.1e-06, + "cache_read_input_token_cost": 7e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_reasoning": true, - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 2.5e-06, - "cache_read_input_token_cost": 2.5e-07, - "source": "https://docs.perplexity.ai/docs/agent-api/models" + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_vision": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_web_search": false }, - "openrouter/anthropic/claude-fable-5": { - "input_cost_per_token": 1e-05, - "output_cost_per_token": 5e-05, + "openrouter/qwen/qwen-plus-2025-07-28": { + "cache_creation_input_token_cost": 3.25e-07, + "cache_read_input_token_cost": 5.2e-08, + "deprecation_date": "2026-10-09", + "input_cost_per_token": 2.6e-07, + "input_cost_per_token_above_256k_tokens": 7.8e-07, "litellm_provider": "openrouter", "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "supports_sampling_params": false, - "supports_adaptive_thinking": true, - "thinking_always_on": true, + "output_cost_per_token": 7.8e-07, + "output_cost_per_token_above_256k_tokens": 2.34e-06, "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/moonshotai/kimi-k2-0905": { + "input_cost_per_token": 6e-07, + "output_cost_per_token": 2.5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 98304, + "max_tokens": 98304, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/qwen/qwen3-30b-a3b-thinking-2507": { + "deprecation_date": "2026-10-09", + "input_cost_per_token": 2e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 81920, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 2.4e-06, + "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "cache_read_input_token_cost": 1e-06, - "supports_prompt_caching": true, - "cache_creation_input_token_cost": 1.25e-05, - "cache_creation_input_token_cost_above_1hr": 2e-05, - "prompt_cache_min_tokens": 512, - "supports_web_search": true + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "openrouter/anthropic/claude-fable-5.1": { - "input_cost_per_token": 1e-05, - "output_cost_per_token": 5e-05, + "openrouter/mistralai/mistral-medium-3.1": { + "input_cost_per_token": 4e-07, + "output_cost_per_token": 2e-06, + "cache_read_input_token_cost": 4e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 131072, + "max_output_tokens": 104857, + "max_tokens": 104857, "mode": "chat", - "supports_sampling_params": false, - "supports_adaptive_thinking": true, - "thinking_always_on": true, "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 2.5e-07, "supports_prompt_caching": true, - "cache_creation_input_token_cost": 1.25e-05, - "cache_creation_input_token_cost_above_1hr": 2e-05, - "prompt_cache_min_tokens": 512, - "supports_web_search": true + "supports_reasoning": false, + "supports_web_search": false }, - "openrouter/anthropic/claude-opus-4.8": { - "input_cost_per_token": 5e-06, - "output_cost_per_token": 2.5e-05, + "openrouter/z-ai/glm-4.5v": { + "input_cost_per_token": 6e-07, + "output_cost_per_token": 1.8e-06, + "cache_read_input_token_cost": 1.1e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 65536, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "supports_sampling_params": false, - "supports_adaptive_thinking": true, "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 5e-07, "supports_prompt_caching": true, - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_1hr": 1e-05, - "supports_web_search": true + "supports_web_search": false }, - "openrouter/anthropic/claude-sonnet-5": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 1e-05, + "openrouter/mistralai/codestral-2508": { + "input_cost_per_token": 3e-07, + "output_cost_per_token": 9e-07, + "cache_read_input_token_cost": 3e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 256000, + "max_output_tokens": 204800, + "max_tokens": 204800, "mode": "chat", - "supports_sampling_params": false, - "supports_adaptive_thinking": true, "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, + "supports_vision": false, "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 2e-07, "supports_prompt_caching": true, - "cache_creation_input_token_cost": 2.5e-06, - "cache_creation_input_token_cost_above_1hr": 4e-06, - "supports_web_search": true + "supports_reasoning": false, + "supports_web_search": false }, - "openrouter/google/gemini-2.5-flash-lite": { - "cache_creation_input_token_cost": 8.33333333333333e-08, - "cache_read_input_audio_token_cost": 3e-08, - "input_cost_per_token": 1e-07, - "output_cost_per_token": 4e-07, + "openrouter/qwen/qwen3-coder-30b-a3b-instruct": { + "input_cost_per_token": 7e-08, + "output_cost_per_token": 2.8e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": true, - "cache_read_input_token_cost": 1e-08, - "deprecation_date": "2026-10-20", - "input_cost_per_audio_token": 3e-07, - "supports_prompt_caching": true, - "supports_web_search": true, - "supports_video_input": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/google/gemini-3.5-flash": { - "cache_creation_input_token_cost": 8.33333333333333e-08, - "cache_read_input_audio_token_cost": 3e-07, - "input_cost_per_token": 1.5e-06, - "output_cost_per_token": 9e-06, + "openrouter/qwen/qwen3-30b-a3b-instruct-2507": { + "input_cost_per_token": 4.815e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 262144, + "max_output_tokens": 32000, + "max_tokens": 32000, "mode": "chat", + "output_cost_per_token": 1.9305e-07, "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": true, - "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_audio_token": 3e-06, - "supports_prompt_caching": true, - "supports_web_search": true, - "supports_video_input": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "openrouter/google/gemini-3.5-flash-lite": { - "cache_creation_input_token_cost": 8.33333333333333e-08, - "cache_read_input_audio_token_cost": 3e-08, - "input_cost_per_token": 3e-07, - "output_cost_per_token": 2.5e-06, + "openrouter/z-ai/glm-4.5": { + "input_cost_per_token": 6e-07, + "output_cost_per_token": 2.2e-06, + "cache_read_input_token_cost": 1.1e-07, + "deprecation_date": "2026-12-31", "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 131072, + "max_output_tokens": 98304, + "max_tokens": 98304, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": true, - "cache_read_input_token_cost": 3e-08, - "input_cost_per_audio_token": 3e-07, + "supports_vision": false, "supports_prompt_caching": true, - "supports_web_search": true, - "supports_video_input": true + "supports_web_search": false }, - "openrouter/google/gemini-3.6-flash": { - "cache_creation_input_token_cost": 4.16666666666667e-08, - "cache_read_input_audio_token_cost": 7.5e-08, - "input_cost_per_token": 7.5e-07, - "output_cost_per_token": 3.75e-06, + "openrouter/z-ai/glm-4.5-air": { + "input_cost_per_token": 1.3e-07, + "output_cost_per_token": 8.5e-07, + "cache_read_input_token_cost": 2.5e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 131072, + "max_output_tokens": 98304, + "max_tokens": 98304, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_tool_choice": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": true, - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_audio_token": 7.5e-07, + "supports_vision": false, "supports_prompt_caching": true, - "supports_web_search": true, - "supports_video_input": true + "supports_response_schema": false, + "supports_web_search": false }, - "openrouter/google/gemini-3.7-flash": { - "cache_creation_input_token_cost": 4.16666666666667e-08, - "cache_read_input_audio_token_cost": 7.5e-08, - "input_cost_per_token": 7.5e-07, - "output_cost_per_token": 3.75e-06, + "openrouter/moonshotai/kimi-k2": { + "input_cost_per_token": 5.7e-07, + "output_cost_per_token": 2.3e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 131072, + "max_output_tokens": 98304, + "max_tokens": 98304, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": true, - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_audio_token": 7.5e-07, - "supports_prompt_caching": true, - "supports_web_search": true, - "supports_video_input": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/google/gemini-3.8-flash": { - "cache_creation_input_token_cost": 4.16666666666667e-08, - "cache_read_input_audio_token_cost": 7.5e-08, - "input_cost_per_token": 7.5e-07, - "output_cost_per_token": 3.75e-06, + "openrouter/minimax/minimax-m1": { + "input_cost_per_token": 5.5e-07, + "output_cost_per_token": 2.2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 1000000, + "max_output_tokens": 40000, + "max_tokens": 40000, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_tool_choice": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": true, - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_audio_token": 7.5e-07, - "supports_prompt_caching": true, - "supports_web_search": true, - "supports_video_input": true + "supports_response_schema": false, + "supports_vision": false, + "supports_web_search": false }, - "openrouter/openai/gpt-4o-mini": { - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, + "openrouter/openai/o3-pro": { + "input_cost_per_token": 2e-05, + "output_cost_per_token": 8e-05, "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, "supports_tool_choice": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 7.5e-08, - "supports_prompt_caching": true, + "supports_prompt_caching": false, "supports_web_search": true }, - "openrouter/openai/gpt-5.1": { + "openrouter/google/gemini-2.5-pro-preview": { "input_cost_per_token": 1.25e-06, "output_cost_per_token": 1e-05, + "cache_read_input_token_cost": 1.25e-07, + "cache_creation_input_token_cost": 3.75e-07, + "cache_read_input_audio_token_cost": 1.25e-07, + "input_cost_per_audio_token": 1.25e-06, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 1.5e-05, + "cache_read_input_token_cost_above_200k_tokens": 2.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, @@ -66172,205 +69317,180 @@ "supports_response_schema": true, "supports_vision": true, "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 1.25e-07, + "supports_audio_input": true, "supports_prompt_caching": true, "supports_web_search": true }, - "openrouter/openai/gpt-5.3-codex": { - "input_cost_per_token": 1.75e-06, - "output_cost_per_token": 1.4e-05, + "openrouter/mistralai/mistral-medium-3": { + "input_cost_per_token": 4e-07, + "output_cost_per_token": 2e-06, + "cache_read_input_token_cost": 4e-08, "litellm_provider": "openrouter", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 131072, + "max_output_tokens": 104857, + "max_tokens": 104857, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 1.75e-07, "supports_prompt_caching": true, - "supports_web_search": true + "supports_reasoning": false, + "supports_web_search": false }, - "openrouter/openai/gpt-5.4": { - "input_cost_per_token": 2.5e-06, - "output_cost_per_token": 1.5e-05, + "openrouter/google/gemini-2.5-pro-preview-05-06": { + "input_cost_per_token": 1.25e-06, + "output_cost_per_token": 1e-05, + "cache_read_input_token_cost": 1.25e-07, + "cache_creation_input_token_cost": 3.75e-07, + "input_cost_per_audio_token": 1.25e-06, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 1.5e-05, + "cache_read_input_token_cost_above_200k_tokens": 2.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 1048576, + "max_output_tokens": 65535, + "max_tokens": 65535, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", + "source": "https://openrouter.ai/google/gemini-2.5-pro-preview-05-06", "supports_function_calling": true, "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 2.5e-07, - "cache_read_input_token_cost_above_272k_tokens": 5e-07, - "input_cost_per_token_above_272k_tokens": 5e-06, - "output_cost_per_token_above_272k_tokens": 2.25e-05, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_audio_input": true, + "supports_prompt_caching": true }, - "openrouter/openai/gpt-5.4-mini": { - "input_cost_per_token": 7.5e-07, - "output_cost_per_token": 4.5e-06, + "openrouter/meta-llama/llama-guard-4-12b": { + "input_cost_per_token": 1.8e-07, + "output_cost_per_token": 1.8e-07, "litellm_provider": "openrouter", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 163840, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, "supports_audio_input": false, - "cache_read_input_token_cost": 7.5e-08, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_tool_choice": false, + "supports_response_schema": false, + "supports_vision": true, + "supports_web_search": false }, - "openrouter/openai/gpt-5.4-nano": { - "input_cost_per_token": 2e-07, - "output_cost_per_token": 1.25e-06, + "openrouter/qwen/qwen3-30b-a3b": { + "deprecation_date": "2026-10-09", + "input_cost_per_token": 1.2e-07, + "output_cost_per_token": 5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 2e-08, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/openai/gpt-5.5": { - "input_cost_per_token": 5e-06, - "output_cost_per_token": 3e-05, + "openrouter/qwen/qwen3-8b": { + "deprecation_date": "2026-10-09", + "input_cost_per_token": 1.17e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", + "output_cost_per_token": 4.55e-07, "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_tool_choice": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_above_272k_tokens": 1e-06, - "input_cost_per_token_above_272k_tokens": 1e-05, - "output_cost_per_token_above_272k_tokens": 4.5e-05, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "openrouter/openai/gpt-5.6-luna": { - "cache_creation_input_token_cost": 2.5e-07, - "cache_creation_input_token_cost_above_272k_tokens": 5e-07, - "input_cost_per_token": 2e-07, - "output_cost_per_token": 1.2e-06, + "openrouter/qwen/qwen3-14b": { + "deprecation_date": "2026-10-09", + "input_cost_per_token": 1.2e-07, + "output_cost_per_token": 2.4e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 2e-08, - "cache_read_input_token_cost_above_272k_tokens": 4e-08, - "input_cost_per_token_above_272k_tokens": 4e-07, - "output_cost_per_token_above_272k_tokens": 1.8e-06, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/openai/gpt-5.6-luna-pro": { - "input_cost_per_token": 2e-07, - "output_cost_per_token": 1.2e-06, - "cache_read_input_token_cost": 2e-08, - "cache_creation_input_token_cost": 2.5e-07, - "cache_creation_input_token_cost_above_272k_tokens": 5e-07, - "input_cost_per_token_above_272k_tokens": 4e-07, - "output_cost_per_token_above_272k_tokens": 1.8e-06, - "cache_read_input_token_cost_above_272k_tokens": 4e-08, + "openrouter/qwen/qwen3-32b": { + "input_cost_per_token": 8e-08, + "output_cost_per_token": 2.8e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/openai/gpt-5.6-terra": { - "cache_creation_input_token_cost": 2.5e-06, - "cache_creation_input_token_cost_above_272k_tokens": 5e-06, - "input_cost_per_token": 2e-06, - "output_cost_per_token": 1.2e-05, + "openrouter/qwen/qwen3-235b-a22b": { + "deprecation_date": "2026-10-09", + "input_cost_per_token": 4.55e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 131072, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", + "output_cost_per_token": 1.82e-06, "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_tool_choice": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_272k_tokens": 4e-07, - "input_cost_per_token_above_272k_tokens": 4e-06, - "output_cost_per_token_above_272k_tokens": 1.8e-05, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "openrouter/openai/gpt-5.6-terra-pro": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 1.2e-05, - "cache_read_input_token_cost": 2e-07, - "cache_creation_input_token_cost": 2.5e-06, - "cache_creation_input_token_cost_above_272k_tokens": 5e-06, - "input_cost_per_token_above_272k_tokens": 4e-06, - "output_cost_per_token_above_272k_tokens": 1.8e-05, - "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "openrouter/openai/o4-mini-high": { + "input_cost_per_token": 1.1e-06, + "output_cost_per_token": 4.4e-06, + "cache_read_input_token_cost": 2.75e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, @@ -66383,5230 +69503,5648 @@ "supports_prompt_caching": true, "supports_web_search": true }, - "openrouter/openai/o3": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 8e-06, + "openrouter/meta-llama/llama-4-maverick": { + "input_cost_per_token": 1.875e-07, + "output_cost_per_token": 6.525e-07, "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, + "max_input_tokens": 1048576, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 5e-07, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_web_search": false }, - "openrouter/openai/o4-mini": { - "input_cost_per_token": 1.1e-06, - "output_cost_per_token": 4.4e-06, + "openrouter/meta-llama/llama-4-scout": { + "input_cost_per_token": 1e-07, + "output_cost_per_token": 3e-07, "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, + "max_input_tokens": 1310720, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 2.75e-07, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_web_search": false }, - "openrouter/x-ai/grok-4.20": { - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 2.5e-06, + "openrouter/openai/o1-pro": { + "input_cost_per_token": 0.00015, + "output_cost_per_token": 0.0006, "litellm_provider": "openrouter", - "max_input_tokens": 2000000, - "max_output_tokens": 1800000, - "max_tokens": 1800000, + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", - "supports_function_calling": true, - "supports_tool_choice": true, + "supports_audio_input": false, + "supports_function_calling": false, + "supports_tool_choice": false, "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "supports_prompt_caching": true, + "supports_prompt_caching": false, "supports_web_search": true }, - "openrouter/x-ai/grok-4.20-multi-agent": { - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 2.5e-06, + "openrouter/google/gemma-3-4b-it": { + "input_cost_per_token": 5e-08, + "output_cost_per_token": 1e-07, "litellm_provider": "openrouter", - "max_input_tokens": 2000000, - "max_output_tokens": 1800000, - "max_tokens": 1800000, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": false, - "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_web_search": false }, - "openrouter/x-ai/grok-4.3": { - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 2.5e-06, + "openrouter/google/gemma-3-12b-it": { + "input_cost_per_token": 5e-08, + "output_cost_per_token": 1.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 900000, - "max_tokens": 900000, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 5e-06, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_web_search": false }, - "openrouter/x-ai/grok-4.5": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 6e-06, + "openrouter/google/gemma-3-27b-it": { + "input_cost_per_token": 8e-08, + "output_cost_per_token": 4.5e-07, + "cache_read_input_token_cost": 4e-08, "litellm_provider": "openrouter", - "max_input_tokens": 500000, - "max_output_tokens": 450000, - "max_tokens": 450000, + "max_input_tokens": 131072, + "max_output_tokens": 117964, + "max_tokens": 117964, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 3e-07, - "cache_read_input_token_cost_above_200k_tokens": 6e-07, - "input_cost_per_token_above_200k_tokens": 4e-06, - "output_cost_per_token_above_200k_tokens": 1.2e-05, "supports_prompt_caching": true, - "supports_web_search": true + "supports_reasoning": false, + "supports_web_search": false }, - "openrouter/x-ai/grok-4.6": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 6e-06, + "openrouter/mistralai/mistral-saba": { + "input_cost_per_token": 2e-07, + "output_cost_per_token": 6e-07, + "cache_read_input_token_cost": 2e-08, "litellm_provider": "openrouter", - "max_input_tokens": 500000, - "max_output_tokens": 450000, - "max_tokens": 450000, + "max_input_tokens": 32768, + "max_output_tokens": 26214, + "max_tokens": 26214, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, + "supports_vision": false, "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_above_200k_tokens": 1e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "output_cost_per_token_above_200k_tokens": 1.2e-05, "supports_prompt_caching": true, - "supports_web_search": true + "supports_reasoning": false, + "supports_web_search": false }, - "openrouter/x-ai/grok-build-0.1": { - "input_cost_per_token": 1e-06, - "output_cost_per_token": 2e-06, + "openrouter/qwen/qwen2.5-vl-72b-instruct": { + "input_cost_per_token": 8e-07, + "output_cost_per_token": 1e-06, + "cache_read_input_token_cost": 4e-07, "litellm_provider": "openrouter", - "max_input_tokens": 256000, - "max_output_tokens": 230400, - "max_tokens": 230400, + "max_input_tokens": 128000, + "max_output_tokens": 115200, + "max_tokens": 115200, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_tool_choice": false, "supports_response_schema": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": false, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "input_cost_per_token_above_200k_tokens": 2e-06, - "output_cost_per_token_above_200k_tokens": 4e-06, "supports_prompt_caching": true, - "supports_web_search": true + "supports_reasoning": false, + "supports_web_search": false }, - "baseten/zai-org/GLM-5.3": { - "cache_read_input_token_cost": 1.4e-07, - "input_cost_per_token": 1.4e-06, - "litellm_provider": "baseten", - "max_input_tokens": 1048576, - "max_output_tokens": 262144, - "max_tokens": 262144, + "openrouter/qwen/qwen-plus": { + "input_cost_per_token": 2.6e-07, + "output_cost_per_token": 7.8e-07, + "cache_read_input_token_cost": 5.2e-08, + "cache_creation_input_token_cost": 3.25e-07, + "input_cost_per_token_above_256k_tokens": 7.8e-07, + "output_cost_per_token_above_256k_tokens": 2.34e-06, + "cache_read_input_token_cost_above_256k_tokens": 1.56e-07, + "cache_creation_input_token_cost_above_256k_tokens": 9.75e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 4.4e-06, - "source": "https://www.baseten.co/pricing/", - "supported_modalities": [ - "text", - "image" - ], - "supported_output_modalities": [ - "text" - ], + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_vision": false, "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_web_search": false + }, + "openrouter/mistralai/mistral-small-24b-instruct-2501": { + "input_cost_per_token": 5e-08, + "output_cost_per_token": 8e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 32768, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_tool_choice": false, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/minimax/minimax-m3": { - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, + "openrouter/deepseek/deepseek-r1-distill-llama-70b": { + "deprecation_date": "2026-09-28", + "input_cost_per_token": 8e-07, + "output_cost_per_token": 8e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 512000, - "max_tokens": 512000, + "max_input_tokens": 8192, + "max_output_tokens": 7372, + "max_tokens": 7372, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", - "supports_function_calling": true, - "supports_tool_choice": true, + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_tool_choice": false, "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "cache_read_input_token_cost": 6e-08, + "supports_response_schema": false, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/minimax/minimax-01": { + "input_cost_per_token": 2e-07, + "output_cost_per_token": 1.1e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000192, + "max_output_tokens": 900172, + "max_tokens": 900172, + "mode": "chat", + "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, + "supports_function_calling": false, "supports_pdf_input": false, - "supports_prompt_caching": true, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": true, "supports_web_search": false }, - "openrouter/qwen/qwen3.7-plus": { - "input_cost_per_token": 3.2e-07, - "output_cost_per_token": 1.28e-06, + "openrouter/meta-llama/llama-3.3-70b-instruct": { + "input_cost_per_token": 1e-07, + "output_cost_per_token": 3.2e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "cache_read_input_token_cost": 6.4e-08, - "supports_prompt_caching": true, - "cache_creation_input_token_cost": 4e-07, - "supports_audio_input": false, - "supports_pdf_input": false, + "supports_vision": false, "supports_web_search": false }, - "openrouter/openai/gpt-6-astra": { - "input_cost_per_token": 1e-05, - "output_cost_per_token": 5e-05, - "cache_read_input_token_cost": 1e-06, - "cache_creation_input_token_cost": 1.25e-05, - "input_cost_per_token_above_272k_tokens": 2e-05, - "output_cost_per_token_above_272k_tokens": 7.5e-05, - "cache_read_input_token_cost_above_272k_tokens": 2e-06, - "cache_creation_input_token_cost_above_272k_tokens": 2.5e-05, + "openrouter/openai/gpt-4o-2024-11-20": { + "input_cost_per_token": 2.5e-06, + "output_cost_per_token": 1e-05, + "cache_read_input_token_cost": 1.25e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, + "supports_web_search": true, "supports_vision": true, "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_web_search": true + "supports_reasoning": false }, - "openrouter/openai/gpt-6-astra-pro": { - "input_cost_per_token": 1e-05, - "output_cost_per_token": 5e-05, - "cache_read_input_token_cost": 1e-06, - "cache_creation_input_token_cost": 1.25e-05, - "cache_creation_input_token_cost_above_272k_tokens": 2.5e-05, - "input_cost_per_token_above_272k_tokens": 2e-05, - "output_cost_per_token_above_272k_tokens": 7.5e-05, - "cache_read_input_token_cost_above_272k_tokens": 2e-06, + "openrouter/mistralai/mistral-large-2407": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 6e-06, + "cache_read_input_token_cost": 2e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 131072, + "max_output_tokens": 104857, + "max_tokens": 104857, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, + "supports_vision": false, "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_web_search": true + "supports_reasoning": false, + "supports_web_search": false }, - "openrouter/qwen/qwen3.8-flash": { - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 4.7e-07, - "cache_read_input_token_cost": 1.6e-08, - "cache_creation_input_token_cost": 2e-07, + "openrouter/qwen/qwen-2.5-7b-instruct": { + "input_cost_per_token": 1e-07, + "output_cost_per_token": 2e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 32768, + "max_output_tokens": 29491, + "max_tokens": 29491, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, + "supports_vision": false, "supports_web_search": false }, - "openrouter/z-ai/glm-5.3-flash": { - "input_cost_per_token": 9e-08, - "output_cost_per_token": 3e-07, - "cache_read_input_token_cost": 1.8e-08, + "openrouter/meta-llama/llama-3.2-1b-instruct": { + "input_cost_per_token": 2.7e-08, + "output_cost_per_token": 2.01e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1310720, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 60000, + "max_output_tokens": 54000, + "max_tokens": 54000, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": false, "supports_web_search": false }, - "openrouter/deepseek/deepseek-v4-flash-vision-exp": { - "input_cost_per_token": 2.2e-07, - "output_cost_per_token": 6.6e-07, - "cache_read_input_token_cost": 7e-09, + "openrouter/meta-llama/llama-3.2-3b-instruct": { + "input_cost_per_token": 5e-08, + "output_cost_per_token": 3.3e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "max_input_tokens": 131072, + "max_output_tokens": 117964, + "max_tokens": 117964, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_tool_choice": false, "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, + "supports_vision": false, "supports_web_search": false }, - "openrouter/z-ai/glm-5.3": { - "input_cost_per_token": 9.1e-07, - "output_cost_per_token": 2.86e-06, - "cache_read_input_token_cost": 1.69e-07, + "openrouter/qwen/qwen-2.5-72b-instruct": { + "input_cost_per_token": 3.6e-07, + "output_cost_per_token": 4e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1310720, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 32768, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": false, "supports_vision": false, - "supports_prompt_caching": true, "supports_web_search": false }, - "openrouter/qwen/qwen3.8-27b": { - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2.5e-06, - "cache_read_input_token_cost": 5e-08, + "openrouter/openai/gpt-4o-2024-08-06": { + "input_cost_per_token": 2.5e-06, + "output_cost_per_token": 1e-05, + "cache_read_input_token_cost": 1.25e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, + "supports_web_search": true, "supports_vision": true, + "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_web_search": false + "supports_reasoning": false }, - "openrouter/qwen/qwen3.8-2.4t-a95b": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 6e-06, - "cache_read_input_token_cost": 2.5e-07, + "openrouter/meta-llama/llama-3.1-70b-instruct": { + "input_cost_per_token": 4e-07, + "output_cost_per_token": 4e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_vision": false, - "supports_prompt_caching": true, "supports_web_search": false }, - "openrouter/nvidia/nemotron-3.5-lightning:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, + "openrouter/meta-llama/llama-3.1-8b-instruct": { + "input_cost_per_token": 5e-08, + "output_cost_per_token": 8e-08, + "cache_read_input_token_cost": 2.5e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 131072, + "max_output_tokens": 117964, + "max_tokens": 117964, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": false, - "supports_prompt_caching": false, "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_vision": false, + "supports_prompt_caching": true, + "supports_reasoning": false, "supports_web_search": false }, - "openrouter/qwen/qwen3.8-max": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 6e-06, - "cache_read_input_token_cost": 2.5e-07, - "cache_creation_input_token_cost": 2.5e-06, + "openrouter/mistralai/mistral-nemo": { + "input_cost_per_token": 1.9e-08, + "output_cost_per_token": 3e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "source": "https://openrouter.ai/qwen/qwen3.8-max", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/qwen/qwen3.8-max-0902": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 6e-06, - "cache_read_input_token_cost": 2.5e-07, - "cache_creation_input_token_cost": 2.5e-06, + "openrouter/openai/gpt-4o-mini-2024-07-18": { + "input_cost_per_token": 1.5e-07, + "output_cost_per_token": 6e-07, + "cache_read_input_token_cost": 7.5e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, + "supports_web_search": true, "supports_vision": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_web_search": false + "supports_reasoning": false }, - "openrouter/deepseek/deepseek-v4-flash-0731": { - "input_cost_per_token": 4e-08, - "output_cost_per_token": 1.6e-07, - "cache_read_input_token_cost": 1.6e-08, + "openrouter/google/gemma-2-27b-it": { + "input_cost_per_token": 6.5e-07, + "output_cost_per_token": 6.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1310720, - "max_output_tokens": 943718, - "max_tokens": 943718, + "max_input_tokens": 8192, + "max_output_tokens": 2048, + "max_tokens": 2048, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_parallel_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_tool_choice": false, + "supports_response_schema": true, "supports_vision": false, - "supports_prompt_caching": true, "supports_web_search": false }, - "openrouter/qwen/qwen3.7-flash": { - "input_cost_per_token": 3e-08, - "output_cost_per_token": 1.3e-07, - "cache_read_input_token_cost": 6e-09, - "cache_creation_input_token_cost": 3.8e-08, - "input_cost_per_token_above_256k_tokens": 2e-07, - "output_cost_per_token_above_256k_tokens": 8e-07, - "cache_read_input_token_cost_above_256k_tokens": 4e-08, - "cache_creation_input_token_cost_above_256k_tokens": 2.5e-07, + "openrouter/openai/gpt-4-turbo": { + "input_cost_per_token": 1e-05, + "output_cost_per_token": 3e-05, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 128000, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_tool_choice": true, - "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_prompt_caching": true, "supports_web_search": false }, - "openrouter/poolside/laguna-s-2.1": { - "input_cost_per_token": 9e-08, - "output_cost_per_token": 1.8e-07, - "cache_read_input_token_cost": 9e-09, + "openrouter/openai/gpt-4-turbo-preview": { + "input_cost_per_token": 1e-05, + "output_cost_per_token": 3e-05, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 128000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "source": "https://openrouter.ai/openai/gpt-4-turbo-preview", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_response_schema": true, + "supports_vision": false + }, + "openrouter/openai/gpt-3.5-turbo-instruct": { + "input_cost_per_token": 1.5e-06, + "output_cost_per_token": 2e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 4095, + "max_output_tokens": 3685, + "max_tokens": 3685, "mode": "chat", "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_tool_choice": false, + "supports_response_schema": true, "supports_vision": false, - "supports_prompt_caching": true, - "supports_response_schema": false, "supports_web_search": false }, - "openrouter/poolside/laguna-s-2.1:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", + "together_ai/arcee-ai/trinity-mini": { + "input_cost_per_token": 4.5e-08, + "litellm_provider": "together_ai", + "mode": "chat", + "output_cost_per_token": 1.5e-07, + "source": "https://api.together.ai/v1/models", + "max_input_tokens": 128000, + "max_tokens": 128000 + }, + "vertex_ai/gemini-2.5-flash-native-audio": { + "deprecation_date": "2026-12-13", + "input_cost_per_audio_token": 3e-06, + "input_cost_per_image_token": 3e-06, + "input_cost_per_token": 5e-07, + "input_cost_per_video_token": 3e-06, + "litellm_provider": "vertex_ai", + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 2e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "vertex_ai/gemini-2.5-flash-preview-tts": { + "input_cost_per_token": 5e-07, + "input_cost_per_token_batches": 2.5e-07, + "litellm_provider": "vertex_ai", + "mode": "audio_speech", + "output_cost_per_audio_token": 1e-05, + "output_cost_per_token": 1e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "vertex_ai/gemini-3.1-flash-tts-preview": { + "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 5e-07, + "litellm_provider": "vertex_ai", + "mode": "audio_speech", + "output_cost_per_audio_token": 2e-05, + "output_cost_per_token": 2e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "vertex_ai/gemini-3.5-transcribe": { + "input_cost_per_audio_token": 2e-06, + "input_cost_per_second": 5e-05, + "litellm_provider": "vertex_ai", + "mode": "audio_transcription", + "output_cost_per_token": 1.2e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "vertex_ai/gemini-3.5-transcribe-live": { + "input_cost_per_audio_token": 3.5e-06, + "input_cost_per_second": 8.33333333333e-05, + "litellm_provider": "vertex_ai", + "mode": "audio_transcription", + "output_cost_per_token": 2.1e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "vertex_ai/gemini-omni-1.1-flash": { + "input_cost_per_token": 1.5e-06, + "litellm_provider": "vertex_ai", + "mode": "chat", + "output_cost_per_reasoning_token": 9e-06, + "output_cost_per_token": 9e-06, + "output_cost_per_video_token": 1.75e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "vertex_ai/gemini-omni-1.1-flash-preview": { + "input_cost_per_token": 1.5e-06, + "litellm_provider": "vertex_ai", + "max_output_tokens": 57920, + "max_tokens": 57920, + "mode": "chat", + "output_cost_per_reasoning_token": 9e-06, + "output_cost_per_token": 9e-06, + "output_cost_per_video_token": 1.75e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1beta/interactions" + ], + "supported_modalities": [ + "text", + "image", + "video" + ], + "supported_output_modalities": [ + "text", + "video" + ], + "supports_reasoning": true, + "supports_video_input": true, + "supports_vision": true + }, + "vertex_ai/gemma-4-26b-a4b-it": { + "cache_read_input_token_cost": 1.5e-08, + "input_cost_per_token": 1.5e-07, + "litellm_provider": "vertex_ai", + "mode": "chat", + "output_cost_per_token": 6e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "gpt-5.5-cyber": { + "cache_read_input_token_cost": 1.25e-06, + "input_cost_per_token": 1.25e-05, + "litellm_provider": "openai", + "mode": "chat", + "output_cost_per_token": 7.5e-05, + "source": "https://developers.openai.com/api/docs/pricing", + "supports_reasoning": true + }, + "gpt-rosalind-research": { + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token": 5e-06, + "litellm_provider": "openai", + "mode": "chat", + "output_cost_per_token": 2.5e-05, + "source": "https://developers.openai.com/api/docs/pricing" + }, + "together_ai/meta-llama/Llama-3.1-405B-Instruct": { + "input_cost_per_token": 3.5e-06, + "litellm_provider": "together_ai", + "mode": "chat", + "output_cost_per_token": 3.5e-06, + "source": "https://api.together.ai/v1/models", + "max_input_tokens": 4096, + "max_tokens": 4096 + }, + "together_ai/meta-llama/Llama-3.2-1B-Instruct": { + "input_cost_per_token": 6e-08, + "litellm_provider": "together_ai", + "mode": "chat", + "output_cost_per_token": 6e-08, + "source": "https://api.together.ai/v1/models", + "max_input_tokens": 131072, + "max_tokens": 131072 + }, + "together_ai/meta-llama/Llama-3.2-3B-Instruct": { + "input_cost_per_token": 6e-08, + "litellm_provider": "together_ai", + "mode": "chat", + "output_cost_per_token": 6e-08, + "source": "https://api.together.ai/v1/models", + "max_input_tokens": 131072, + "max_tokens": 131072 + }, + "together_ai/Qwen/Qwen2-1.5B-Instruct": { + "input_cost_per_token": 2e-08, + "litellm_provider": "together_ai", + "mode": "chat", + "output_cost_per_token": 2e-08, + "source": "https://api.together.ai/v1/models", + "max_input_tokens": 32768, + "max_tokens": 32768 + }, + "together_ai/Qwen/Qwen2.5-14B-Instruct": { + "input_cost_per_token": 8e-07, + "litellm_provider": "together_ai", + "mode": "chat", + "output_cost_per_token": 8e-07, + "source": "https://api.together.ai/v1/models", + "max_input_tokens": 32768, + "max_tokens": 32768 + }, + "together_ai/Qwen/Qwen2.5-72B-Instruct": { + "input_cost_per_token": 1.2e-06, + "litellm_provider": "together_ai", + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "source": "https://api.together.ai/v1/models", + "max_input_tokens": 32768, + "max_tokens": 32768 + }, + "together_ai/Salesforce/Llama-Rank-V1": { + "deprecation_date": "2026-02-06", + "input_cost_per_token": 1e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 8192, + "max_tokens": 8192, + "mode": "rerank", + "output_cost_per_token": 0.0, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/meta-llama/Meta-Llama-3.1-8B": { + "input_cost_per_token": 2e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 16384, + "max_tokens": 16384, + "mode": "completion", + "output_cost_per_token": 2e-07, + "source": "https://api.together.xyz/v1/models" + }, + "together_ai/together/Tev1-4B-experimental": { + "cache_read_input_token_cost": 4.2e-08, + "input_cost_per_token": 4.2e-08, + "litellm_provider": "together_ai", + "max_input_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 0.0, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO": { + "deprecation_date": "2025-08-28", + "input_cost_per_token": 6e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 6e-07, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/QwQ-32B": { + "deprecation_date": "2025-11-13", + "input_cost_per_token": 1.2e-06, + "litellm_provider": "together_ai", + "max_input_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen2-72B-Instruct": { + "deprecation_date": "2025-08-28", + "input_cost_per_token": 9e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 9e-07, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen2-VL-72B-Instruct": { + "deprecation_date": "2025-08-28", + "input_cost_per_token": 1.2e-06, + "litellm_provider": "together_ai", + "max_input_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen2.5-72B-Instruct-Turbo": { + "deprecation_date": "2026-02-06", + "input_cost_per_token": 1.2e-06, + "litellm_provider": "together_ai", + "max_input_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen2.5-Coder-32B-Instruct": { + "deprecation_date": "2025-11-13", + "input_cost_per_token": 8e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 8e-07, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen2.5-VL-72B-Instruct": { + "deprecation_date": "2026-01-05", + "input_cost_per_token": 1.95e-06, + "litellm_provider": "together_ai", + "max_input_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 8e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen3-Coder-480B-A35B-Instruct-FP8": { + "deprecation_date": "2026-06-04", + "input_cost_per_token": 2e-06, + "litellm_provider": "together_ai", + "max_input_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 2e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen3-Coder-Next-FP8": { + "deprecation_date": "2026-05-14", + "input_cost_per_token": 5e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen3-Next-80B-A3B-Instruct": { + "deprecation_date": "2026-04-02", + "input_cost_per_token": 1.5e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 1.5e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen3-Next-80B-A3B-Thinking": { + "deprecation_date": "2026-02-25", + "input_cost_per_token": 1.5e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 1.5e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen3-VL-32B-Instruct": { + "deprecation_date": "2026-02-25", + "input_cost_per_token": 5e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 1.5e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen3-VL-8B-Instruct": { + "deprecation_date": "2026-04-16", + "input_cost_per_token": 1.8e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 6.8e-07, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/Qwen/Qwen3.5-397B-A17B": { + "cache_read_input_token_cost": 3.5e-07, + "deprecation_date": "2026-06-29", + "input_cost_per_token": 6e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 3.6e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/deepseek-ai/DeepSeek-R1-Distill-Llama-70B": { + "deprecation_date": "2025-12-23", + "input_cost_per_token": 2e-06, + "litellm_provider": "together_ai", + "max_input_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 2e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B": { + "deprecation_date": "2025-08-28", + "input_cost_per_token": 1.8e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 1.8e-07, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/deepseek-ai/DeepSeek-R1-Distill-Qwen-14B": { + "deprecation_date": "2025-11-13", + "input_cost_per_token": 1.6e-06, + "litellm_provider": "together_ai", + "max_input_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 1.6e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/deepseek-ai/DeepSeek-V3.1": { + "deprecation_date": "2026-05-14", + "input_cost_per_token": 6e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 1.7e-06, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/deepseek-ai/deepseek-coder-33b-instruct": { + "deprecation_date": "2024-08-22", + "input_cost_per_token": 8e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 8e-07, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/google/gemma-2-27b-it": { + "deprecation_date": "2025-08-28", + "input_cost_per_token": 8e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 8e-07, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/google/gemma-4-31B-it": { + "deprecation_date": "2026-09-15", + "input_cost_per_token": 3.9e-07, + "litellm_provider": "together_ai", "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_tokens": 262144, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 9.7e-07, + "source": "https://api.together.ai/v1/models" }, - "openrouter/moonshotai/kimi-k3": { - "input_cost_per_token": 1.7e-06, - "output_cost_per_token": 8.5e-06, - "cache_read_input_token_cost": 1.7e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "together_ai/meta-llama/Llama-3-8b-chat-hf": { + "deprecation_date": "2025-08-28", + "input_cost_per_token": 2e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 2e-07, + "source": "https://api.together.ai/v1/models" }, - "openrouter/poolside/laguna-xs-2.1": { - "input_cost_per_token": 6e-08, - "output_cost_per_token": 1.2e-07, - "cache_read_input_token_cost": 3e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "together_ai/meta-llama/Llama-4-Scout-17B-16E-Instruct": { + "deprecation_date": "2026-02-06", + "input_cost_per_token": 1.8e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 1048576, + "max_tokens": 1048576, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_response_schema": false, - "supports_web_search": false + "output_cost_per_token": 5.9e-07, + "source": "https://api.together.ai/v1/models" }, - "openrouter/poolside/laguna-xs-2.1:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "together_ai/meta-llama/Meta-Llama-3-70B-Instruct-Turbo": { + "deprecation_date": "2025-12-23", + "input_cost_per_token": 8.8e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 8.8e-07, + "source": "https://api.together.ai/v1/models" }, - "openrouter/google/gemini-3.1-flash-lite-image": { - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 1.5e-06, - "output_cost_per_image_token": 3e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 65536, - "max_output_tokens": 58982, - "max_tokens": 58982, + "together_ai/meta-llama/Meta-Llama-3-8B-Instruct": { + "deprecation_date": "2025-08-28", + "input_cost_per_token": 2e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": false, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": true + "output_cost_per_token": 2e-07, + "source": "https://api.together.ai/v1/models" }, - "openrouter/google/gemini-3.1-flash-image": { - "input_cost_per_token": 5e-07, - "output_cost_per_token": 3e-06, - "output_cost_per_image_token": 6e-05, - "litellm_provider": "openrouter", + "together_ai/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo": { + "deprecation_date": "2026-02-25", + "input_cost_per_token": 8.8e-07, + "litellm_provider": "together_ai", "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_tokens": 131072, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": false, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": true + "output_cost_per_token": 8.8e-07, + "source": "https://api.together.ai/v1/models" }, - "openrouter/google/gemini-3-pro-image": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 1.2e-05, - "cache_read_input_token_cost": 2e-07, - "cache_creation_input_token_cost": 3.75e-07, - "cache_read_input_audio_token_cost": 2e-07, - "input_cost_per_audio_token": 2e-06, - "output_cost_per_image_token": 0.00012, - "litellm_provider": "openrouter", + "together_ai/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo": { + "deprecation_date": "2026-03-06", + "input_cost_per_token": 1.8e-07, + "litellm_provider": "together_ai", "max_input_tokens": 131072, - "max_output_tokens": 32768, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 1.8e-07, + "source": "https://api.together.ai/v1/models" + }, + "together_ai/mistralai/Mistral-7B-Instruct-v0.1": { + "deprecation_date": "2025-11-13", + "input_cost_per_token": 2e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 32768, "max_tokens": 32768, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": true + "output_cost_per_token": 2e-07, + "source": "https://api.together.ai/v1/models" }, - "openrouter/z-ai/glm-5.2": { - "input_cost_per_token": 6.496e-07, - "output_cost_per_token": 2.0416e-06, - "cache_read_input_token_cost": 1.2064e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "together_ai/mistralai/Mistral-Small-24B-Instruct-2501": { + "deprecation_date": "2026-04-02", + "input_cost_per_token": 1e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": false, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 3e-07, + "source": "https://api.together.ai/v1/models" }, - "openrouter/z-ai/glm-5.2:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", + "together_ai/mistralai/Mixtral-8x7B-Instruct-v0.1": { + "deprecation_date": "2026-04-16", + "input_cost_per_token": 6e-07, + "litellm_provider": "together_ai", "max_input_tokens": 32768, - "max_output_tokens": 29491, - "max_tokens": 29491, + "max_tokens": 32768, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": false, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 6e-07, + "source": "https://api.together.ai/v1/models" }, - "openrouter/moonshotai/kimi-k2.7-code": { - "input_cost_per_token": 7.062e-07, - "output_cost_per_token": 3.21e-06, - "cache_read_input_token_cost": 1.8e-07, - "litellm_provider": "openrouter", + "together_ai/moonshotai/Kimi-K2.6": { + "cache_read_input_token_cost": 2e-07, + "deprecation_date": "2026-08-19", + "input_cost_per_token": 1.2e-06, + "litellm_provider": "together_ai", "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "max_tokens": 262144, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": false, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 4.5e-06, + "source": "https://api.together.ai/v1/models" }, - "openrouter/nvidia/nemotron-3.5-content-safety": { - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 117964, - "max_tokens": 117964, + "together_ai/moonshotai/Kimi-K2.7-Code": { + "cache_read_input_token_cost": 1.9e-07, + "deprecation_date": "2026-08-27", + "input_cost_per_token": 9.5e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": false, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 4e-06, + "source": "https://api.together.ai/v1/models" }, - "openrouter/nvidia/nemotron-3.5-content-safety:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "together_ai/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF": { + "deprecation_date": "2025-08-28", + "input_cost_per_token": 8.8e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": false, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 8.8e-07, + "source": "https://api.together.ai/v1/models" }, - "openrouter/nvidia/nemotron-3-ultra-550b-a55b": { + "together_ai/nvidia/nemotron-3-ultra-550b-a55b": { + "cache_read_input_token_cost": 2e-07, + "deprecation_date": "2026-08-27", "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.4e-06, - "cache_read_input_token_cost": 1.2e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 182520, - "max_tokens": 182520, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_web_search": false - }, - "openrouter/nvidia/nemotron-3-ultra-550b-a55b:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 65536, - "max_tokens": 65536, + "litellm_provider": "together_ai", + "max_input_tokens": 512288, + "max_tokens": 512288, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 3.6e-06, + "source": "https://api.together.ai/v1/models" }, - "openrouter/minimax/minimax-m3:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "together_ai/openai/gpt-oss-20b": { + "deprecation_date": "2026-09-15", + "input_cost_per_token": 5e-08, + "litellm_provider": "together_ai", + "max_input_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "source": "https://openrouter.ai/minimax/minimax-m3:free", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true + "output_cost_per_token": 2e-07, + "source": "https://api.together.ai/v1/models" }, - "openrouter/qwen/qwen3.7-max": { - "input_cost_per_token": 1.475e-06, - "output_cost_per_token": 4.425e-06, - "cache_read_input_token_cost": 2.95e-07, - "cache_creation_input_token_cost": 1.84375e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, + "together_ai/zai-org/GLM-4.5-Air-FP8": { + "deprecation_date": "2026-04-02", + "input_cost_per_token": 2e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 131072, "max_tokens": 131072, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 1.1e-06, + "source": "https://api.together.ai/v1/models" }, - "openrouter/mistralai/mistral-medium-3-5": { - "input_cost_per_token": 1.5e-06, - "output_cost_per_token": 7.5e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 209715, - "max_tokens": 209715, + "together_ai/zai-org/GLM-4.7": { + "deprecation_date": "2026-04-02", + "input_cost_per_token": 4.5e-07, + "litellm_provider": "together_ai", + "max_input_tokens": 202752, + "max_tokens": 202752, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_prompt_caching": false, - "supports_web_search": false + "output_cost_per_token": 2e-06, + "source": "https://api.together.ai/v1/models" }, - "openrouter/nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 256000, - "max_output_tokens": 65536, - "max_tokens": 65536, + "together_ai/zai-org/GLM-5": { + "deprecation_date": "2026-06-22", + "input_cost_per_token": 1e-06, + "litellm_provider": "together_ai", + "max_input_tokens": 202752, + "max_tokens": 202752, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_vision": true, - "supports_audio_input": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_response_schema": false, - "supports_web_search": false + "output_cost_per_token": 3.2e-06, + "source": "https://api.together.ai/v1/models" }, - "openrouter/qwen/qwen3.5-plus-20260420": { - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.8e-06, - "cache_creation_input_token_cost": 3.75e-07, - "input_cost_per_token_above_256k_tokens": 3.75e-07, - "output_cost_per_token_above_256k_tokens": 2.25e-06, - "cache_creation_input_token_cost_above_256k_tokens": 4.6875e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 65536, - "max_tokens": 65536, + "together_ai/zai-org/GLM-5.1": { + "cache_read_input_token_cost": 2.6e-07, + "deprecation_date": "2026-07-10", + "input_cost_per_token": 1.4e-06, + "litellm_provider": "together_ai", + "max_input_tokens": 202752, + "max_tokens": 202752, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 4.4e-06, + "source": "https://api.together.ai/v1/models" }, - "openrouter/qwen/qwen3.6-flash": { - "input_cost_per_token": 1.875e-07, - "output_cost_per_token": 1.125e-06, - "cache_creation_input_token_cost": 2.34375e-07, - "input_cost_per_token_above_256k_tokens": 7.5e-07, - "output_cost_per_token_above_256k_tokens": 3e-06, - "cache_creation_input_token_cost_above_256k_tokens": 9.375e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 65536, - "max_tokens": 65536, + "azure/eu/codex-mini": { + "deprecation_date": "2026-11-15", + "cache_read_input_token_cost": 4.13e-07, + "input_cost_per_token": 1.65e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 6.6e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3.6-35b-a3b": { - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 1e-06, - "cache_read_input_token_cost": 5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "azure/eu/computer-use-preview": { + "input_cost_per_token": 3.3e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 1.32e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3.6-max-preview": { - "input_cost_per_token": 1.027e-06, - "output_cost_per_token": 6.162e-06, - "cache_creation_input_token_cost": 1.28375e-06, - "input_cost_per_token_above_128k_tokens": 1.58e-06, - "output_cost_per_token_above_128k_tokens": 9.48e-06, - "cache_creation_input_token_cost_above_128k_tokens": 1.975e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "azure/eu/gpt-4.1": { + "deprecation_date": "2027-04-14", + "cache_read_input_token_cost": 5.5e-07, + "cache_read_input_token_cost_priority": 9.63e-07, + "input_cost_per_token": 2.2e-06, + "input_cost_per_token_batches": 1.1e-06, + "input_cost_per_token_priority": 3.85e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 8.8e-06, + "output_cost_per_token_batches": 4.4e-06, + "output_cost_per_token_priority": 1.54e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3.6-27b": { - "input_cost_per_token": 3e-07, - "output_cost_per_token": 2e-06, - "cache_read_input_token_cost": 3e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "azure/eu/gpt-4.1-mini": { + "deprecation_date": "2027-04-14", + "cache_read_input_token_cost": 1.1e-07, + "cache_read_input_token_cost_priority": 1.93e-07, + "input_cost_per_token": 4.4e-07, + "input_cost_per_token_batches": 2.2e-07, + "input_cost_per_token_priority": 7.7e-07, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 1.76e-06, + "output_cost_per_token_batches": 8.8e-07, + "output_cost_per_token_priority": 3.08e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/openai/gpt-5.5-pro": { - "input_cost_per_token": 3e-05, - "output_cost_per_token": 0.00018, - "input_cost_per_token_above_272k_tokens": 6e-05, - "output_cost_per_token_above_272k_tokens": 0.00027, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "azure/eu/gpt-4.1-nano": { + "deprecation_date": "2027-04-14", + "cache_read_input_token_cost": 2.8e-08, + "input_cost_per_token": 1.1e-07, + "input_cost_per_token_batches": 5.5e-08, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_prompt_caching": false, - "supports_web_search": true + "output_cost_per_token": 4.4e-07, + "output_cost_per_token_batches": 2.2e-07, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/openai/gpt-chat-latest": { - "input_cost_per_token": 5e-06, - "output_cost_per_token": 3e-05, - "cache_read_input_token_cost": 5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "azure/eu/gpt-4o-2024-05-13": { + "deprecation_date": "2026-12-09", + "input_cost_per_token": 5.5e-06, + "input_cost_per_token_batches": 2.75e-06, + "litellm_provider": "azure", + "max_input_tokens": 128000, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": false, - "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_web_search": true + "output_cost_per_token": 1.65e-05, + "output_cost_per_token_batches": 8.25e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/deepseek/deepseek-v4-flash": { - "input_cost_per_token": 5.544e-08, - "output_cost_per_token": 1.1088e-07, - "cache_read_input_token_cost": 1.1088e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 384000, - "max_tokens": 384000, + "azure/eu/gpt-5": { + "deprecation_date": "2027-02-09", + "cache_read_input_token_cost": 1.375e-07, + "cache_read_input_token_cost_batches": 6.875e-08, + "cache_read_input_token_cost_priority": 2.75e-07, + "input_cost_per_token": 1.375e-06, + "input_cost_per_token_batches": 6.875e-07, + "input_cost_per_token_priority": 2.75e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 1.1e-05, + "output_cost_per_token_batches": 5.5e-06, + "output_cost_per_token_priority": 2.2e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/moonshotai/kimi-k2.6": { - "input_cost_per_token": 9.5e-07, - "output_cost_per_token": 4e-06, - "cache_read_input_token_cost": 1.6e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "azure/eu/gpt-5-codex": { + "deprecation_date": "2027-03-17", + "cache_read_input_token_cost": 1.38e-07, + "input_cost_per_token": 1.375e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_parallel_function_calling": true, - "supports_pdf_input": false, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 1.1e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/google/gemma-4-26b-a4b-it": { - "cache_read_input_token_cost": 5e-08, - "input_cost_per_token": 9e-08, - "output_cost_per_token": 3e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "azure/eu/gpt-5-mini": { + "deprecation_date": "2027-02-09", + "cache_read_input_token_cost": 2.75e-08, + "cache_read_input_token_cost_batches": 1.375e-08, + "cache_read_input_token_cost_priority": 4.95e-08, + "input_cost_per_token": 2.75e-07, + "input_cost_per_token_batches": 1.375e-07, + "input_cost_per_token_priority": 4.95e-07, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 2.2e-06, + "output_cost_per_token_batches": 1.1e-06, + "output_cost_per_token_priority": 3.96e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/google/gemma-4-26b-a4b-it:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/eu/gpt-5-nano": { + "deprecation_date": "2027-02-09", + "cache_read_input_token_cost": 5.5e-09, + "cache_read_input_token_cost_batches": 2.75e-09, + "input_cost_per_token": 5.5e-08, + "input_cost_per_token_batches": 2.75e-08, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 4.4e-07, + "output_cost_per_token_batches": 2.2e-07, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/google/gemma-4-31b-it": { - "input_cost_per_token": 9e-08, - "output_cost_per_token": 3.4e-07, - "cache_read_input_token_cost": 5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 16384, - "max_tokens": 16384, + "azure/eu/gpt-5-pro": { + "deprecation_date": "2027-04-07", + "input_cost_per_token": 1.65e-05, + "input_cost_per_token_batches": 8.25e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 0.000132, + "output_cost_per_token_batches": 6.6e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/google/gemma-4-31b-it:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/eu/gpt-5.1-codex-max": { + "deprecation_date": "2027-05-18", + "cache_read_input_token_cost": 1.375e-07, + "input_cost_per_token": 1.375e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 1.1e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/z-ai/glm-5v-turbo": { - "input_cost_per_token": 1.2e-06, - "output_cost_per_token": 4e-06, - "cache_read_input_token_cost": 2.4e-07, - "deprecation_date": "2098-12-31", - "litellm_provider": "openrouter", - "max_input_tokens": 202752, - "max_output_tokens": 131072, - "max_tokens": 131072, + "azure/eu/gpt-5.2": { + "deprecation_date": "2027-06-08", + "cache_read_input_token_cost": 1.925e-07, + "cache_read_input_token_cost_batches": 9.625e-08, + "cache_read_input_token_cost_priority": 3.85e-07, + "input_cost_per_token": 1.925e-06, + "input_cost_per_token_batches": 9.625e-07, + "input_cost_per_token_priority": 3.85e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 1.54e-05, + "output_cost_per_token_batches": 7.7e-06, + "output_cost_per_token_priority": 3.08e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/minimax/minimax-m2.7": { - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, - "cache_read_input_token_cost": 6e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 204800, - "max_output_tokens": 131072, - "max_tokens": 131072, + "azure/eu/gpt-5.2-codex": { + "deprecation_date": "2027-07-13", + "cache_read_input_token_cost": 1.925e-07, + "input_cost_per_token": 1.925e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 1.54e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/minimax/minimax-m2.7:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 196608, - "max_output_tokens": 176947, - "max_tokens": 176947, + "azure/eu/gpt-5.2-pro": { + "input_cost_per_token": 2.31e-05, + "input_cost_per_token_batches": 1.155e-05, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/minimax/minimax-m2.7:free", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false + "output_cost_per_token": 0.0001848, + "output_cost_per_token_batches": 9.24e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/mistralai/mistral-small-2603": { - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, - "cache_read_input_token_cost": 1.5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 209715, - "max_tokens": 209715, + "azure/eu/gpt-5.3-codex": { + "deprecation_date": "2027-08-24", + "cache_read_input_token_cost": 1.925e-07, + "cache_read_input_token_cost_priority": 3.85e-07, + "input_cost_per_token": 1.925e-06, + "input_cost_per_token_priority": 3.85e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 1.54e-05, + "output_cost_per_token_priority": 3.08e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/z-ai/glm-5-turbo": { - "input_cost_per_token": 1.2e-06, - "output_cost_per_token": 4e-06, - "cache_read_input_token_cost": 2.4e-07, - "deprecation_date": "2098-12-31", - "litellm_provider": "openrouter", - "max_input_tokens": 202752, - "max_output_tokens": 131072, - "max_tokens": 131072, + "azure/eu/gpt-5.4-mini": { + "deprecation_date": "2027-09-21", + "cache_read_input_token_cost": 8.25e-08, + "cache_read_input_token_cost_batches": 4.125e-08, + "cache_read_input_token_cost_priority": 1.65e-07, + "input_cost_per_token": 8.25e-07, + "input_cost_per_token_batches": 4.125e-07, + "input_cost_per_token_priority": 1.65e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 4.95e-06, + "output_cost_per_token_batches": 2.475e-06, + "output_cost_per_token_priority": 9.9e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/nvidia/nemotron-3-super-120b-a12b": { - "input_cost_per_token": 8e-08, - "output_cost_per_token": 4.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "azure/eu/gpt-5.4-nano": { + "deprecation_date": "2027-09-21", + "cache_read_input_token_cost": 2.2e-08, + "cache_read_input_token_cost_batches": 1.1e-08, + "input_cost_per_token": 2.2e-07, + "input_cost_per_token_batches": 1.1e-07, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 1.375e-06, + "output_cost_per_token_batches": 6.875e-07, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/nvidia/nemotron-3-super-120b-a12b:free": { - "input_cost_per_token": 0.0, - "output_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "azure/eu/gpt-5.4-pro": { + "deprecation_date": "2027-09-07", + "input_cost_per_token": 3.3e-05, + "input_cost_per_token_above_272k_tokens": 6.6e-05, + "input_cost_per_token_above_272k_tokens_batches": 3.3e-05, + "input_cost_per_token_batches": 1.65e-05, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 0.000198, + "output_cost_per_token_above_272k_tokens": 0.000297, + "output_cost_per_token_above_272k_tokens_batches": 0.0001485, + "output_cost_per_token_batches": 9.9e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3.5-9b": { - "input_cost_per_token": 1e-07, - "output_cost_per_token": 1.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/eu/gpt-6-astra": { + "deprecation_date": "2028-01-11", + "cache_creation_input_token_cost": 1.5e-05, + "cache_creation_input_token_cost_above_272k_tokens": 3e-05, + "cache_read_input_token_cost": 1.2e-06, + "cache_read_input_token_cost_above_272k_tokens": 2.4e-06, + "input_cost_per_token": 1.2e-05, + "input_cost_per_token_above_272k_tokens": 2.4e-05, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 6e-05, + "output_cost_per_token_above_272k_tokens": 9e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'swedencentral'%20and%20priceType%20eq%20'Consumption'", + "supports_reasoning": true }, - "openrouter/openai/gpt-5.4-pro": { - "input_cost_per_token": 3e-05, - "output_cost_per_token": 0.00018, - "input_cost_per_token_above_272k_tokens": 6e-05, - "output_cost_per_token_above_272k_tokens": 0.00027, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "azure/eu/gpt-6-luna": { + "deprecation_date": "2028-03-11", + "cache_creation_input_token_cost": 1.5e-07, + "cache_creation_input_token_cost_above_272k_tokens": 3e-07, + "cache_read_input_token_cost": 1.2e-08, + "cache_read_input_token_cost_above_272k_tokens": 2.4e-08, + "input_cost_per_token": 1.2e-07, + "input_cost_per_token_above_272k_tokens": 2.4e-07, + "litellm_provider": "azure", + "max_input_tokens": 922000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 6e-07, + "output_cost_per_token_above_272k_tokens": 9e-07, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://azure.microsoft.com/en-us/blog/gpt-6-astra-sol-and-luna-for-production-agents-in-microsoft-foundry/", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_computer_use": true, "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_native_streaming": true, + "supports_none_reasoning_effort": true, + "supports_parallel_function_calling": true, "supports_pdf_input": true, - "supports_prompt_caching": false, - "supports_web_search": true - }, - "openrouter/google/gemini-3.1-flash-image-preview": { - "input_cost_per_token": 5e-07, - "output_cost_per_token": 3e-06, - "output_cost_per_image_token": 6e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 65536, - "max_output_tokens": 58982, - "max_tokens": 58982, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "supports_xhigh_reasoning_effort": true }, - "openrouter/google/gemini-3.1-pro-preview-customtools": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 1.2e-05, - "cache_read_input_token_cost": 2e-07, - "cache_creation_input_token_cost": 3.75e-07, - "cache_read_input_audio_token_cost": 2e-07, - "input_cost_per_audio_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, - "output_cost_per_token_above_200k_tokens": 1.8e-05, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "azure/eu/gpt-6-sol": { + "deprecation_date": "2028-03-11", + "cache_creation_input_token_cost": 3e-06, + "cache_creation_input_token_cost_above_272k_tokens": 6e-06, + "cache_read_input_token_cost": 2.4e-07, + "cache_read_input_token_cost_above_272k_tokens": 4.8e-07, + "input_cost_per_token": 2.4e-06, + "input_cost_per_token_above_272k_tokens": 4.8e-06, + "litellm_provider": "azure", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_above_272k_tokens": 1.8e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://azure.microsoft.com/en-us/blog/gpt-6-astra-sol-and-luna-for-production-agents-in-microsoft-foundry/", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_computer_use": true, "supports_function_calling": true, - "supports_tool_choice": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_native_streaming": true, + "supports_none_reasoning_effort": true, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": true, - "supports_prompt_caching": true, "supports_web_search": true, - "supports_video_input": true + "supports_xhigh_reasoning_effort": true }, - "openrouter/qwen/qwen3-max-thinking": { - "input_cost_per_token": 7.8e-07, - "output_cost_per_token": 3.9e-06, - "input_cost_per_token_above_128k_tokens": 1.95e-06, - "output_cost_per_token_above_128k_tokens": 9.75e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "azure/eu/o1-mini": { + "cache_read_input_token_cost": 6.05e-07, + "input_cost_per_token": 1.21e-06, + "input_cost_per_token_batches": 6.05e-07, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 4.84e-06, + "output_cost_per_token_batches": 2.42e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-coder-next": { - "input_cost_per_token": 1.2e-07, - "output_cost_per_token": 8e-07, - "cache_read_input_token_cost": 7e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "azure/eu/o3-2025-04-16": { + "deprecation_date": "2026-11-19", + "cache_read_input_token_cost": 5.5e-07, + "input_cost_per_token": 2.2e-06, + "input_cost_per_token_batches": 1.1e-06, + "litellm_provider": "azure", + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false + "output_cost_per_token": 8.8e-06, + "output_cost_per_token_batches": 4.4e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/minimax/minimax-m2-her": { - "input_cost_per_token": 3e-07, - "output_cost_per_token": 1.2e-06, - "cache_read_input_token_cost": 3e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 65536, - "max_output_tokens": 2048, - "max_tokens": 2048, + "azure/eu/o3-deep-research": { + "deprecation_date": "2026-11-19", + "cache_read_input_token_cost": 2.75e-06, + "input_cost_per_token": 1.1e-05, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_tool_choice": false, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_web_search": false + "output_cost_per_token": 4.4e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/openai/gpt-audio": { - "input_cost_per_token": 2.5e-06, - "output_cost_per_token": 1e-05, - "input_cost_per_audio_token": 3.2e-05, - "output_cost_per_audio_token": 6.4e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "azure/eu/o4-mini-2025-04-16": { + "deprecation_date": "2026-11-19", + "cache_read_input_token_cost": 3.03e-07, + "input_cost_per_token": 1.21e-06, + "input_cost_per_token_batches": 6.05e-07, + "litellm_provider": "azure", + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_audio_input": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_web_search": false + "output_cost_per_token": 4.84e-06, + "output_cost_per_token_batches": 2.42e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/openai/gpt-audio-mini": { - "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.4e-06, - "input_cost_per_audio_token": 6e-07, - "output_cost_per_audio_token": 2.4e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_audio_input": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_web_search": false + "azure/eu/text-embedding-3-large": { + "deprecation_date": "2028-02-09", + "input_cost_per_token": 1.43e-07, + "litellm_provider": "azure", + "mode": "embedding", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/nvidia/nemotron-3-nano-30b-a3b": { - "input_cost_per_token": 6e-08, - "output_cost_per_token": 2.4e-07, - "cache_read_input_token_cost": 3e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": false, - "supports_web_search": false + "azure/eu/text-embedding-3-small": { + "deprecation_date": "2028-02-09", + "input_cost_per_token": 2.2e-08, + "litellm_provider": "azure", + "mode": "embedding", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/z-ai/glm-4.6v": { - "input_cost_per_token": 3e-07, - "output_cost_per_token": 9e-07, - "cache_read_input_token_cost": 5.5e-08, - "litellm_provider": "openrouter", + "azure/eu/text-embedding-ada-002": { + "deprecation_date": "2028-02-09", + "input_cost_per_token": 1.1e-07, + "litellm_provider": "azure", + "mode": "embedding", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + }, + "gemini/gemini-3.8-live": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_image_token": 1e-06, + "input_cost_per_token": 7.5e-07, + "input_cost_per_video_token": 1e-06, + "litellm_provider": "gemini", "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 4.5e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supports_audio_input": true, + "tpm": 250000, + "rpm": 10, "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, + "supports_response_schema": false, "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": false + "supports_web_search": true, + "supports_reasoning": true }, - "openrouter/google/gemini-3-pro-image-preview": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 1.2e-05, - "cache_read_input_token_cost": 2e-07, - "cache_creation_input_token_cost": 3.75e-07, - "cache_read_input_audio_token_cost": 2e-07, - "input_cost_per_audio_token": 2e-06, - "output_cost_per_image_token": 0.00012, - "litellm_provider": "openrouter", - "max_input_tokens": 65536, - "max_output_tokens": 32768, - "max_tokens": 32768, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_tool_choice": false, - "supports_reasoning": true, - "supports_response_schema": true, + "gemini/gemini-3.8-live-extended-thinking": { + "input_cost_per_audio_token": 3e-06, + "input_cost_per_image_token": 1e-06, + "input_cost_per_token": 7.5e-07, + "input_cost_per_video_token": 1e-06, + "litellm_provider": "gemini", + "max_input_tokens": 131072, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "realtime", + "output_cost_per_audio_token": 1.2e-05, + "output_cost_per_token": 4.5e-06, + "source": "https://ai.google.dev/gemini-api/docs/pricing", + "supports_audio_input": true, + "tpm": 250000, + "rpm": 10, + "supports_function_calling": true, + "supports_response_schema": false, "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": true + "supports_web_search": true, + "supports_reasoning": true }, - "openrouter/openai/gpt-5.1-codex": { - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 1e-05, - "cache_read_input_token_cost": 1.3e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "azure/us/codex-mini": { + "deprecation_date": "2026-11-15", + "cache_read_input_token_cost": 4.13e-07, + "input_cost_per_token": 1.65e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": true + "output_cost_per_token": 6.6e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/openai/gpt-5.1-codex-mini": { - "input_cost_per_token": 2.5e-07, - "output_cost_per_token": 2e-06, - "cache_read_input_token_cost": 3e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "azure/us/computer-use-preview": { + "input_cost_per_token": 3.3e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": true + "output_cost_per_token": 1.32e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/moonshotai/kimi-k2-thinking": { - "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.5e-06, - "cache_read_input_token_cost": 1.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 98304, - "max_tokens": 98304, + "azure/us/gpt-4.1": { + "deprecation_date": "2027-04-14", + "cache_read_input_token_cost": 5.5e-07, + "cache_read_input_token_cost_priority": 9.63e-07, + "input_cost_per_token": 2.2e-06, + "input_cost_per_token_batches": 1.1e-06, + "input_cost_per_token_priority": 3.85e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 8.8e-06, + "output_cost_per_token_batches": 4.4e-06, + "output_cost_per_token_priority": 1.54e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/mistralai/voxtral-small-24b-2507": { - "input_cost_per_token": 1e-07, - "output_cost_per_token": 3e-07, - "cache_read_input_token_cost": 1e-08, - "input_cost_per_audio_token": 0.0001, - "litellm_provider": "openrouter", - "max_input_tokens": 32768, - "max_output_tokens": 26214, - "max_tokens": 26214, + "azure/us/gpt-4.1-mini": { + "deprecation_date": "2027-04-14", + "cache_read_input_token_cost": 1.1e-07, + "cache_read_input_token_cost_priority": 1.93e-07, + "input_cost_per_token": 4.4e-07, + "input_cost_per_token_batches": 2.2e-07, + "input_cost_per_token_priority": 7.7e-07, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_pdf_input": true, - "supports_audio_input": true, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false + "output_cost_per_token": 1.76e-06, + "output_cost_per_token_batches": 8.8e-07, + "output_cost_per_token_priority": 3.08e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/openai/gpt-oss-safeguard-20b": { - "input_cost_per_token": 7.5e-08, - "output_cost_per_token": 3e-07, - "cache_read_input_token_cost": 3.75e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 65536, - "max_tokens": 65536, + "azure/us/gpt-4.1-nano": { + "deprecation_date": "2027-04-14", + "cache_read_input_token_cost": 2.8e-08, + "input_cost_per_token": 1.1e-07, + "input_cost_per_token_batches": 5.5e-08, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 4.4e-07, + "output_cost_per_token_batches": 2.2e-07, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + }, + "azure/us/gpt-4o-2024-05-13": { + "deprecation_date": "2026-12-09", + "input_cost_per_token": 5.5e-06, + "input_cost_per_token_batches": 2.75e-06, + "litellm_provider": "azure", + "max_input_tokens": 128000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 1.65e-05, + "output_cost_per_token_batches": 8.25e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-vl-32b-instruct": { - "input_cost_per_token": 1.04e-07, - "output_cost_per_token": 4.16e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/us/gpt-5": { + "deprecation_date": "2027-02-09", + "cache_read_input_token_cost": 1.375e-07, + "cache_read_input_token_cost_batches": 6.875e-08, + "cache_read_input_token_cost_priority": 2.75e-07, + "input_cost_per_token": 1.375e-06, + "input_cost_per_token_batches": 6.875e-07, + "input_cost_per_token_priority": 2.75e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 1.1e-05, + "output_cost_per_token_batches": 5.5e-06, + "output_cost_per_token_priority": 2.2e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-vl-8b-thinking": { - "input_cost_per_token": 1.8e-07, - "output_cost_per_token": 2.1e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/us/gpt-5-codex": { + "deprecation_date": "2027-03-17", + "cache_read_input_token_cost": 1.38e-07, + "input_cost_per_token": 1.375e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 1.1e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-vl-8b-instruct": { - "input_cost_per_token": 1.17e-07, - "output_cost_per_token": 4.55e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/us/gpt-5-mini": { + "deprecation_date": "2027-02-09", + "cache_read_input_token_cost": 2.75e-08, + "cache_read_input_token_cost_batches": 1.375e-08, + "cache_read_input_token_cost_priority": 4.95e-08, + "input_cost_per_token": 2.75e-07, + "input_cost_per_token_batches": 1.375e-07, + "input_cost_per_token_priority": 4.95e-07, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 2.2e-06, + "output_cost_per_token_batches": 1.1e-06, + "output_cost_per_token_priority": 3.96e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/google/gemini-2.5-flash-image": { - "input_cost_per_token": 3e-07, - "output_cost_per_token": 2.5e-06, - "cache_read_input_token_cost": 3e-08, - "cache_creation_input_token_cost": 8.33333333333333e-08, - "cache_read_input_audio_token_cost": 1e-07, - "deprecation_date": "2027-03-15", - "input_cost_per_audio_token": 1e-06, - "output_cost_per_image_token": 3e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 32768, - "max_output_tokens": 8192, - "max_tokens": 8192, + "azure/us/gpt-5-nano": { + "deprecation_date": "2027-02-09", + "cache_read_input_token_cost": 5.5e-09, + "cache_read_input_token_cost_batches": 2.75e-09, + "input_cost_per_token": 5.5e-08, + "input_cost_per_token_batches": 2.75e-08, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_tool_choice": false, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": true + "output_cost_per_token": 4.4e-07, + "output_cost_per_token_batches": 2.2e-07, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-vl-30b-a3b-thinking": { - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2.4e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/us/gpt-5-pro": { + "deprecation_date": "2027-04-07", + "input_cost_per_token": 1.65e-05, + "input_cost_per_token_batches": 8.25e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 0.000132, + "output_cost_per_token_batches": 6.6e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-vl-30b-a3b-instruct": { - "input_cost_per_token": 1.3e-07, - "output_cost_per_token": 5.2e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/us/gpt-5.1-codex-max": { + "deprecation_date": "2027-05-18", + "cache_read_input_token_cost": 1.375e-07, + "input_cost_per_token": 1.375e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 1.1e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/openai/gpt-5-pro": { - "input_cost_per_token": 1.5e-05, - "output_cost_per_token": 0.00012, - "litellm_provider": "openrouter", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "azure/us/gpt-5.2": { + "deprecation_date": "2027-06-08", + "cache_read_input_token_cost": 1.925e-07, + "cache_read_input_token_cost_batches": 9.625e-08, + "cache_read_input_token_cost_priority": 3.85e-07, + "input_cost_per_token": 1.925e-06, + "input_cost_per_token_batches": 9.625e-07, + "input_cost_per_token_priority": 3.85e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_prompt_caching": false, - "supports_web_search": true + "output_cost_per_token": 1.54e-05, + "output_cost_per_token_batches": 7.7e-06, + "output_cost_per_token_priority": 3.08e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-vl-235b-a22b-thinking": { - "input_cost_per_token": 4e-07, - "output_cost_per_token": 4e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/us/gpt-5.2-codex": { + "deprecation_date": "2027-07-13", + "cache_read_input_token_cost": 1.925e-07, + "input_cost_per_token": 1.925e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": false + "output_cost_per_token": 1.54e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-vl-235b-a22b-instruct": { - "input_cost_per_token": 2.1e-07, - "output_cost_per_token": 1.9e-06, - "cache_read_input_token_cost": 1e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/us/gpt-5.2-pro": { + "input_cost_per_token": 2.31e-05, + "input_cost_per_token_batches": 1.155e-05, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false + "output_cost_per_token": 0.0001848, + "output_cost_per_token_batches": 9.24e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-max": { - "input_cost_per_token": 7.8e-07, - "output_cost_per_token": 3.9e-06, - "cache_read_input_token_cost": 1.56e-07, - "cache_creation_input_token_cost": 9.75e-07, - "input_cost_per_token_above_128k_tokens": 1.95e-06, - "output_cost_per_token_above_128k_tokens": 9.75e-06, - "cache_read_input_token_cost_above_128k_tokens": 3.9e-07, - "cache_creation_input_token_cost_above_128k_tokens": 2.4375e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "azure/us/gpt-5.3-codex": { + "deprecation_date": "2027-08-24", + "cache_read_input_token_cost": 1.925e-07, + "cache_read_input_token_cost_priority": 3.85e-07, + "input_cost_per_token": 1.925e-06, + "input_cost_per_token_priority": 3.85e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false + "output_cost_per_token": 1.54e-05, + "output_cost_per_token_priority": 3.08e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/deepseek/deepseek-v3.1-terminus": { - "input_cost_per_token": 2.7e-07, - "output_cost_per_token": 1e-06, - "cache_read_input_token_cost": 1.35e-07, - "deprecation_date": "2026-09-28", - "litellm_provider": "openrouter", - "max_input_tokens": 163840, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/us/gpt-5.4-mini": { + "deprecation_date": "2027-09-21", + "cache_read_input_token_cost": 8.25e-08, + "cache_read_input_token_cost_batches": 4.125e-08, + "cache_read_input_token_cost_priority": 1.65e-07, + "input_cost_per_token": 8.25e-07, + "input_cost_per_token_batches": 4.125e-07, + "input_cost_per_token_priority": 1.65e-06, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_web_search": false + "output_cost_per_token": 4.95e-06, + "output_cost_per_token_batches": 2.475e-06, + "output_cost_per_token_priority": 9.9e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-coder-flash": { - "input_cost_per_token": 1.95e-07, - "output_cost_per_token": 9.75e-07, - "cache_read_input_token_cost": 3.9e-08, - "cache_creation_input_token_cost": 2.4375e-07, - "input_cost_per_token_above_128k_tokens": 5.2e-07, - "output_cost_per_token_above_128k_tokens": 2.6e-06, - "cache_read_input_token_cost_above_128k_tokens": 1.04e-07, - "cache_creation_input_token_cost_above_128k_tokens": 6.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 65536, - "max_tokens": 65536, + "azure/us/gpt-5.4-nano": { + "deprecation_date": "2027-09-21", + "cache_read_input_token_cost": 2.2e-08, + "cache_read_input_token_cost_batches": 1.1e-08, + "input_cost_per_token": 2.2e-07, + "input_cost_per_token_batches": 1.1e-07, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false + "output_cost_per_token": 1.375e-06, + "output_cost_per_token_batches": 6.875e-07, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-next-80b-a3b-thinking": { - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 1.2e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/us/gpt-5.4-pro": { + "deprecation_date": "2027-09-07", + "input_cost_per_token": 3.3e-05, + "input_cost_per_token_above_272k_tokens": 6.6e-05, + "input_cost_per_token_above_272k_tokens_batches": 3.3e-05, + "input_cost_per_token_batches": 1.65e-05, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 0.000198, + "output_cost_per_token_above_272k_tokens": 0.000297, + "output_cost_per_token_above_272k_tokens_batches": 0.0001485, + "output_cost_per_token_batches": 9.9e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen3-next-80b-a3b-instruct": { - "input_cost_per_token": 9e-08, - "output_cost_per_token": 1.1e-06, - "cache_read_input_token_cost": 7e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 16384, - "max_tokens": 16384, + "azure/us/o1-mini": { + "cache_read_input_token_cost": 6.05e-07, + "input_cost_per_token": 1.21e-06, + "input_cost_per_token_batches": 6.05e-07, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_web_search": false + "output_cost_per_token": 4.84e-06, + "output_cost_per_token_batches": 2.42e-06, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" }, - "openrouter/qwen/qwen-plus-2025-07-28": { - "cache_creation_input_token_cost": 3.25e-07, - "cache_read_input_token_cost": 5.2e-08, - "input_cost_per_token": 2.6e-07, - "output_cost_per_token": 7.8e-07, - "input_cost_per_token_above_256k_tokens": 7.8e-07, - "output_cost_per_token_above_256k_tokens": 2.34e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 32768, - "max_tokens": 32768, + "azure/us/o3-deep-research": { + "deprecation_date": "2026-11-19", + "cache_read_input_token_cost": 2.75e-06, + "input_cost_per_token": 1.1e-05, + "litellm_provider": "azure", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 4.4e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + }, + "azure/us/text-embedding-3-large": { + "deprecation_date": "2028-02-09", + "input_cost_per_token": 1.43e-07, + "litellm_provider": "azure", + "mode": "embedding", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + }, + "azure/us/text-embedding-3-small": { + "deprecation_date": "2028-02-09", + "input_cost_per_token": 2.2e-08, + "litellm_provider": "azure", + "mode": "embedding", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + }, + "azure/us/text-embedding-ada-002": { + "deprecation_date": "2028-02-09", + "input_cost_per_token": 1.1e-07, + "litellm_provider": "azure", + "mode": "embedding", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + }, + "azure/gpt-realtime-2": { + "cache_creation_input_audio_token_cost": 4e-07, + "cache_read_input_audio_token_cost": 4e-07, + "cache_read_input_token_cost": 4e-07, + "deprecation_date": "2026-10-31", + "input_cost_per_audio_token": 3.2e-05, + "input_cost_per_image_token": 5e-06, + "input_cost_per_token": 4e-06, + "litellm_provider": "azure", + "max_input_tokens": 32000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "realtime", + "output_cost_per_audio_token": 6.4e-05, + "output_cost_per_token": 2.4e-05, + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/realtime" + ], + "supported_modalities": [ + "text", + "image", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_parallel_function_calling": true, + "supports_system_messages": true, + "supports_tool_choice": true + }, + "azure/gpt-live-1": { + "deprecation_date": "2027-09-10", + "input_cost_per_second": 0.000833333333333, + "litellm_provider": "azure", + "mode": "realtime", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true, + "supports_function_calling": true + }, + "azure/gpt-live-transcribe": { + "deprecation_date": "2028-02-01", + "input_cost_per_second": 0.000283333333333, + "litellm_provider": "azure", + "max_input_tokens": 32000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "audio_transcription", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/realtime", + "/v1/realtime/transcription_sessions" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true + }, + "azure/gpt-transcribe": { + "deprecation_date": "2028-02-01", + "input_cost_per_second": 7.5e-05, + "litellm_provider": "azure", + "mode": "audio_transcription", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_endpoints": [ + "/v1/audio/transcriptions", + "/v1/realtime/transcription_sessions" + ], + "supported_modalities": [ + "text", + "audio" + ], + "supported_output_modalities": [ + "text" + ], + "supports_audio_input": true }, - "openrouter/moonshotai/kimi-k2-0905": { - "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.5e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 98304, - "max_tokens": 98304, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "azure/gpt-realtime-translate": { + "deprecation_date": "2027-05-06", + "input_cost_per_second": 0.000566666666667, + "litellm_provider": "azure", + "max_input_tokens": 32000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "realtime", + "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'", + "supported_modalities": [ + "audio" + ], + "supported_output_modalities": [ + "text", + "audio" + ], + "supports_audio_input": true, + "supports_audio_output": true }, - "openrouter/qwen/qwen3-30b-a3b-thinking-2507": { - "input_cost_per_token": 2e-07, - "output_cost_per_token": 2.4e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 81920, - "max_output_tokens": 32768, - "max_tokens": 32768, + "aihubmix/agnes-2.5-flash": { + "input_cost_per_token": 3e-08, + "litellm_provider": "aihubmix", + "max_input_tokens": 512000, + "max_output_tokens": 65500, + "max_tokens": 65500, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, + "output_cost_per_token": 1.5e-07, + "source": "https://aihubmix.com/api/v1/models", "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/mistralai/mistral-medium-3.1": { - "input_cost_per_token": 4e-07, - "output_cost_per_token": 2e-06, - "cache_read_input_token_cost": 4e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 104857, - "max_tokens": 104857, + "aihubmix/agnes-2.5-pro": { + "cache_read_input_token_cost": 3.78e-09, + "input_cost_per_token": 4.5e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, + "output_cost_per_token": 9e-07, + "source": "https://aihubmix.com/api/v1/models", "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false + "supports_reasoning": true, + "supports_vision": true }, - "openrouter/z-ai/glm-4.5v": { - "input_cost_per_token": 6e-07, - "output_cost_per_token": 1.8e-06, - "cache_read_input_token_cost": 1.1e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 65536, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/cc-glm-5.1": { + "input_cost_per_token": 6e-08, + "litellm_provider": "aihubmix", + "max_input_tokens": 200000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.2e-07, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_prompt_caching": true, - "supports_web_search": false + "supports_response_schema": true }, - "openrouter/mistralai/codestral-2508": { - "input_cost_per_token": 3e-07, - "output_cost_per_token": 9e-07, - "cache_read_input_token_cost": 3e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 256000, - "max_output_tokens": 204800, - "max_tokens": 204800, + "aihubmix/claude-fable-5": { + "cache_read_input_token_cost": 1.1e-06, + "cache_creation_input_token_cost": 1.375e-05, + "input_cost_per_token": 1.1e-05, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 5.5e-05, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false - }, - "openrouter/qwen/qwen3-coder-30b-a3b-instruct": { - "input_cost_per_token": 7e-08, - "output_cost_per_token": 2.8e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/qwen/qwen3-30b-a3b-instruct-2507": { - "input_cost_per_token": 4.815e-08, - "output_cost_per_token": 1.9305e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32000, - "max_tokens": 32000, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "prompt_cache_min_tokens": 512, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_sampling_params": false }, - "openrouter/z-ai/glm-4.5": { - "input_cost_per_token": 6e-07, - "output_cost_per_token": 2.2e-06, + "aihubmix/claude-haiku-4-5": { "cache_read_input_token_cost": 1.1e-07, - "deprecation_date": "2026-12-31", - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 98304, - "max_tokens": 98304, + "cache_creation_input_token_cost": 1.375e-06, + "input_cost_per_token": 1.1e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 200000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 5.5e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, "supports_prompt_caching": true, - "supports_web_search": false - }, - "openrouter/z-ai/glm-4.5-air": { - "input_cost_per_token": 1.3e-07, - "output_cost_per_token": 8.5e-07, - "cache_read_input_token_cost": 2.5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 98304, - "max_tokens": 98304, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, "supports_reasoning": true, - "supports_vision": false, - "supports_prompt_caching": true, - "supports_response_schema": false, - "supports_web_search": false - }, - "openrouter/moonshotai/kimi-k2": { - "input_cost_per_token": 5.7e-07, - "output_cost_per_token": 2.3e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 98304, - "max_tokens": 98304, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_response_schema": true, + "supports_vision": true, + "prompt_cache_min_tokens": 4096 }, - "openrouter/minimax/minimax-m1": { - "input_cost_per_token": 4e-07, - "output_cost_per_token": 2.2e-06, - "litellm_provider": "openrouter", + "aihubmix/claude-opus-4-8-think": { + "cache_read_input_token_cost": 5e-07, + "cache_creation_input_token_cost": 6.25e-06, + "input_cost_per_token": 5e-06, + "litellm_provider": "aihubmix", "max_input_tokens": 1000000, - "max_output_tokens": 40000, - "max_tokens": 40000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.5e-05, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, - "supports_vision": false, - "supports_web_search": false + "supports_response_schema": true, + "supports_vision": true, + "prompt_cache_min_tokens": 1024, + "supports_adaptive_thinking": true, + "supports_sampling_params": false }, - "openrouter/openai/o3-pro": { - "input_cost_per_token": 2e-05, - "output_cost_per_token": 8e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, + "aihubmix/claude-opus-5": { + "cache_read_input_token_cost": 5e-07, + "cache_creation_input_token_cost": 6.25e-06, + "input_cost_per_token": 5e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.5e-05, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_prompt_caching": false, - "supports_web_search": true + "supports_web_search": true, + "supports_adaptive_thinking": true, + "prompt_cache_min_tokens": 512, + "supports_sampling_params": false }, - "openrouter/google/gemini-2.5-pro-preview": { - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 1e-05, - "cache_read_input_token_cost": 1.25e-07, - "cache_creation_input_token_cost": 3.75e-07, - "cache_read_input_audio_token_cost": 1.25e-07, - "input_cost_per_audio_token": 1.25e-06, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 1.5e-05, - "cache_read_input_token_cost_above_200k_tokens": 2.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "aihubmix/claude-sonnet-5": { + "cache_read_input_token_cost": 2e-07, + "cache_creation_input_token_cost": 2.5e-06, + "input_cost_per_token": 2e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", + "output_cost_per_token": 1e-05, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": true, - "supports_prompt_caching": true, - "supports_web_search": true + "prompt_cache_min_tokens": 1024, + "supports_adaptive_thinking": true, + "supports_sampling_params": false }, - "openrouter/mistralai/mistral-medium-3": { - "input_cost_per_token": 4e-07, - "output_cost_per_token": 2e-06, - "cache_read_input_token_cost": 4e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 104857, - "max_tokens": 104857, + "aihubmix/coding-glm-5.3": { + "cache_read_input_token_cost": 1.5e-08, + "input_cost_per_token": 6e-08, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.2e-07, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false + "supports_reasoning": true, + "supports_response_schema": true }, - "openrouter/google/gemini-2.5-pro-preview-05-06": { - "input_cost_per_token": 1.25e-06, - "output_cost_per_token": 1e-05, - "cache_read_input_token_cost": 1.25e-07, - "cache_creation_input_token_cost": 3.75e-07, - "input_cost_per_audio_token": 1.25e-06, - "input_cost_per_token_above_200k_tokens": 2.5e-06, - "output_cost_per_token_above_200k_tokens": 1.5e-05, - "cache_read_input_token_cost_above_200k_tokens": 2.5e-07, - "litellm_provider": "openrouter", + "aihubmix/coding-kimi-k3": { + "cache_read_input_token_cost": 6.6e-08, + "input_cost_per_token": 4.4e-07, + "litellm_provider": "aihubmix", "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "max_output_tokens": 1048576, + "max_tokens": 1048576, "mode": "chat", - "source": "https://openrouter.ai/google/gemini-2.5-pro-preview-05-06", + "output_cost_per_token": 1.61333e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, - "supports_audio_input": true, - "supports_prompt_caching": true - }, - "openrouter/meta-llama/llama-guard-4-12b": { - "input_cost_per_token": 1.8e-07, - "output_cost_per_token": 1.8e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 163840, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": false, - "supports_response_schema": false, - "supports_vision": true, - "supports_web_search": false + "supports_vision": true }, - "openrouter/qwen/qwen3-30b-a3b": { - "input_cost_per_token": 1.2e-07, - "output_cost_per_token": 5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/coding-xiaomi-mimo-v2-omni": { + "cache_read_input_token_cost": 1.6e-08, + "input_cost_per_token": 8e-08, + "litellm_provider": "aihubmix", "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 4e-07, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/qwen/qwen3-8b": { - "input_cost_per_token": 1.17e-07, - "output_cost_per_token": 4.55e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 8192, - "max_tokens": 8192, + "aihubmix/coding-xiaomi-mimo-v2.5": { + "cache_read_input_token_cost": 1.6e-09, + "input_cost_per_token": 8e-08, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.6e-07, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/qwen/qwen3-14b": { - "input_cost_per_token": 1.2e-07, - "output_cost_per_token": 2.4e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/coding-xiaomi-mimo-v2.5-pro": { + "cache_read_input_token_cost": 1.6e-09, + "input_cost_per_token": 2e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 4e-07, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_response_schema": true }, - "openrouter/qwen/qwen3-32b": { - "input_cost_per_token": 8e-08, - "output_cost_per_token": 2.8e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/command-a-plus-05-2026": { + "input_cost_per_token": 2.5e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 128000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1e-05, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/qwen/qwen3-235b-a22b": { - "input_cost_per_token": 4.55e-07, - "output_cost_per_token": 1.82e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 8192, - "max_tokens": 8192, + "aihubmix/deepseek-v4-flash": { + "cache_read_input_token_cost": 2.84e-08, + "input_cost_per_token": 1.42e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.84e-07, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_response_schema": true }, - "openrouter/openai/o4-mini-high": { - "input_cost_per_token": 1.1e-06, - "output_cost_per_token": 4.4e-06, - "cache_read_input_token_cost": 2.75e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, + "aihubmix/deepseek-v4-pro": { + "cache_read_input_token_cost": 1.4027e-07, + "input_cost_per_token": 1.69e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 3.38e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_web_search": true + "supports_reasoning": true, + "supports_response_schema": true }, - "openrouter/meta-llama/llama-4-maverick": { - "input_cost_per_token": 2e-07, - "output_cost_per_token": 8e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/doubao-seed-2-0-code-preview": { + "cache_read_input_token_cost": 9.644e-08, + "input_cost_per_token": 4.822e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 256000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.411e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, - "supports_response_schema": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/meta-llama/llama-4-scout": { - "input_cost_per_token": 1e-07, - "output_cost_per_token": 3e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1310720, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/doubao-seed-2-0-lite-260428": { + "cache_read_input_token_cost": 1.8082e-08, + "input_cost_per_token": 9.041e-08, + "litellm_provider": "aihubmix", + "max_input_tokens": 256000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 5.4246e-07, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/openai/o1-pro": { - "input_cost_per_token": 0.00015, - "output_cost_per_token": 0.0006, - "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, + "aihubmix/doubao-seed-2-0-mini": { + "cache_read_input_token_cost": 6.027e-09, + "input_cost_per_token": 3.0136e-08, + "litellm_provider": "aihubmix", + "max_input_tokens": 256000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_tool_choice": false, + "output_cost_per_token": 3.0136e-07, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_prompt_caching": false, "supports_web_search": true }, - "openrouter/google/gemma-3-4b-it": { - "input_cost_per_token": 5e-08, - "output_cost_per_token": 1e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/doubao-seed-2-0-pro": { + "cache_read_input_token_cost": 9.644e-08, + "input_cost_per_token": 4.822e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 256000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": false, + "output_cost_per_token": 2.411e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/google/gemma-3-12b-it": { - "input_cost_per_token": 5e-08, - "output_cost_per_token": 1.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/doubao-seed-2-1-turbo": { + "cache_read_input_token_cost": 9.295e-08, + "input_cost_per_token": 4.6475e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.32375e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/google/gemma-3-27b-it": { - "input_cost_per_token": 8e-08, - "output_cost_per_token": 4.5e-07, - "cache_read_input_token_cost": 4e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 117964, - "max_tokens": 117964, + "aihubmix/ernie-5.1": { + "cache_read_input_token_cost": 5.634e-07, + "input_cost_per_token": 5.634e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 119000, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": true, + "output_cost_per_token": 2.5353e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false + "supports_reasoning": true }, - "openrouter/mistralai/mistral-saba": { - "input_cost_per_token": 2e-07, - "output_cost_per_token": 6e-07, - "cache_read_input_token_cost": 2e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 32768, - "max_output_tokens": 26214, - "max_tokens": 26214, + "aihubmix/gemini-3-flash-preview": { + "cache_read_input_token_cost": 5e-08, + "input_cost_per_token": 5e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 3e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false - }, - "openrouter/qwen/qwen2.5-vl-72b-instruct": { - "input_cost_per_token": 8e-07, - "output_cost_per_token": 1e-06, - "cache_read_input_token_cost": 4e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 115200, - "max_tokens": 115200, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_tool_choice": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/qwen/qwen-plus": { - "input_cost_per_token": 2.6e-07, - "output_cost_per_token": 7.8e-07, - "cache_read_input_token_cost": 5.2e-08, - "cache_creation_input_token_cost": 3.25e-07, - "input_cost_per_token_above_256k_tokens": 7.8e-07, - "output_cost_per_token_above_256k_tokens": 2.34e-06, - "cache_read_input_token_cost_above_256k_tokens": 1.56e-07, - "cache_creation_input_token_cost_above_256k_tokens": 9.75e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 32768, - "max_tokens": 32768, + "aihubmix/gemini-3-flash-preview-search": { + "cache_read_input_token_cost": 5e-08, + "input_cost_per_token": 5e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 3e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false - }, - "openrouter/mistralai/mistral-small-24b-instruct-2501": { - "input_cost_per_token": 5e-08, - "output_cost_per_token": 8e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 32768, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": false, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/deepseek/deepseek-r1-distill-llama-70b": { - "deprecation_date": "2026-09-28", - "input_cost_per_token": 8e-07, - "output_cost_per_token": 8e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 8192, - "max_output_tokens": 7372, - "max_tokens": 7372, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_tool_choice": false, "supports_reasoning": true, - "supports_response_schema": false, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/minimax/minimax-01": { - "input_cost_per_token": 2e-07, - "output_cost_per_token": 1.1e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1000192, - "max_output_tokens": 900172, - "max_tokens": 900172, - "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, + "supports_response_schema": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/meta-llama/llama-3.3-70b-instruct": { - "input_cost_per_token": 1e-07, - "output_cost_per_token": 3.2e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/gemini-3.1-pro-preview": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.2e-05, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/openai/gpt-4o-2024-11-20": { - "input_cost_per_token": 2.5e-06, - "output_cost_per_token": 1e-05, - "cache_read_input_token_cost": 1.25e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/gemini-3.1-pro-preview-customtools": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.2e-05, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_web_search": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": false + "supports_web_search": true }, - "openrouter/mistralai/mistral-large-2407": { - "input_cost_per_token": 2e-06, - "output_cost_per_token": 6e-06, - "cache_read_input_token_cost": 2e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 104857, - "max_tokens": 104857, + "aihubmix/gemini-3.5-flash-lite": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 3e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.499999e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "openrouter/qwen/qwen-2.5-7b-instruct": { - "input_cost_per_token": 1e-07, - "output_cost_per_token": 2e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 32768, - "max_output_tokens": 29491, - "max_tokens": 29491, + "aihubmix/gemini-3.7-flash": { + "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_token": 7.5e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 3.75e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/meta-llama/llama-3.2-1b-instruct": { - "input_cost_per_token": 2.7e-08, - "output_cost_per_token": 2.01e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 60000, - "max_output_tokens": 54000, - "max_tokens": 54000, + "aihubmix/gemma-4-26b-a4b-it": { + "input_cost_per_token": 1.4e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 262144, + "max_output_tokens": 131100, + "max_tokens": 131100, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 3.9998e-07, + "source": "https://aihubmix.com/api/v1/models", + "supports_reasoning": true, + "supports_vision": true }, - "openrouter/meta-llama/llama-3.2-3b-instruct": { - "input_cost_per_token": 5e-08, - "output_cost_per_token": 3.3e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 117964, - "max_tokens": 117964, + "aihubmix/gemma-4-31b-it": { + "input_cost_per_token": 1.4e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 262144, + "max_output_tokens": 131100, + "max_tokens": 131100, + "mode": "chat", + "output_cost_per_token": 3.9998e-07, + "source": "https://aihubmix.com/api/v1/models", + "supports_reasoning": true, + "supports_vision": true + }, + "aihubmix/glm-5.2-fast-preview": { + "cache_read_input_token_cost": 5.635e-07, + "input_cost_per_token": 2.254e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": false, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 7.889e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true }, - "openrouter/qwen/qwen-2.5-72b-instruct": { - "input_cost_per_token": 3.6e-07, - "output_cost_per_token": 4e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 32768, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/glm-5.3": { + "cache_read_input_token_cost": 2.817e-07, + "input_cost_per_token": 1.1268e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 3.9438e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true }, - "openrouter/openai/gpt-4o-2024-08-06": { - "input_cost_per_token": 2.5e-06, - "output_cost_per_token": 1e-05, - "cache_read_input_token_cost": 1.25e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/glm-5.3-flash": { + "cache_read_input_token_cost": 2.817e-08, + "input_cost_per_token": 1.1268e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 3.9438e-07, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_web_search": true, - "supports_vision": true, - "supports_pdf_input": true, + "supports_vision": true + }, + "aihubmix/glm-5v-turbo": { + "cache_read_input_token_cost": 1.69008e-07, + "input_cost_per_token": 7.042e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 200000, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 3.09848e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_prompt_caching": true, - "supports_reasoning": false + "supports_reasoning": true, + "supports_vision": true }, - "openrouter/meta-llama/llama-3.1-70b-instruct": { - "input_cost_per_token": 4e-07, - "output_cost_per_token": 4e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/gpt-5.3-codex": { + "cache_read_input_token_cost": 1.75e-07, + "input_cost_per_token": 1.75e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.4e-05, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/meta-llama/llama-3.1-8b-instruct": { - "input_cost_per_token": 5e-08, - "output_cost_per_token": 8e-08, - "cache_read_input_token_cost": 2.5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 117964, - "max_tokens": 117964, + "aihubmix/gpt-5.4-high": { + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 2.5e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.5e-05, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_tool_choice": true, - "supports_response_schema": true, - "supports_vision": false, "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_web_search": false + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "openrouter/mistralai/mistral-nemo": { - "input_cost_per_token": 1.9e-08, - "output_cost_per_token": 3e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "aihubmix/gpt-5.4-low": { + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 2.5e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.5e-05, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/openai/gpt-4o-mini-2024-07-18": { - "input_cost_per_token": 1.5e-07, - "output_cost_per_token": 6e-07, + "aihubmix/gpt-5.4-mini": { "cache_read_input_token_cost": 7.5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "input_cost_per_token": 7.5e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 4.5e-06, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_web_search": true, "supports_vision": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": false + "supports_web_search": true }, - "openrouter/google/gemma-2-27b-it": { - "input_cost_per_token": 6.5e-07, - "output_cost_per_token": 6.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 8192, - "max_output_tokens": 2048, - "max_tokens": 2048, + "aihubmix/gpt-5.4-nano": { + "cache_read_input_token_cost": 2e-08, + "input_cost_per_token": 2e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": false, + "output_cost_per_token": 1.25e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/openai/gpt-4-turbo": { - "input_cost_per_token": 1e-05, - "output_cost_per_token": 3e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, + "aihubmix/gpt-5.5": { + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token": 5e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 3e-05, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/openai/gpt-4-turbo-preview": { - "input_cost_per_token": 1e-05, - "output_cost_per_token": 3e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, + "aihubmix/gpt-5.5-pro": { + "input_cost_per_token": 3e-05, + "litellm_provider": "aihubmix", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/openai/gpt-4-turbo-preview", + "output_cost_per_token": 0.00018, + "source": "https://aihubmix.com/api/v1/models", "supports_function_calling": true, - "supports_tool_choice": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/openai/gpt-3.5-turbo-instruct": { - "input_cost_per_token": 1.5e-06, - "output_cost_per_token": 2e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 4095, - "max_output_tokens": 3685, - "max_tokens": 3685, + "aihubmix/gpt-5.6-luna": { + "cache_read_input_token_cost": 2e-08, + "cache_creation_input_token_cost": 2.5e-07, + "input_cost_per_token": 2e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_tool_choice": false, + "output_cost_per_token": 1.2e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": false, - "supports_web_search": false - }, - "together_ai/arcee-ai/trinity-mini": { - "input_cost_per_token": 4.5e-08, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 1.5e-07, - "source": "https://api.together.ai/v1/models" + "supports_vision": true }, - "together_ai/deepseek-ai/deepseek-coder-33b-instruct": { - "deprecation_date": "2024-08-22", - "input_cost_per_token": 8e-07, - "litellm_provider": "together_ai", + "aihubmix/gpt-5.6-sol-disc": { + "cache_read_input_token_cost": 4e-07, + "cache_creation_input_token_cost": 5e-06, + "input_cost_per_token": 4e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 8e-07, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 2e-05, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true }, - "together_ai/deepseek-ai/DeepSeek-R1-Distill-Llama-70B": { - "deprecation_date": "2025-12-23", + "aihubmix/gpt-5.6-terra": { + "cache_read_input_token_cost": 2e-07, + "cache_creation_input_token_cost": 2.5e-06, "input_cost_per_token": 2e-06, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://api.together.ai/v1/models" - }, - "together_ai/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B": { - "deprecation_date": "2025-08-28", - "input_cost_per_token": 1.8e-07, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 1.8e-07, - "source": "https://api.together.ai/v1/models" - }, - "together_ai/deepseek-ai/DeepSeek-R1-Distill-Qwen-14B": { - "deprecation_date": "2025-11-13", - "input_cost_per_token": 1.6e-06, - "litellm_provider": "together_ai", + "litellm_provider": "aihubmix", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.6e-06, - "source": "https://api.together.ai/v1/models" - }, - "vertex_ai/gemini-2.5-flash-native-audio": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_token": 5e-07, - "litellm_provider": "vertex_ai", - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 2e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" - }, - "vertex_ai/gemini-2.5-flash-preview-tts": { - "input_cost_per_token": 5e-07, - "input_cost_per_token_batches": 2.5e-07, - "litellm_provider": "vertex_ai", - "mode": "audio_speech", - "output_cost_per_audio_token": 1e-05, - "output_cost_per_token": 1e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" - }, - "vertex_ai/gemini-3.1-flash-live-preview": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_second": 8.33333333333e-05, - "input_cost_per_token": 7.5e-07, - "litellm_provider": "vertex_ai", - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 4.5e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" - }, - "vertex_ai/gemini-3.1-flash-tts-preview": { - "input_cost_per_token": 1e-06, - "input_cost_per_token_batches": 5e-07, - "litellm_provider": "vertex_ai", - "mode": "audio_speech", - "output_cost_per_audio_token": 2e-05, - "output_cost_per_token": 2e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" - }, - "vertex_ai/gemini-3.5-transcribe": { - "input_cost_per_audio_token": 2e-06, - "input_cost_per_second": 5e-05, - "litellm_provider": "vertex_ai", - "mode": "audio_transcription", "output_cost_per_token": 1.2e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" - }, - "vertex_ai/gemini-3.5-transcribe-live": { - "input_cost_per_audio_token": 3.5e-06, - "input_cost_per_second": 8.33333333333e-05, - "litellm_provider": "vertex_ai", - "mode": "audio_transcription", - "output_cost_per_token": 2.1e-05, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" - }, - "vertex_ai/gemini-omni-1.1-flash": { - "input_cost_per_token": 1.5e-06, - "litellm_provider": "vertex_ai", - "mode": "chat", - "output_cost_per_token": 9e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" - }, - "vertex_ai/gemini-robotics-er-2": { - "cache_read_input_token_cost": 1e-07, - "input_cost_per_token": 1e-06, - "input_cost_per_token_batches": 5e-07, - "litellm_provider": "vertex_ai", - "mode": "chat", - "output_cost_per_token": 5e-06, - "output_cost_per_token_batches": 2.5e-06, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" - }, - "vertex_ai/gemma-4-26b-a4b-it": { - "cache_read_input_token_cost": 1.5e-08, - "input_cost_per_token": 1.5e-07, - "litellm_provider": "vertex_ai", - "mode": "chat", - "output_cost_per_token": 6e-07, - "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" - }, - "together_ai/google/gemma-2-27b-it": { - "deprecation_date": "2025-08-28", - "input_cost_per_token": 8e-07, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 8e-07, - "source": "https://api.together.ai/v1/models" - }, - "gpt-5.5-cyber": { - "cache_read_input_token_cost": 1.25e-06, - "input_cost_per_token": 1.25e-05, - "litellm_provider": "openai", - "mode": "chat", - "output_cost_per_token": 7.5e-05, - "source": "https://developers.openai.com/api/docs/pricing", - "supports_reasoning": true + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true }, - "gpt-rosalind-research": { + "aihubmix/gpt-chat-latest": { "cache_read_input_token_cost": 5e-07, "input_cost_per_token": 5e-06, - "litellm_provider": "openai", - "mode": "chat", - "output_cost_per_token": 2.5e-05, - "source": "https://developers.openai.com/api/docs/pricing" - }, - "together_ai/meta-llama/Llama-3-8b-chat-hf": { - "deprecation_date": "2025-08-28", - "input_cost_per_token": 2e-07, - "litellm_provider": "together_ai", - "mode": "chat", - "output_cost_per_token": 2e-07, - "source": "https://api.together.ai/v1/models" - }, - "together_ai/meta-llama/Llama-3.1-405B-Instruct": { - "input_cost_per_token": 3.5e-06, - "litellm_provider": "together_ai", + "litellm_provider": "aihubmix", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3.5e-06, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 3e-05, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "together_ai/meta-llama/Llama-3.2-1B-Instruct": { - "input_cost_per_token": 6e-08, - "litellm_provider": "together_ai", + "aihubmix/grok-4-20-non-reasoning": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 6e-08, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 6e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true }, - "together_ai/meta-llama/Llama-3.2-3B-Instruct": { - "input_cost_per_token": 6e-08, - "litellm_provider": "together_ai", + "aihubmix/grok-4-20-reasoning": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 6e-08, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 6e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true }, - "together_ai/meta-llama/Meta-Llama-3-70B-Instruct-Turbo": { - "deprecation_date": "2025-12-23", - "input_cost_per_token": 8.8e-07, - "litellm_provider": "together_ai", + "aihubmix/grok-4.6": { + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 8.8e-07, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 6e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true }, - "together_ai/meta-llama/Meta-Llama-3-8B-Instruct": { - "deprecation_date": "2025-08-28", - "input_cost_per_token": 2e-07, - "litellm_provider": "together_ai", + "aihubmix/grok-build-0.1": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, "mode": "chat", - "output_cost_per_token": 2e-07, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 2e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true }, - "together_ai/NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO": { - "deprecation_date": "2025-08-28", - "input_cost_per_token": 6e-07, - "litellm_provider": "together_ai", + "aihubmix/hy3": { + "cache_read_input_token_cost": 3.905e-08, + "input_cost_per_token": 1.562e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 256000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6e-07, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 6.248e-07, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_web_search": true }, - "together_ai/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF": { - "deprecation_date": "2025-08-28", - "input_cost_per_token": 8.8e-07, - "litellm_provider": "together_ai", + "aihubmix/hy4-preview": { + "cache_read_input_token_cost": 4.225e-08, + "input_cost_per_token": 8.45e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 8.8e-07, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 2.535e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_web_search": true }, - "together_ai/Qwen/Qwen2-1.5B-Instruct": { - "input_cost_per_token": 2e-08, - "litellm_provider": "together_ai", + "aihubmix/kimi-k2.6": { + "cache_read_input_token_cost": 1.60835e-07, + "input_cost_per_token": 9.5e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 2e-08, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 3.9995e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true }, - "together_ai/Qwen/Qwen2-72B-Instruct": { - "deprecation_date": "2025-08-28", - "input_cost_per_token": 9e-07, - "litellm_provider": "together_ai", + "aihubmix/kimi-k2.7-code-highspeed": { + "cache_read_input_token_cost": 3.2167e-07, + "input_cost_per_token": 1.9e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 9e-07, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 7.999e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true }, - "together_ai/Qwen/Qwen2-VL-72B-Instruct": { - "deprecation_date": "2025-08-28", - "input_cost_per_token": 1.2e-06, - "litellm_provider": "together_ai", + "aihubmix/kimi-k3": { + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 3e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, + "max_output_tokens": 1048576, + "max_tokens": 1048576, "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 1.5e-05, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true }, - "together_ai/Qwen/Qwen2.5-14B-Instruct": { - "input_cost_per_token": 8e-07, - "litellm_provider": "together_ai", + "aihubmix/longcat-2.0": { + "cache_read_input_token_cost": 1.5492e-08, + "input_cost_per_token": 7.746e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 8e-07, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 3.0984e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true }, - "together_ai/Qwen/Qwen2.5-72B-Instruct": { - "input_cost_per_token": 1.2e-06, - "litellm_provider": "together_ai", + "aihubmix/mai-thinking-1": { + "input_cost_per_token": 2e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 256000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 8e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_reasoning": true, + "supports_response_schema": true }, - "together_ai/Qwen/Qwen2.5-Coder-32B-Instruct": { - "deprecation_date": "2025-11-13", - "input_cost_per_token": 8e-07, - "litellm_provider": "together_ai", + "aihubmix/mimo-v2-omni": { + "cache_read_input_token_cost": 8.8e-08, + "input_cost_per_token": 4.4e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 256000, "mode": "chat", - "output_cost_per_token": 8e-07, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 2.2e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_prompt_caching": true, + "supports_vision": true, + "supports_web_search": true }, - "together_ai/Qwen/Qwen2.5-VL-72B-Instruct": { - "deprecation_date": "2026-01-05", - "input_cost_per_token": 1.95e-06, - "litellm_provider": "together_ai", + "aihubmix/mimo-v2-pro": { + "cache_read_input_token_cost": 2.2e-07, + "input_cost_per_token": 1.1e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://api.together.ai/v1/models" + "output_cost_per_token": 3.3e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_prompt_caching": true, + "supports_web_search": true }, - "azure/eu/codex-mini": { - "deprecation_date": "2026-11-15", - "cache_read_input_token_cost": 4.13e-07, - "input_cost_per_token": 1.65e-06, - "litellm_provider": "azure", + "aihubmix/minimax-m2.7": { + "cache_read_input_token_cost": 5.916e-08, + "input_cost_per_token": 2.958e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 204800, + "max_output_tokens": 204800, + "max_tokens": 204800, "mode": "chat", - "output_cost_per_token": 6.6e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.1832e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true }, - "azure/eu/computer-use-preview": { - "input_cost_per_token": 3.3e-06, - "litellm_provider": "azure", + "aihubmix/minimax-m3": { + "input_cost_per_token": 2.88e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 524288, + "max_tokens": 524288, "mode": "chat", - "output_cost_per_token": 1.32e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.152e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true }, - "azure/eu/gpt-4.1": { - "deprecation_date": "2027-04-14", - "cache_read_input_token_cost": 5.5e-07, - "cache_read_input_token_cost_priority": 9.63e-07, - "input_cost_per_token": 2.2e-06, - "input_cost_per_token_batches": 1.1e-06, - "input_cost_per_token_priority": 3.85e-06, - "litellm_provider": "azure", + "aihubmix/muse-spark-1.2": { + "input_cost_per_token": 1.375e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1048576, "mode": "chat", - "output_cost_per_token": 8.8e-06, - "output_cost_per_token_batches": 4.4e-06, - "output_cost_per_token_priority": 1.54e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 4.675e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_vision": true }, - "azure/eu/gpt-4.1-mini": { - "deprecation_date": "2027-04-14", - "cache_read_input_token_cost": 1.1e-07, - "cache_read_input_token_cost_priority": 1.93e-07, - "input_cost_per_token": 4.4e-07, - "input_cost_per_token_batches": 2.2e-07, - "input_cost_per_token_priority": 7.7e-07, - "litellm_provider": "azure", + "aihubmix/qwen3-coder-next": { + "input_cost_per_token": 1.37e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.76e-06, - "output_cost_per_token_batches": 8.8e-07, - "output_cost_per_token_priority": 3.08e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 5.48e-07, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_response_schema": true }, - "azure/eu/gpt-4.1-nano": { - "deprecation_date": "2027-04-14", - "cache_read_input_token_cost": 2.8e-08, - "input_cost_per_token": 1.1e-07, - "input_cost_per_token_batches": 5.5e-08, - "litellm_provider": "azure", + "aihubmix/qwen3.5-122b-a10b": { + "input_cost_per_token": 1.126e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 4.4e-07, - "output_cost_per_token_batches": 2.2e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 9.008e-07, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/eu/gpt-4o-2024-05-13": { - "deprecation_date": "2026-10-01", - "input_cost_per_token": 5.5e-06, - "input_cost_per_token_batches": 2.75e-06, - "litellm_provider": "azure", + "aihubmix/qwen3.5-397b-a17b": { + "input_cost_per_token": 1.644e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.65e-05, - "output_cost_per_token_batches": 8.25e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 9.864e-07, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/eu/gpt-5": { - "deprecation_date": "2027-02-09", - "cache_read_input_token_cost": 1.375e-07, - "cache_read_input_token_cost_priority": 2.75e-07, - "input_cost_per_token": 1.375e-06, - "input_cost_per_token_batches": 6.875e-07, - "input_cost_per_token_priority": 2.75e-06, - "litellm_provider": "azure", + "aihubmix/qwen3.6-27b": { + "input_cost_per_token": 4.22e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.1e-05, - "output_cost_per_token_batches": 5.5e-06, - "output_cost_per_token_priority": 2.2e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 2.532e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/eu/gpt-5-codex": { - "deprecation_date": "2027-03-17", - "cache_read_input_token_cost": 1.38e-07, - "input_cost_per_token": 1.375e-06, - "litellm_provider": "azure", + "aihubmix/qwen3.6-35b-a3b": { + "input_cost_per_token": 2.54e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.1e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.524e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/eu/gpt-5-mini": { - "deprecation_date": "2027-02-09", - "cache_read_input_token_cost": 2.75e-08, - "cache_read_input_token_cost_priority": 4.95e-08, - "input_cost_per_token": 2.75e-07, - "input_cost_per_token_batches": 1.375e-07, - "input_cost_per_token_priority": 4.95e-07, - "litellm_provider": "azure", + "aihubmix/qwen3.6-max-preview": { + "cache_read_input_token_cost": 1.268e-07, + "cache_creation_input_token_cost": 1.585e-06, + "input_cost_per_token": 1.268e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 2.2e-06, - "output_cost_per_token_batches": 1.1e-06, - "output_cost_per_token_priority": 3.96e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 7.608e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_web_search": true }, - "azure/eu/gpt-5-nano": { - "deprecation_date": "2027-02-09", - "cache_read_input_token_cost": 5.5e-09, - "input_cost_per_token": 5.5e-08, - "input_cost_per_token_batches": 2.75e-08, - "litellm_provider": "azure", + "aihubmix/qwen3.7-plus": { + "cache_read_input_token_cost": 5.64e-08, + "cache_creation_input_token_cost": 3.525e-07, + "input_cost_per_token": 2.82e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 4.4e-07, - "output_cost_per_token_batches": 2.2e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.128e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/eu/gpt-5-pro": { - "deprecation_date": "2027-04-07", - "input_cost_per_token": 1.65e-05, - "input_cost_per_token_batches": 8.25e-06, - "litellm_provider": "azure", + "aihubmix/qwen3.8-2.4t-a95b": { + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 0.000132, - "output_cost_per_token_batches": 6.6e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 6e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_web_search": true }, - "azure/eu/gpt-5.1-codex-max": { - "deprecation_date": "2027-05-18", - "cache_read_input_token_cost": 1.375e-07, - "input_cost_per_token": 1.375e-06, - "litellm_provider": "azure", + "aihubmix/qwen3.8-flash": { + "cache_read_input_token_cost": 1.4075e-08, + "cache_creation_input_token_cost": 1.75937e-07, + "input_cost_per_token": 1.126e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.1e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 3.80025e-07, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/eu/gpt-5.2": { - "deprecation_date": "2027-06-08", - "cache_read_input_token_cost": 1.925e-07, - "cache_read_input_token_cost_priority": 3.85e-07, - "input_cost_per_token": 1.925e-06, - "input_cost_per_token_batches": 9.625e-07, - "input_cost_per_token_priority": 3.85e-06, - "litellm_provider": "azure", + "aihubmix/qwen3.8-max": { + "cache_read_input_token_cost": 1.69e-07, + "cache_creation_input_token_cost": 2.1125e-06, + "input_cost_per_token": 1.69e-06, + "litellm_provider": "aihubmix", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.54e-05, - "output_cost_per_token_batches": 7.7e-06, - "output_cost_per_token_priority": 3.08e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 5.07e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/eu/gpt-5.2-chat": { - "deprecation_date": "2026-06-29", - "cache_read_input_token_cost": 1.925e-07, - "input_cost_per_token": 1.925e-06, - "litellm_provider": "azure", + "aihubmix/step-3.7-flash": { + "cache_read_input_token_cost": 4.4e-08, + "input_cost_per_token": 2.2e-07, + "litellm_provider": "aihubmix", + "max_input_tokens": 256000, "mode": "chat", - "output_cost_per_token": 1.54e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.32e-06, + "source": "https://aihubmix.com/api/v1/models", + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_vision": true }, - "azure/eu/gpt-5.2-codex": { - "deprecation_date": "2027-07-13", - "cache_read_input_token_cost": 1.925e-07, - "input_cost_per_token": 1.925e-06, - "litellm_provider": "azure", - "mode": "chat", - "output_cost_per_token": 1.54e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "openrouter/typesafe/jev-1.13": { + "input_cost_per_token": 4.2e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 32000, + "max_output_tokens": 28800, + "max_tokens": 28800, + "mode": "evaluation", + "output_cost_per_token": 0.0, + "source": "https://openrouter.ai/typesafe/jev-1.13" }, - "azure/eu/gpt-5.2-pro": { - "input_cost_per_token": 2.31e-05, - "input_cost_per_token_batches": 1.155e-05, - "litellm_provider": "azure", + "openrouter/typesafe/jev-router": { + "input_cost_per_token": 0, + "output_cost_per_token": 0, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 0.0001848, - "output_cost_per_token_batches": 9.24e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "source": "https://openrouter.ai/typesafe/jev-router", + "supports_function_calling": true, + "supports_tool_choice": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_vision": true, + "supports_pdf_input": true, + "supports_audio_input": true, + "supports_video_input": true }, - "azure/eu/gpt-5.3-chat": { - "deprecation_date": "2026-06-29", - "cache_read_input_token_cost": 1.925e-07, - "input_cost_per_token": 1.925e-06, - "litellm_provider": "azure", - "mode": "chat", - "output_cost_per_token": 1.54e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "typesafe/jev-1.13.0": { + "input_cost_per_token": 4.2e-08, + "litellm_provider": "typesafe", + "mode": "evaluation", + "output_cost_per_token": 0.0, + "source": "https://docs.typesafe.ai/models" }, - "azure/eu/gpt-5.3-codex": { - "deprecation_date": "2027-08-24", - "cache_read_input_token_cost": 1.925e-07, - "cache_read_input_token_cost_priority": 3.85e-07, - "input_cost_per_token": 1.925e-06, - "input_cost_per_token_priority": 3.85e-06, - "litellm_provider": "azure", - "mode": "chat", - "output_cost_per_token": 1.54e-05, - "output_cost_per_token_priority": 3.08e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "typesafe/jev-latest": { + "input_cost_per_token": 4.2e-08, + "litellm_provider": "typesafe", + "mode": "evaluation", + "output_cost_per_token": 0.0, + "source": "https://docs.typesafe.ai/models" }, - "azure/eu/gpt-5.4-mini": { - "deprecation_date": "2027-09-21", - "cache_read_input_token_cost": 8.25e-08, - "cache_read_input_token_cost_priority": 1.65e-07, - "input_cost_per_token": 8.25e-07, - "input_cost_per_token_batches": 4.125e-07, - "input_cost_per_token_priority": 1.65e-06, - "litellm_provider": "azure", - "mode": "chat", - "output_cost_per_token": 4.95e-06, - "output_cost_per_token_batches": 2.475e-06, - "output_cost_per_token_priority": 9.9e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "typesafe/jev-preview": { + "input_cost_per_token": 4.2e-08, + "litellm_provider": "typesafe", + "mode": "evaluation", + "output_cost_per_token": 0.0, + "source": "https://docs.typesafe.ai/models" }, - "azure/eu/gpt-5.4-nano": { - "deprecation_date": "2027-09-21", - "cache_read_input_token_cost": 2.2e-08, - "input_cost_per_token": 2.2e-07, - "input_cost_per_token_batches": 1.1e-07, - "litellm_provider": "azure", + "wandb/deepseek-ai/DeepSeek-V4.1-Flash": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 2e-07, + "litellm_provider": "wandb", + "max_input_tokens": 1049000, + "max_tokens": 1048576, "mode": "chat", - "output_cost_per_token": 1.375e-06, - "output_cost_per_token_batches": 6.875e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 6.5e-07, + "source": "https://wandb.ai/site/pricing/tokens/", + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_vision": true }, - "azure/eu/gpt-5.4-pro": { - "deprecation_date": "2027-09-07", - "input_cost_per_token": 3.3e-05, - "input_cost_per_token_above_272k_tokens": 6.6e-05, - "input_cost_per_token_batches": 1.65e-05, - "litellm_provider": "azure", + "wandb/google/gemma-4-26B-A4B-it": { + "cache_read_input_token_cost": 5e-08, + "input_cost_per_token": 1e-07, + "litellm_provider": "wandb", + "max_input_tokens": 262000, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 0.000198, - "output_cost_per_token_above_272k_tokens": 0.000297, - "output_cost_per_token_batches": 9.9e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 3e-07, + "source": "https://wandb.ai/site/pricing/tokens/", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true }, - "azure/eu/gpt-6-astra": { - "cache_creation_input_token_cost": 1.375e-05, - "cache_creation_input_token_cost_above_272k_tokens": 2.75e-05, - "cache_read_input_token_cost": 1.1e-06, - "cache_read_input_token_cost_above_272k_tokens": 2.2e-06, - "input_cost_per_token": 1.1e-05, - "input_cost_per_token_above_272k_tokens": 2.2e-05, - "litellm_provider": "azure", + "wandb/zai-org/GLM-5.3-Flash": { + "cache_read_input_token_cost": 5e-08, + "input_cost_per_token": 1.5e-07, + "litellm_provider": "wandb", + "max_input_tokens": 1049000, "mode": "chat", - "output_cost_per_token": 5.5e-05, - "output_cost_per_token_above_272k_tokens": 8.25e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 5e-07, + "source": "https://docs.wandb.ai/inference/models.md", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true }, - "azure/eu/o1-mini": { - "cache_read_input_token_cost": 6.05e-07, - "input_cost_per_token": 1.21e-06, - "input_cost_per_token_batches": 6.05e-07, - "litellm_provider": "azure", + "openrouter/~anthropic/claude-fable-latest": { + "cache_creation_input_token_cost": 1.25e-05, + "cache_creation_input_token_cost_above_1hr": 2e-05, + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 1e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 4.84e-06, - "output_cost_per_token_batches": 2.42e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 5e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/eu/o1-preview": { - "cache_read_input_token_cost": 8.25e-06, - "input_cost_per_token": 1.65e-05, - "litellm_provider": "azure", + "openrouter/~anthropic/claude-haiku-latest": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_creation_input_token_cost_above_1hr": 2e-06, + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 1e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 200000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 6.6e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/eu/o3-2025-04-16": { - "deprecation_date": "2026-11-19", - "cache_read_input_token_cost": 5.5e-07, - "input_cost_per_token": 2.2e-06, - "input_cost_per_token_batches": 1.1e-06, - "litellm_provider": "azure", + "openrouter/~anthropic/claude-opus-latest": { + "cache_creation_input_token_cost": 5e-06, + "cache_creation_input_token_cost_above_1hr": 8e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 4e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 8.8e-06, - "output_cost_per_token_batches": 4.4e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 2e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/eu/o3-deep-research": { - "deprecation_date": "2026-11-19", - "cache_read_input_token_cost": 2.75e-06, - "input_cost_per_token": 1.1e-05, - "litellm_provider": "azure", + "openrouter/~anthropic/claude-sonnet-latest": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_1hr": 4e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 4.4e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/eu/o4-mini-2025-04-16": { - "deprecation_date": "2026-11-19", - "cache_read_input_token_cost": 3.03e-07, - "input_cost_per_token": 1.21e-06, - "input_cost_per_token_batches": 6.05e-07, - "litellm_provider": "azure", + "openrouter/~deepseek/deepseek-flash-latest": { + "cache_read_input_token_cost": 6e-09, + "input_cost_per_token": 3e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 4.84e-06, - "output_cost_per_token_batches": 2.42e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" - }, - "azure/eu/text-embedding-3-large": { - "deprecation_date": "2028-02-09", - "input_cost_per_token": 1.43e-07, - "litellm_provider": "azure", - "mode": "embedding", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.2e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "azure/eu/text-embedding-3-small": { - "deprecation_date": "2028-02-09", - "input_cost_per_token": 2.2e-08, - "litellm_provider": "azure", - "mode": "embedding", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "openrouter/~deepseek/deepseek-pro-latest": { + "cache_read_input_token_cost": 4.4e-08, + "input_cost_per_token": 1.32e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 384000, + "max_tokens": 384000, + "mode": "chat", + "off_peak_pricing": {"windows":[{"weekdays":["saturday","sunday"],"hours_utc":"00:00-00:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"00:00-01:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"04:00-06:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"10:00-00:00"}],"input_cost_per_token":6.6e-7,"output_cost_per_token":0.00000198,"cache_read_input_token_cost":2.2e-8}, + "output_cost_per_token": 3.96e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "azure/eu/text-embedding-ada-002": { - "deprecation_date": "2028-02-09", - "input_cost_per_token": 1.1e-07, - "litellm_provider": "azure", - "mode": "embedding", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "openrouter/~deepseek/deepseek-v4-flash-latest": { + "cache_read_input_token_cost": 1.6e-08, + "input_cost_per_token": 4e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 1310720, + "max_output_tokens": 943718, + "max_tokens": 943718, + "mode": "chat", + "output_cost_per_token": 6.4e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "gemini/gemini-3.8-live": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_image_token": 1e-06, + "openrouter/~google/gemini-flash-latest": { + "cache_creation_input_token_cost": 4.16666666666667e-08, + "cache_read_input_audio_token_cost": 7.5e-08, + "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_audio_token": 7.5e-07, "input_cost_per_token": 7.5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 131072, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 4.5e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "mode": "chat", + "output_cost_per_token": 3.75e-06, + "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": true, - "tpm": 250000, - "rpm": 10, "supports_function_calling": true, - "supports_response_schema": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "gemini/gemini-3.8-live-extended-thinking": { - "input_cost_per_audio_token": 3e-06, - "input_cost_per_image_token": 1e-06, - "input_cost_per_token": 7.5e-07, - "litellm_provider": "gemini", - "max_input_tokens": 131072, + "openrouter/~google/gemini-pro-latest": { + "cache_creation_input_token_cost": 3.75e-07, + "cache_read_input_audio_token_cost": 2e-07, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_audio_token": 2e-06, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, - "mode": "realtime", - "output_cost_per_audio_token": 1.2e-05, - "output_cost_per_token": 4.5e-06, - "source": "https://ai.google.dev/gemini-api/docs/pricing", + "mode": "chat", + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_above_200k_tokens": 1.8e-05, + "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": true, - "tpm": 250000, - "rpm": 10, "supports_function_calling": true, - "supports_response_schema": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "azure/us/codex-mini": { - "deprecation_date": "2026-11-15", - "cache_read_input_token_cost": 4.13e-07, - "input_cost_per_token": 1.65e-06, - "litellm_provider": "azure", + "openrouter/~moonshotai/kimi-latest": { + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 3e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 6.6e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.5e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "azure/us/computer-use-preview": { - "input_cost_per_token": 3.3e-06, - "litellm_provider": "azure", + "openrouter/~openai/gpt-astra-latest": { + "cache_creation_input_token_cost": 1.25e-05, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-05, + "cache_read_input_token_cost": 1e-06, + "cache_read_input_token_cost_above_272k_tokens": 2e-06, + "input_cost_per_token": 1e-05, + "input_cost_per_token_above_272k_tokens": 2e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.32e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 5e-05, + "output_cost_per_token_above_272k_tokens": 7.5e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/us/gpt-4.1": { - "deprecation_date": "2027-04-14", - "cache_read_input_token_cost": 5.5e-07, - "cache_read_input_token_cost_priority": 9.63e-07, - "input_cost_per_token": 2.2e-06, - "input_cost_per_token_batches": 1.1e-06, - "input_cost_per_token_priority": 3.85e-06, - "litellm_provider": "azure", + "openrouter/~openai/gpt-luna-latest": { + "cache_creation_input_token_cost": 1.25e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-07, + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_272k_tokens": 2e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 8.8e-06, - "output_cost_per_token_batches": 4.4e-06, - "output_cost_per_token_priority": 1.54e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 5e-07, + "output_cost_per_token_above_272k_tokens": 7.5e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, + "openrouter/~openai/gpt-mini-latest": { + "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_token": 7.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 4.5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/us/gpt-4.1-mini": { - "deprecation_date": "2027-04-14", - "cache_read_input_token_cost": 1.1e-07, - "cache_read_input_token_cost_priority": 1.93e-07, - "input_cost_per_token": 4.4e-07, - "input_cost_per_token_batches": 2.2e-07, - "input_cost_per_token_priority": 7.7e-07, - "litellm_provider": "azure", + "openrouter/~openai/gpt-sol-latest": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.76e-06, - "output_cost_per_token_batches": 8.8e-07, - "output_cost_per_token_priority": 3.08e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/us/gpt-4.1-nano": { - "deprecation_date": "2027-04-14", - "cache_read_input_token_cost": 2.8e-08, - "input_cost_per_token": 1.1e-07, - "input_cost_per_token_batches": 5.5e-08, - "litellm_provider": "azure", + "openrouter/~openai/gpt-terra-latest": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 4.4e-07, - "output_cost_per_token_batches": 2.2e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.2e-05, + "output_cost_per_token_above_272k_tokens": 1.8e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/us/gpt-4o-2024-05-13": { - "deprecation_date": "2026-10-01", - "input_cost_per_token": 5.5e-06, - "input_cost_per_token_batches": 2.75e-06, - "litellm_provider": "azure", + "openrouter/~x-ai/grok-latest": { + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_200k_tokens": 1e-06, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 500000, + "max_output_tokens": 450000, + "max_tokens": 450000, "mode": "chat", - "output_cost_per_token": 1.65e-05, - "output_cost_per_token_batches": 8.25e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 6e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/us/gpt-5": { - "deprecation_date": "2027-02-09", - "cache_read_input_token_cost": 1.375e-07, - "cache_read_input_token_cost_priority": 2.75e-07, - "input_cost_per_token": 1.375e-06, - "input_cost_per_token_batches": 6.875e-07, - "input_cost_per_token_priority": 2.75e-06, - "litellm_provider": "azure", + "openrouter/~z-ai/glm-flash-latest": { + "cache_read_input_token_cost": 5e-08, + "input_cost_per_token": 1.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1310720, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 1.1e-05, - "output_cost_per_token_batches": 5.5e-06, - "output_cost_per_token_priority": 2.2e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 5e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "azure/us/gpt-5-codex": { - "deprecation_date": "2027-03-17", - "cache_read_input_token_cost": 1.38e-07, - "input_cost_per_token": 1.375e-06, - "litellm_provider": "azure", + "openrouter/~z-ai/glm-latest": { + "cache_read_input_token_cost": 1.2142e-07, + "input_cost_per_token": 6.538e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1310720, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.1e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 2.0548e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "azure/us/gpt-5-mini": { - "deprecation_date": "2027-02-09", - "cache_read_input_token_cost": 2.75e-08, - "cache_read_input_token_cost_priority": 4.95e-08, - "input_cost_per_token": 2.75e-07, - "input_cost_per_token_batches": 1.375e-07, - "input_cost_per_token_priority": 4.95e-07, - "litellm_provider": "azure", + "openrouter/aion-labs/aion-2.0": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 8e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 2.2e-06, - "output_cost_per_token_batches": 1.1e-06, - "output_cost_per_token_priority": 3.96e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.6e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "azure/us/gpt-5-nano": { - "deprecation_date": "2027-02-09", - "cache_read_input_token_cost": 5.5e-09, - "input_cost_per_token": 5.5e-08, - "input_cost_per_token_batches": 2.75e-08, - "litellm_provider": "azure", + "openrouter/aion-labs/aion-3.0": { + "cache_read_input_token_cost": 7.5e-07, + "input_cost_per_token": 3e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 4.4e-07, - "output_cost_per_token_batches": 2.2e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 6e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "azure/us/gpt-5-pro": { - "deprecation_date": "2027-04-07", - "input_cost_per_token": 1.65e-05, - "input_cost_per_token_batches": 8.25e-06, - "litellm_provider": "azure", + "openrouter/aion-labs/aion-3.0-mini": { + "cache_read_input_token_cost": 1.8e-07, + "input_cost_per_token": 7e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 0.000132, - "output_cost_per_token_batches": 6.6e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.4e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "azure/us/gpt-5.1-codex-max": { - "deprecation_date": "2027-05-18", - "cache_read_input_token_cost": 1.375e-07, - "input_cost_per_token": 1.375e-06, - "litellm_provider": "azure", + "openrouter/aion-labs/aion-3.5": { + "cache_read_input_token_cost": 7.5e-07, + "input_cost_per_token": 3e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 1.1e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 6e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "azure/us/gpt-5.2": { - "deprecation_date": "2027-06-08", - "cache_read_input_token_cost": 1.925e-07, - "cache_read_input_token_cost_priority": 3.85e-07, - "input_cost_per_token": 1.925e-06, - "input_cost_per_token_batches": 9.625e-07, - "input_cost_per_token_priority": 3.85e-06, - "litellm_provider": "azure", + "openrouter/aion-labs/aion-3.5-mini": { + "cache_read_input_token_cost": 1.8e-07, + "input_cost_per_token": 7e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 1.54e-05, - "output_cost_per_token_batches": 7.7e-06, - "output_cost_per_token_priority": 3.08e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.4e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "azure/us/gpt-5.2-chat": { - "deprecation_date": "2026-06-29", - "cache_read_input_token_cost": 1.925e-07, - "input_cost_per_token": 1.925e-06, - "litellm_provider": "azure", + "openrouter/aion-labs/aion-rp-llama-3.1-8b": { + "input_cost_per_token": 8e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 32768, + "max_output_tokens": 29491, + "max_tokens": 29491, "mode": "chat", - "output_cost_per_token": 1.54e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.6e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "azure/us/gpt-5.2-codex": { - "deprecation_date": "2027-07-13", - "cache_read_input_token_cost": 1.925e-07, - "input_cost_per_token": 1.925e-06, - "litellm_provider": "azure", + "openrouter/amazon/nova-2-lite-v1": { + "input_cost_per_token": 3e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 65535, + "max_tokens": 65535, "mode": "chat", - "output_cost_per_token": 1.54e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 2.5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "azure/us/gpt-5.2-pro": { - "input_cost_per_token": 2.31e-05, - "input_cost_per_token_batches": 1.155e-05, - "litellm_provider": "azure", + "openrouter/amazon/nova-lite-v1": { + "input_cost_per_token": 6e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 300000, + "max_output_tokens": 5120, + "max_tokens": 5120, "mode": "chat", - "output_cost_per_token": 0.0001848, - "output_cost_per_token_batches": 9.24e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 2.4e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": true, + "supports_web_search": false }, - "azure/us/gpt-5.3-chat": { - "deprecation_date": "2026-06-29", - "cache_read_input_token_cost": 1.925e-07, - "input_cost_per_token": 1.925e-06, - "litellm_provider": "azure", + "openrouter/amazon/nova-micro-v1": { + "input_cost_per_token": 3.5e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 5120, + "max_tokens": 5120, "mode": "chat", - "output_cost_per_token": 1.54e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.4e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "azure/us/gpt-5.3-codex": { - "deprecation_date": "2027-08-24", - "cache_read_input_token_cost": 1.925e-07, - "cache_read_input_token_cost_priority": 3.85e-07, - "input_cost_per_token": 1.925e-06, - "input_cost_per_token_priority": 3.85e-06, - "litellm_provider": "azure", + "openrouter/amazon/nova-premier-v1": { + "cache_read_input_token_cost": 6.25e-07, + "input_cost_per_token": 2.5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 32000, + "max_tokens": 32000, "mode": "chat", - "output_cost_per_token": 1.54e-05, - "output_cost_per_token_priority": 3.08e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 1.25e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": true, + "supports_web_search": false }, - "azure/us/gpt-5.4-mini": { - "deprecation_date": "2027-09-21", - "cache_read_input_token_cost": 8.25e-08, - "cache_read_input_token_cost_priority": 1.65e-07, - "input_cost_per_token": 8.25e-07, - "input_cost_per_token_batches": 4.125e-07, - "input_cost_per_token_priority": 1.65e-06, - "litellm_provider": "azure", + "openrouter/amazon/nova-pro-v1": { + "input_cost_per_token": 8e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 300000, + "max_output_tokens": 5120, + "max_tokens": 5120, "mode": "chat", - "output_cost_per_token": 4.95e-06, - "output_cost_per_token_batches": 2.475e-06, - "output_cost_per_token_priority": 9.9e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 3.2e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": true, + "supports_web_search": false }, - "azure/us/gpt-5.4-nano": { - "deprecation_date": "2027-09-21", - "cache_read_input_token_cost": 2.2e-08, - "input_cost_per_token": 2.2e-07, - "input_cost_per_token_batches": 1.1e-07, - "litellm_provider": "azure", + "openrouter/anthracite-org/magnum-v4-72b": { + "input_cost_per_token": 2.5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 32768, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 1.375e-06, - "output_cost_per_token_batches": 6.875e-07, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "azure/us/gpt-5.4-pro": { - "deprecation_date": "2027-09-07", - "input_cost_per_token": 3.3e-05, - "input_cost_per_token_above_272k_tokens": 6.6e-05, - "input_cost_per_token_batches": 1.65e-05, - "litellm_provider": "azure", + "openrouter/anthropic/claude-fable-5:batch": { + "cache_creation_input_token_cost": 6.25e-06, + "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token": 5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 0.000198, - "output_cost_per_token_above_272k_tokens": 0.000297, - "output_cost_per_token_batches": 9.9e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 2.5e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/us/o1-mini": { - "cache_read_input_token_cost": 6.05e-07, - "input_cost_per_token": 1.21e-06, - "input_cost_per_token_batches": 6.05e-07, - "litellm_provider": "azure", + "openrouter/anthropic/claude-fable-5.1:batch": { + "cache_creation_input_token_cost": 6.25e-06, + "cache_creation_input_token_cost_above_1hr": 1e-05, + "cache_read_input_token_cost": 1.25e-07, + "input_cost_per_token": 5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 4.84e-06, - "output_cost_per_token_batches": 2.42e-06, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 2.5e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/us/o1-preview": { - "cache_read_input_token_cost": 8.25e-06, - "input_cost_per_token": 1.65e-05, - "litellm_provider": "azure", + "openrouter/anthropic/claude-haiku-4.5:batch": { + "cache_creation_input_token_cost": 6.25e-07, + "cache_creation_input_token_cost_above_1hr": 1e-06, + "cache_read_input_token_cost": 5e-08, + "input_cost_per_token": 5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 200000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 6.6e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 2.5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/us/o3-deep-research": { - "deprecation_date": "2026-11-19", - "cache_read_input_token_cost": 2.75e-06, - "input_cost_per_token": 1.1e-05, - "litellm_provider": "azure", + "openrouter/anthropic/claude-opus-4.1:batch": { + "cache_creation_input_token_cost": 9.375e-06, + "cache_creation_input_token_cost_above_1hr": 1.5e-05, + "cache_read_input_token_cost": 7.5e-07, + "input_cost_per_token": 7.5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 200000, + "max_output_tokens": 32000, + "max_tokens": 32000, "mode": "chat", - "output_cost_per_token": 4.4e-05, - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" - }, - "azure/us/text-embedding-3-large": { - "deprecation_date": "2028-02-09", - "input_cost_per_token": 1.43e-07, - "litellm_provider": "azure", - "mode": "embedding", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" - }, - "azure/us/text-embedding-3-small": { - "deprecation_date": "2028-02-09", - "input_cost_per_token": 2.2e-08, - "litellm_provider": "azure", - "mode": "embedding", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "output_cost_per_token": 3.75e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "azure/us/text-embedding-ada-002": { - "deprecation_date": "2028-02-09", - "input_cost_per_token": 1.1e-07, - "litellm_provider": "azure", - "mode": "embedding", - "source": "https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'" + "openrouter/anthropic/claude-opus-4.5:batch": { + "cache_creation_input_token_cost": 3.125e-06, + "cache_creation_input_token_cost_above_1hr": 5e-06, + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 2.5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 200000, + "max_output_tokens": 64000, + "max_tokens": 64000, + "mode": "chat", + "output_cost_per_token": 1.25e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "aihubmix/agnes-2.5-flash": { - "input_cost_per_token": 3e-08, - "litellm_provider": "aihubmix", - "max_input_tokens": 512000, - "max_output_tokens": 65500, - "max_tokens": 65500, + "openrouter/anthropic/claude-opus-4.6:batch": { + "cache_creation_input_token_cost": 3.125e-06, + "cache_creation_input_token_cost_above_1hr": 5e-06, + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 2.5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.5e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.25e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_vision": true + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "aihubmix/agnes-2.5-pro": { - "cache_read_input_token_cost": 3.78e-09, - "input_cost_per_token": 4.5e-07, - "litellm_provider": "aihubmix", + "openrouter/anthropic/claude-opus-4.7:batch": { + "cache_creation_input_token_cost": 3.125e-06, + "cache_creation_input_token_cost_above_1hr": 5e-06, + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 2.5e-06, + "litellm_provider": "openrouter", "max_input_tokens": 1000000, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 9e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.25e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_vision": true + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "aihubmix/cc-glm-5.1": { - "input_cost_per_token": 6e-08, - "litellm_provider": "aihubmix", - "max_input_tokens": 200000, - "max_output_tokens": 131072, - "max_tokens": 131072, + "openrouter/anthropic/claude-opus-4.8:batch": { + "cache_creation_input_token_cost": 3.125e-06, + "cache_creation_input_token_cost_above_1hr": 5e-06, + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 2.5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.2e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.25e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "aihubmix/claude-fable-5": { - "cache_read_input_token_cost": 1.1e-06, - "cache_creation_input_token_cost": 1.375e-05, - "input_cost_per_token": 1.1e-05, - "litellm_provider": "aihubmix", + "openrouter/anthropic/claude-opus-5:batch": { + "cache_creation_input_token_cost": 3.125e-06, + "cache_creation_input_token_cost_above_1hr": 5e-06, + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 2.5e-06, + "litellm_provider": "openrouter", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 5.5e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.25e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "prompt_cache_min_tokens": 512, - "supports_adaptive_thinking": true, - "thinking_always_on": true, - "supports_sampling_params": false + "supports_web_search": true }, - "aihubmix/claude-haiku-4-5": { - "cache_read_input_token_cost": 1.1e-07, - "cache_creation_input_token_cost": 1.375e-06, - "input_cost_per_token": 1.1e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 200000, + "openrouter/anthropic/claude-sonnet-4.5:batch": { + "cache_creation_input_token_cost": 1.875e-06, + "cache_creation_input_token_cost_above_1hr": 3e-06, + "cache_creation_input_token_cost_above_200k_tokens": 3.75e-06, + "cache_read_input_token_cost": 1.5e-07, + "cache_read_input_token_cost_above_200k_tokens": 3e-07, + "input_cost_per_token": 1.5e-06, + "input_cost_per_token_above_200k_tokens": 3e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, "max_output_tokens": 64000, "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 5.5e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 7.5e-06, + "output_cost_per_token_above_200k_tokens": 1.125e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "prompt_cache_min_tokens": 4096 + "supports_web_search": true }, - "aihubmix/claude-opus-4-8-think": { - "cache_read_input_token_cost": 5e-07, - "cache_creation_input_token_cost": 6.25e-06, - "input_cost_per_token": 5e-06, - "litellm_provider": "aihubmix", + "openrouter/anthropic/claude-sonnet-4.6:batch": { + "cache_creation_input_token_cost": 1.875e-06, + "cache_creation_input_token_cost_above_1hr": 3e-06, + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 1.5e-06, + "litellm_provider": "openrouter", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 7.5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "prompt_cache_min_tokens": 1024, - "supports_adaptive_thinking": true, - "supports_sampling_params": false + "supports_web_search": true }, - "aihubmix/claude-opus-5": { - "cache_read_input_token_cost": 5e-07, - "cache_creation_input_token_cost": 6.25e-06, - "input_cost_per_token": 5e-06, - "litellm_provider": "aihubmix", + "openrouter/anthropic/claude-sonnet-5:batch": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_creation_input_token_cost_above_1hr": 2e-06, + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 1e-06, + "litellm_provider": "openrouter", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true, - "supports_adaptive_thinking": true, - "prompt_cache_min_tokens": 512, - "supports_sampling_params": false + "supports_web_search": true }, - "aihubmix/claude-sonnet-5": { - "cache_read_input_token_cost": 2e-07, - "cache_creation_input_token_cost": 2.5e-06, - "input_cost_per_token": 2e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/arcee-ai/trinity-large-thinking": { + "cache_read_input_token_cost": 6e-08, + "input_cost_per_token": 2.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 80000, + "max_tokens": 80000, "mode": "chat", - "output_cost_per_token": 1e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 8e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, + "supports_response_schema": false, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/baidu/ernie-4.5-vl-424b-a47b": { + "deprecation_date": "2026-10-08", + "input_cost_per_token": 4.2e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 123000, + "max_output_tokens": 16000, + "max_tokens": 16000, + "mode": "chat", + "output_cost_per_token": 1.25e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": true, + "supports_web_search": false + }, + "openrouter/bytedance-seed/seed-1.6": { + "deprecation_date": "2026-11-11", + "input_cost_per_token": 2.5e-07, + "input_cost_per_token_above_128k_tokens": 5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, + "mode": "chat", + "output_cost_per_token": 2e-06, + "output_cost_per_token_above_128k_tokens": 4e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "prompt_cache_min_tokens": 1024, - "supports_adaptive_thinking": true, - "supports_sampling_params": false + "supports_web_search": false }, - "aihubmix/coding-glm-5.3": { - "cache_read_input_token_cost": 1.5e-08, - "input_cost_per_token": 6e-08, - "litellm_provider": "aihubmix", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, + "openrouter/bytedance-seed/seed-1.6-flash": { + "deprecation_date": "2026-11-11", + "input_cost_per_token": 7.5e-08, + "input_cost_per_token_above_128k_tokens": 1e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 2.2e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 3e-07, + "output_cost_per_token_above_128k_tokens": 8e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "aihubmix/coding-kimi-k3": { - "cache_read_input_token_cost": 6.6e-08, - "input_cost_per_token": 4.4e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 1048576, - "max_output_tokens": 1048576, - "max_tokens": 1048576, + "openrouter/bytedance-seed/seed-2-1-turbo": { + "input_cost_per_token": 5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 1.61333e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 2.5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "aihubmix/coding-xiaomi-mimo-v2-omni": { - "cache_read_input_token_cost": 1.6e-08, - "input_cost_per_token": 8e-08, - "litellm_provider": "aihubmix", + "openrouter/bytedance-seed/seed-2.0-code": { + "deprecation_date": "2026-11-11", + "input_cost_per_token": 5e-07, + "input_cost_per_token_above_128k_tokens": 1e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 4e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 3e-06, + "output_cost_per_token_above_128k_tokens": 6e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "aihubmix/coding-xiaomi-mimo-v2.5": { - "cache_read_input_token_cost": 1.6e-09, - "input_cost_per_token": 8e-08, - "litellm_provider": "aihubmix", - "max_input_tokens": 1048576, + "openrouter/bytedance-seed/seed-2.0-lite": { + "input_cost_per_token": 2.5e-07, + "input_cost_per_token_above_128k_tokens": 5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, "max_output_tokens": 131072, "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.6e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 2e-06, + "output_cost_per_token_above_128k_tokens": 4e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "aihubmix/coding-xiaomi-mimo-v2.5-pro": { - "cache_read_input_token_cost": 1.6e-09, - "input_cost_per_token": 2e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 1048576, + "openrouter/bytedance-seed/seed-2.0-mini": { + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_128k_tokens": 2e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, "max_output_tokens": 131072, "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 4e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 4e-07, + "output_cost_per_token_above_128k_tokens": 8e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false + }, + "openrouter/cognitivecomputations/dolphin-mistral-24b-venice-edition": { + "input_cost_per_token": 2e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 9e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/cohere/command-a": { + "input_cost_per_token": 2.5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 256000, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 1e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/cohere/command-r-08-2024": { + "input_cost_per_token": 1.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 4000, + "max_tokens": 4000, + "mode": "chat", + "output_cost_per_token": 6e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/command-a-plus-05-2026": { + "openrouter/cohere/command-r-plus-08-2024": { "input_cost_per_token": 2.5e-06, - "litellm_provider": "aihubmix", + "litellm_provider": "openrouter", "max_input_tokens": 128000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "max_output_tokens": 4000, + "max_tokens": 4000, "mode": "chat", "output_cost_per_token": 1e-05, - "source": "https://aihubmix.com/api/v1/models", + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_reasoning": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/deepseek-v4-flash": { - "cache_read_input_token_cost": 2.84e-08, - "input_cost_per_token": 1.42e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, - "max_output_tokens": 384000, - "max_tokens": 384000, + "openrouter/cohere/command-r7b-12-2024": { + "input_cost_per_token": 3.75e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 4000, + "max_tokens": 4000, "mode": "chat", - "output_cost_per_token": 2.84e-07, - "source": "https://aihubmix.com/api/v1/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true + "output_cost_per_token": 1.5e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/deepseek-v4-pro": { - "cache_read_input_token_cost": 1.4027e-07, - "input_cost_per_token": 1.69e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, - "max_output_tokens": 384000, - "max_tokens": 384000, + "openrouter/cohere/north-mini-code:free": { + "input_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 256000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 3.38e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 0.0, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true + "supports_response_schema": false, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/doubao-seed-2-0-code-preview": { - "cache_read_input_token_cost": 9.644e-08, - "input_cost_per_token": 4.822e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 256000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/apodex/apodex-1.1-mini:free": { + "input_cost_per_token": 0.0, + "output_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 2.411e-06, - "source": "https://aihubmix.com/api/v1/models", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, - "supports_prompt_caching": true, "supports_reasoning": true, - "supports_vision": true, - "supports_web_search": true + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false }, - "aihubmix/doubao-seed-2-0-lite-260428": { - "cache_read_input_token_cost": 1.8082e-08, - "input_cost_per_token": 9.041e-08, - "litellm_provider": "aihubmix", - "max_input_tokens": 256000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/unbiased/pareto-26.10-preview": { + "input_cost_per_token": 8e-07, + "output_cost_per_token": 3.2e-06, + "cache_read_input_token_cost": 3e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 5.4246e-07, - "source": "https://aihubmix.com/api/v1/models", + "source": "https://openrouter.ai/api/v1/models", "supports_function_calling": true, "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": true + "supports_tool_choice": true, + "supports_vision": true }, - "aihubmix/doubao-seed-2-0-mini": { - "cache_read_input_token_cost": 6.027e-09, - "input_cost_per_token": 3.0136e-08, - "litellm_provider": "aihubmix", - "max_input_tokens": 256000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/dots-studio/dots-3-note-preview:free": { + "deprecation_date": "2026-12-31", + "input_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 512000, + "max_output_tokens": 460800, + "max_tokens": 460800, "mode": "chat", - "output_cost_per_token": 3.0136e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 0.0, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false }, - "aihubmix/doubao-seed-2-0-pro": { - "cache_read_input_token_cost": 9.644e-08, - "input_cost_per_token": 4.822e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 256000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/google/gemini-2.5-flash-lite:batch": { + "cache_read_input_audio_token_cost": 3e-08, + "cache_read_input_token_cost": 1e-08, + "input_cost_per_audio_token": 1.5e-07, + "input_cost_per_token": 5e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 65535, + "max_tokens": 65535, "mode": "chat", - "output_cost_per_token": 2.411e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 2e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "supports_video_input": true }, - "aihubmix/doubao-seed-2-1-turbo": { - "cache_read_input_token_cost": 9.295e-08, - "input_cost_per_token": 4.6475e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, + "openrouter/google/gemini-2.5-flash:batch": { + "cache_read_input_audio_token_cost": 1e-07, + "cache_read_input_token_cost": 3e-08, + "deprecation_date": "2026-10-20", + "input_cost_per_audio_token": 5e-07, + "input_cost_per_token": 1.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 65535, + "max_tokens": 65535, "mode": "chat", - "output_cost_per_token": 2.32375e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.25e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true - }, - "aihubmix/ernie-5.1": { - "cache_read_input_token_cost": 5.634e-07, - "input_cost_per_token": 5.634e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 119000, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "chat", - "output_cost_per_token": 2.5353e-06, - "source": "https://aihubmix.com/api/v1/models", - "supports_prompt_caching": true, - "supports_reasoning": true + "supports_web_search": true, + "supports_video_input": true }, - "aihubmix/gemini-3-flash-preview": { - "cache_read_input_token_cost": 5e-08, - "input_cost_per_token": 5e-07, - "litellm_provider": "aihubmix", + "openrouter/google/gemini-2.5-pro:batch": { + "cache_read_input_audio_token_cost": 1.25e-07, + "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_above_200k_tokens": 2.5e-07, + "deprecation_date": "2026-10-20", + "input_cost_per_audio_token": 6.25e-07, + "input_cost_per_token": 6.25e-07, + "input_cost_per_token_above_200k_tokens": 1.25e-06, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 5e-06, + "output_cost_per_token_above_200k_tokens": 7.5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "supports_video_input": true }, - "aihubmix/gemini-3-flash-preview-search": { - "cache_read_input_token_cost": 5e-08, - "input_cost_per_token": 5e-07, - "litellm_provider": "aihubmix", + "openrouter/google/gemini-3-flash-preview:batch": { + "input_cost_per_audio_token": 5e-07, + "input_cost_per_token": 2.5e-07, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": true, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "supports_video_input": true }, - "aihubmix/gemini-3.1-pro-preview": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 2e-06, - "litellm_provider": "aihubmix", + "openrouter/google/gemini-3.1-flash-lite:batch": { + "cache_read_input_audio_token_cost": 2.5e-08, + "cache_read_input_token_cost": 1.25e-08, + "input_cost_per_audio_token": 2.5e-07, + "input_cost_per_token": 1.25e-07, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 7.5e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "supports_video_input": true }, - "aihubmix/gemini-3.1-pro-preview-customtools": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 2e-06, - "litellm_provider": "aihubmix", + "openrouter/google/gemini-3.1-pro-preview:batch": { + "input_cost_per_audio_token": 1e-06, + "input_cost_per_token": 1e-06, + "input_cost_per_token_above_200k_tokens": 2e-06, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 6e-06, + "output_cost_per_token_above_200k_tokens": 9e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": true, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "supports_video_input": true }, - "aihubmix/gemini-3.5-flash-lite": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "aihubmix", + "openrouter/google/gemini-3.5-flash-lite:batch": { + "cache_read_input_audio_token_cost": 1.5e-08, + "cache_read_input_token_cost": 1.5e-08, + "input_cost_per_audio_token": 1.5e-07, + "input_cost_per_token": 1.5e-07, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 2.499999e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.25e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "supports_video_input": true }, - "aihubmix/gemini-3.7-flash": { + "openrouter/google/gemini-3.5-flash:batch": { + "cache_read_input_audio_token_cost": 1.5e-07, "cache_read_input_token_cost": 7.5e-08, + "input_cost_per_audio_token": 1.5e-06, "input_cost_per_token": 7.5e-07, - "litellm_provider": "aihubmix", + "litellm_provider": "openrouter", "max_input_tokens": 1048576, "max_output_tokens": 65536, "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 3.75e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 4.5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true - }, - "aihubmix/gemma-4-26b-a4b-it": { - "input_cost_per_token": 1.4e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 262144, - "max_output_tokens": 131100, - "max_tokens": 131100, - "mode": "chat", - "output_cost_per_token": 3.9998e-07, - "source": "https://aihubmix.com/api/v1/models", - "supports_reasoning": true, - "supports_vision": true - }, - "aihubmix/gemma-4-31b-it": { - "input_cost_per_token": 1.4e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 262144, - "max_output_tokens": 131100, - "max_tokens": 131100, - "mode": "chat", - "output_cost_per_token": 3.9998e-07, - "source": "https://aihubmix.com/api/v1/models", - "supports_reasoning": true, - "supports_vision": true - }, - "aihubmix/glm-5.2-fast-preview": { - "cache_read_input_token_cost": 5.635e-07, - "input_cost_per_token": 2.254e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 7.889e-06, - "source": "https://aihubmix.com/api/v1/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true - }, - "aihubmix/glm-5.3": { - "cache_read_input_token_cost": 2.817e-07, - "input_cost_per_token": 1.1268e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 3.9438e-06, - "source": "https://aihubmix.com/api/v1/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true + "supports_web_search": true, + "supports_video_input": true }, - "aihubmix/glm-5.3-flash": { - "cache_read_input_token_cost": 2.817e-08, - "input_cost_per_token": 1.1268e-07, - "litellm_provider": "aihubmix", + "openrouter/google/gemini-3.6-flash:batch": { + "cache_creation_input_token_cost": 4.16666666666667e-08, + "cache_read_input_audio_token_cost": 3.75e-08, + "cache_read_input_token_cost": 3.75e-08, + "input_cost_per_audio_token": 3.75e-07, + "input_cost_per_token": 3.75e-07, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 3.9438e-07, - "source": "https://aihubmix.com/api/v1/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true - }, - "aihubmix/glm-5v-turbo": { - "cache_read_input_token_cost": 1.69008e-07, - "input_cost_per_token": 7.042e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 200000, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 3.09848e-06, - "source": "https://aihubmix.com/api/v1/models", - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_vision": true - }, - "aihubmix/gpt-5.3-codex": { - "cache_read_input_token_cost": 1.75e-07, - "input_cost_per_token": 1.75e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.4e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.875e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "supports_video_input": true }, - "aihubmix/gpt-5.4-high": { - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 2.5e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/google/gemini-3.7-flash:batch": { + "cache_creation_input_token_cost": 4.16666666666667e-08, + "cache_read_input_audio_token_cost": 3.75e-08, + "cache_read_input_token_cost": 3.75e-08, + "input_cost_per_audio_token": 3.75e-07, + "input_cost_per_token": 3.75e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.5e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.875e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "supports_video_input": true }, - "aihubmix/gpt-5.4-low": { - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 2.5e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/google/gemini-3.8-flash:batch": { + "cache_creation_input_token_cost": 4.16666666666667e-08, + "cache_read_input_audio_token_cost": 3.75e-08, + "cache_read_input_token_cost": 3.75e-08, + "input_cost_per_audio_token": 3.75e-07, + "input_cost_per_token": 3.75e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 1.5e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.875e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "supports_video_input": true }, - "aihubmix/gpt-5.4-mini": { - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_token": 7.5e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/ibm-granite/granite-4.0-h-micro": { + "input_cost_per_token": 1.7e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 131000, + "max_output_tokens": 117900, + "max_tokens": 117900, "mode": "chat", - "output_cost_per_token": 4.5e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.12e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/ibm-granite/granite-4.2-8b": { + "cache_read_input_token_cost": 1.5e-08, + "input_cost_per_token": 6e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 117964, + "max_tokens": 117964, + "mode": "chat", + "output_cost_per_token": 2.5e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/gpt-5.4-nano": { - "cache_read_input_token_cost": 2e-08, - "input_cost_per_token": 2e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/inception/mercury-2": { + "cache_read_input_token_cost": 2.5e-08, + "input_cost_per_token": 2.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 50000, + "max_tokens": 50000, "mode": "chat", - "output_cost_per_token": 1.25e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 7.5e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/gpt-5.5": { - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 5e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/inception/mercury-2.5": { + "cache_read_input_token_cost": 4e-09, + "input_cost_per_token": 4e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 260000, + "max_output_tokens": 65536, + "max_tokens": 65536, "mode": "chat", - "output_cost_per_token": 3e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.5e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/gpt-5.5-pro": { - "input_cost_per_token": 3e-05, - "litellm_provider": "aihubmix", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/inclusionai/ling-3.0-flash": { + "cache_read_input_token_cost": 4.2e-09, + "input_cost_per_token": 2.1e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 0.00018, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 6.3e-08, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true, - "supports_web_search": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/gpt-5.6-luna": { - "cache_read_input_token_cost": 2e-08, - "cache_creation_input_token_cost": 2.5e-07, - "input_cost_per_token": 2e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/inclusionai/ling-3.0-flash-fin": { + "cache_read_input_token_cost": 1.2e-08, + "input_cost_per_token": 6e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.8e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/gpt-5.6-sol-disc": { - "cache_read_input_token_cost": 4e-07, - "cache_creation_input_token_cost": 5e-06, - "input_cost_per_token": 4e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/inclusionai/ling-3.0-flash-fin:free": { + "input_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 2e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 0.0, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true + "supports_response_schema": false, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/gpt-5.6-terra": { - "cache_read_input_token_cost": 2e-07, - "cache_creation_input_token_cost": 2.5e-06, - "input_cost_per_token": 2e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/inclusionai/ling-3.0-flash-sante:free": { + "input_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 0.0, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true + "supports_response_schema": false, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/gpt-chat-latest": { - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 5e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/inclusionai/ling-3.0-flash-vl": { + "cache_read_input_token_cost": 4.2e-09, + "input_cost_per_token": 2.1e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 3e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 6.16e-08, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false }, - "aihubmix/grok-4-20-non-reasoning": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 2e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, + "openrouter/inclusionai/ling-3.0-flash-vl:free": { + "input_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 6e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 0.0, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true, - "supports_vision": true + "supports_response_schema": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "aihubmix/grok-4-20-reasoning": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 2e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, + "openrouter/inference-net/schematron-v2-small": { + "cache_read_input_token_cost": 5e-08, + "input_cost_per_token": 5e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 6e-06, - "source": "https://aihubmix.com/api/v1/models", - "supports_function_calling": true, + "output_cost_per_token": 2.3e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/grok-4.6": { - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 2e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 500000, - "max_output_tokens": 500000, - "max_tokens": 500000, + "openrouter/inference-net/schematron-v2-turbo": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 3e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 6e-06, - "source": "https://aihubmix.com/api/v1/models", - "supports_function_calling": true, + "output_cost_per_token": 1.5e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/grok-build-0.1": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 1e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 256000, - "max_output_tokens": 256000, - "max_tokens": 256000, + "openrouter/kwaipilot/kat-coder-pro-v2.5": { + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 7.4e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 2e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 2.96e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/hy3": { - "cache_read_input_token_cost": 3.905e-08, - "input_cost_per_token": 1.562e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 256000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "openrouter/liquid/lfm-2.5-2.6b:free": { + "input_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 65536, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 6.248e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 0.0, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_web_search": true + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/hy4-preview": { - "cache_read_input_token_cost": 4.225e-08, - "input_cost_per_token": 8.45e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 1048576, - "max_output_tokens": 64000, - "max_tokens": 64000, + "openrouter/meituan/longcat-2.0": { + "cache_read_input_token_cost": 6e-09, + "input_cost_per_token": 3e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1048756, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 2.535e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.2e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_web_search": true + "supports_response_schema": false, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/kimi-k2.6": { - "cache_read_input_token_cost": 1.60835e-07, - "input_cost_per_token": 9.5e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "openrouter/meta/muse-glimmer-30b": { + "cache_read_input_token_cost": 4e-08, + "input_cost_per_token": 3.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 117964, + "max_tokens": 117964, "mode": "chat", - "output_cost_per_token": 3.9995e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "aihubmix/kimi-k2.7-code-highspeed": { - "cache_read_input_token_cost": 3.2167e-07, - "input_cost_per_token": 1.9e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "openrouter/meta/muse-spark-1.1": { + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 7.999e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 4.25e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "aihubmix/kimi-k3": { - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 3e-06, - "litellm_provider": "aihubmix", + "openrouter/meta/muse-spark-1.2": { + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "max_output_tokens": 1048576, - "max_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 1.5e-05, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 4.25e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "aihubmix/longcat-2.0": { - "cache_read_input_token_cost": 1.5492e-08, - "input_cost_per_token": 7.746e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, + "openrouter/meta/muse-spark-1.2-contributor": { + "cache_read_input_token_cost": 2e-09, + "input_cost_per_token": 1e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 3.0984e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 2e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": true - }, - "aihubmix/mai-thinking-1": { - "input_cost_per_token": 2e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 256000, - "max_output_tokens": 64000, - "max_tokens": 64000, - "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://aihubmix.com/api/v1/models", "supports_reasoning": true, - "supports_response_schema": true + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "aihubmix/mimo-v2-omni": { - "cache_read_input_token_cost": 8.8e-08, - "input_cost_per_token": 4.4e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 256000, + "openrouter/meta/muse-spark-1.3": { + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 2.2e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 4.25e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, + "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "aihubmix/mimo-v2-pro": { - "cache_read_input_token_cost": 2.2e-07, - "input_cost_per_token": 1.1e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, + "openrouter/meta/muse-spark-1.3-contributor": { + "cache_read_input_token_cost": 2e-09, + "input_cost_per_token": 1e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 943718, + "max_tokens": 943718, "mode": "chat", - "output_cost_per_token": 3.3e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 2e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, + "supports_function_calling": true, + "supports_pdf_input": true, "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, "supports_web_search": true }, - "aihubmix/minimax-m2.7": { - "cache_read_input_token_cost": 5.916e-08, - "input_cost_per_token": 2.958e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 204800, - "max_output_tokens": 204800, - "max_tokens": 204800, + "openrouter/microsoft/phi-4": { + "input_cost_per_token": 7e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 16384, + "max_output_tokens": 14745, + "max_tokens": 14745, "mode": "chat", - "output_cost_per_token": 1.1832e-06, - "source": "https://aihubmix.com/api/v1/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true + "output_cost_per_token": 1.4e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/minimax-m3": { - "input_cost_per_token": 2.88e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, - "max_output_tokens": 524288, - "max_tokens": 524288, + "openrouter/microsoft/wizardlm-2-8x22b": { + "input_cost_per_token": 6.2e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 65535, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", - "output_cost_per_token": 1.152e-06, - "source": "https://aihubmix.com/api/v1/models", - "supports_function_calling": true, - "supports_reasoning": true, + "output_cost_per_token": 6.2e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_response_schema": true, - "supports_vision": true + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/muse-spark-1.2": { - "input_cost_per_token": 1.375e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1048576, + "openrouter/mistralai/codestral-2508:batch": { + "cache_read_input_token_cost": 1.5e-08, + "input_cost_per_token": 1.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 256000, + "max_output_tokens": 204800, + "max_tokens": 204800, "mode": "chat", - "output_cost_per_token": 4.675e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 4.5e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_reasoning": true, - "supports_vision": true + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/qwen3-coder-next": { - "input_cost_per_token": 1.37e-07, - "litellm_provider": "aihubmix", + "openrouter/mistralai/ministral-8b-2512:batch": { + "cache_read_input_token_cost": 7.5e-09, + "input_cost_per_token": 7.5e-08, + "litellm_provider": "openrouter", "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 209715, + "max_tokens": 209715, "mode": "chat", - "output_cost_per_token": 5.48e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 7.5e-08, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_response_schema": true + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "aihubmix/qwen3.5-122b-a10b": { - "input_cost_per_token": 1.126e-07, - "litellm_provider": "aihubmix", + "openrouter/mistralai/mistral-large-2512": { + "cache_read_input_token_cost": 5e-08, + "input_cost_per_token": 5e-07, + "litellm_provider": "openrouter", "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 209715, + "max_tokens": 209715, "mode": "chat", - "output_cost_per_token": 9.008e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_reasoning": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": false, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false }, - "aihubmix/qwen3.5-397b-a17b": { - "input_cost_per_token": 1.644e-07, - "litellm_provider": "aihubmix", + "openrouter/mistralai/mistral-large-2512:batch": { + "cache_read_input_token_cost": 2.5e-08, + "input_cost_per_token": 2.5e-07, + "litellm_provider": "openrouter", "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 209715, + "max_tokens": 209715, "mode": "chat", - "output_cost_per_token": 9.864e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 7.5e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_reasoning": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": false, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false }, - "aihubmix/qwen3.6-27b": { - "input_cost_per_token": 4.22e-07, - "litellm_provider": "aihubmix", + "openrouter/mistralai/mistral-medium-3-5:batch": { + "input_cost_per_token": 7.5e-07, + "litellm_provider": "openrouter", "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 209715, + "max_tokens": 209715, "mode": "chat", - "output_cost_per_token": 2.532e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 3.75e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false }, - "aihubmix/qwen3.6-35b-a3b": { - "input_cost_per_token": 2.54e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "openrouter/mistralai/mistral-medium-3.1:batch": { + "cache_read_input_token_cost": 2e-08, + "input_cost_per_token": 2e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 104857, + "max_tokens": 104857, "mode": "chat", - "output_cost_per_token": 1.524e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_reasoning": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": false, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false }, - "aihubmix/qwen3.6-max-preview": { - "cache_read_input_token_cost": 1.268e-07, - "cache_creation_input_token_cost": 1.585e-06, - "input_cost_per_token": 1.268e-06, - "litellm_provider": "aihubmix", + "openrouter/mistralai/mistral-small-2603:batch": { + "cache_read_input_token_cost": 7.5e-09, + "input_cost_per_token": 7.5e-08, + "litellm_provider": "openrouter", "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 209715, + "max_tokens": 209715, "mode": "chat", - "output_cost_per_token": 7.608e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 3e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_web_search": true + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": false }, - "aihubmix/qwen3.7-plus": { - "cache_read_input_token_cost": 5.64e-08, - "cache_creation_input_token_cost": 3.525e-07, - "input_cost_per_token": 2.82e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, + "openrouter/moonshotai/kimi-k3:batch": { + "cache_read_input_token_cost": 2.28e-07, + "input_cost_per_token": 2.28e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 1048576, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1.128e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 1.14e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false }, - "aihubmix/qwen3.8-2.4t-a95b": { - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 2e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, + "openrouter/morph/morph-v3-fast": { + "input_cost_per_token": 8e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 81920, + "max_output_tokens": 38000, + "max_tokens": 38000, + "mode": "chat", + "output_cost_per_token": 1.2e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/morph/morph-v3-large": { + "input_cost_per_token": 9e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, "max_output_tokens": 131072, "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 6e-06, - "source": "https://aihubmix.com/api/v1/models", - "supports_function_calling": true, - "supports_prompt_caching": true, - "supports_reasoning": true, + "output_cost_per_token": 1.9e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_response_schema": true, - "supports_web_search": true + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "aihubmix/qwen3.8-flash": { - "cache_read_input_token_cost": 1.4075e-08, - "cache_creation_input_token_cost": 1.75937e-07, - "input_cost_per_token": 1.126e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, + "openrouter/nex-agi/nex-n2.5-mini:free": { + "deprecation_date": "2026-09-25", + "input_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 3.80025e-07, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 0.0, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false }, - "aihubmix/qwen3.8-max": { - "cache_read_input_token_cost": 1.69e-07, - "cache_creation_input_token_cost": 2.1125e-06, - "input_cost_per_token": 1.69e-06, - "litellm_provider": "aihubmix", - "max_input_tokens": 1000000, - "max_output_tokens": 131072, - "max_tokens": 131072, + "openrouter/nex-agi/nex-n2.5-pro:free": { + "deprecation_date": "2026-09-25", + "input_cost_per_token": 0.0, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 5.07e-06, - "source": "https://aihubmix.com/api/v1/models", + "output_cost_per_token": 0.0, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, "supports_function_calling": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false }, - "aihubmix/step-3.7-flash": { - "cache_read_input_token_cost": 4.4e-08, - "input_cost_per_token": 2.2e-07, - "litellm_provider": "aihubmix", - "max_input_tokens": 256000, + "openrouter/nousresearch/hermes-3-llama-3.1-405b": { + "input_cost_per_token": 1e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1.32e-06, - "source": "https://aihubmix.com/api/v1/models", - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_vision": true - }, - "typesafe/jev-1.13.0": { - "input_cost_per_token": 4.2e-08, - "litellm_provider": "typesafe", - "mode": "evaluation", - "output_cost_per_token": 0.0, - "source": "https://docs.typesafe.ai/models" - }, - "typesafe/jev-latest": { - "input_cost_per_token": 4.2e-08, - "litellm_provider": "typesafe", - "mode": "evaluation", - "output_cost_per_token": 0.0, - "source": "https://docs.typesafe.ai/models" + "output_cost_per_token": 1e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "typesafe/jev-preview": { - "input_cost_per_token": 4.2e-08, - "litellm_provider": "typesafe", - "mode": "evaluation", - "output_cost_per_token": 0.0, - "source": "https://docs.typesafe.ai/models" + "openrouter/nousresearch/hermes-3-llama-3.1-70b": { + "input_cost_per_token": 7e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "chat", + "output_cost_per_token": 7e-07, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "wandb/zai-org/GLM-5.3-Flash": { - "cache_read_input_token_cost": 5e-08, - "input_cost_per_token": 1.5e-07, - "litellm_provider": "wandb", - "max_input_tokens": 1049000, + "openrouter/nousresearch/hermes-4-405b": { + "input_cost_per_token": 1e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 131072, + "max_output_tokens": 117964, + "max_tokens": 117964, "mode": "chat", - "output_cost_per_token": 5e-07, - "source": "https://wandb.ai/site/pricing/tokens/", - "supports_function_calling": true, - "supports_prompt_caching": true, + "output_cost_per_token": 3e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "openrouter/~anthropic/claude-fable-latest": { - "cache_creation_input_token_cost": 1.25e-05, - "cache_creation_input_token_cost_above_1hr": 2e-05, - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 1e-05, + "openrouter/openai/gpt-3.5-turbo-0613": { + "input_cost_per_token": 1e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 4095, + "max_output_tokens": 3685, + "max_tokens": 3685, "mode": "chat", - "output_cost_per_token": 5e-05, + "output_cost_per_token": 2e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/~anthropic/claude-haiku-latest": { - "cache_creation_input_token_cost": 1.25e-06, - "cache_creation_input_token_cost_above_1hr": 2e-06, - "cache_read_input_token_cost": 1e-07, - "input_cost_per_token": 1e-06, + "openrouter/openai/gpt-3.5-turbo:batch": { + "input_cost_per_token": 2.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "max_input_tokens": 16385, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 5e-06, + "output_cost_per_token": 7.5e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false, + "supports_web_search": true + }, + "openrouter/openai/gpt-4-turbo:batch": { + "input_cost_per_token": 5e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 128000, + "max_output_tokens": 4096, + "max_tokens": 4096, + "mode": "chat", + "output_cost_per_token": 1.5e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "openrouter/~anthropic/claude-opus-latest": { - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_1hr": 1e-05, - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 5e-06, + "openrouter/openai/gpt-4.1-mini:batch": { + "cache_read_input_token_cost": 5e-08, + "input_cost_per_token": 2e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 1047576, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 2.5e-05, + "output_cost_per_token": 8e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "openrouter/~anthropic/claude-sonnet-latest": { - "cache_creation_input_token_cost": 2.5e-06, - "cache_creation_input_token_cost_above_1hr": 4e-06, - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 2e-06, + "openrouter/openai/gpt-4.1-nano:batch": { + "cache_read_input_token_cost": 1.25e-08, + "input_cost_per_token": 5e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 1047576, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 1e-05, + "output_cost_per_token": 2e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "openrouter/~deepseek/deepseek-flash-latest": { - "cache_read_input_token_cost": 6e-09, - "input_cost_per_token": 3e-07, + "openrouter/openai/gpt-4.1:batch": { + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 1e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 384000, - "max_tokens": 384000, + "max_input_tokens": 1047576, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "off_peak_pricing": {"windows":[{"weekdays":["saturday","sunday"],"hours_utc":"00:00-00:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"00:00-01:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"04:00-06:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"10:00-00:00"}],"input_cost_per_token":1.5e-7,"output_cost_per_token":6e-7,"cache_read_input_token_cost":3e-9}, - "output_cost_per_token": 1.2e-06, + "output_cost_per_token": 4e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/~deepseek/deepseek-pro-latest": { - "cache_read_input_token_cost": 1.8354e-08, - "input_cost_per_token": 5.7684e-07, + "openrouter/openai/gpt-4o-mini:batch": { + "cache_read_input_token_cost": 3.75e-08, + "input_cost_per_token": 7.5e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 393216, - "max_tokens": 393216, + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "off_peak_pricing": {"windows":[{"weekdays":["saturday","sunday"],"hours_utc":"00:00-00:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"00:00-01:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"04:00-06:00"},{"weekdays":["monday","tuesday","wednesday","thursday","friday"],"hours_utc":"10:00-00:00"}],"input_cost_per_token":5.7684e-7,"output_cost_per_token":0.00000173052,"cache_read_input_token_cost":1.8354e-8}, - "output_cost_per_token": 1.73052e-06, + "output_cost_per_token": 3e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/~deepseek/deepseek-v4-flash-latest": { - "cache_read_input_token_cost": 1.6e-08, - "input_cost_per_token": 4e-08, + "openrouter/openai/gpt-4o:batch": { + "cache_read_input_token_cost": 6.25e-07, + "input_cost_per_token": 1.25e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1310720, - "max_output_tokens": 943718, - "max_tokens": 943718, + "max_input_tokens": 128000, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1.6e-07, + "output_cost_per_token": 5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/~google/gemini-flash-latest": { - "cache_creation_input_token_cost": 4.16666666666667e-08, - "cache_read_input_audio_token_cost": 7.5e-08, - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_audio_token": 7.5e-07, - "input_cost_per_token": 7.5e-07, + "openrouter/openai/gpt-5-image": { + "cache_read_input_token_cost": 1.25e-06, + "input_cost_per_token": 1e-05, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3.75e-06, + "output_cost_per_token": 1e-05, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, - "supports_function_calling": true, + "supports_audio_input": false, + "supports_function_calling": false, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, + "supports_tool_choice": false, "supports_vision": true, "supports_web_search": true }, - "openrouter/~google/gemini-pro-latest": { - "cache_creation_input_token_cost": 3.75e-07, - "cache_read_input_audio_token_cost": 2e-07, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_200k_tokens": 4e-07, - "input_cost_per_audio_token": 2e-06, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, + "openrouter/openai/gpt-5-image-mini": { + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 2.5e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_200k_tokens": 1.8e-05, + "output_cost_per_token": 2e-06, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, - "supports_function_calling": true, + "supports_audio_input": false, + "supports_function_calling": false, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, + "supports_tool_choice": false, "supports_vision": true, "supports_web_search": true }, - "openrouter/~moonshotai/kimi-latest": { - "cache_read_input_token_cost": 1.7e-07, - "input_cost_per_token": 1.7e-06, + "openrouter/openai/gpt-5-mini:batch": { + "cache_read_input_token_cost": 1.25e-08, + "input_cost_per_token": 1.25e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 8.5e-06, + "output_cost_per_token": 1e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/~openai/gpt-astra-latest": { - "cache_creation_input_token_cost": 1.25e-05, - "cache_creation_input_token_cost_above_272k_tokens": 2.5e-05, - "cache_read_input_token_cost": 1e-06, - "cache_read_input_token_cost_above_272k_tokens": 2e-06, - "input_cost_per_token": 1e-05, - "input_cost_per_token_above_272k_tokens": 2e-05, + "openrouter/openai/gpt-5-nano:batch": { + "cache_read_input_token_cost": 2.5e-09, + "input_cost_per_token": 2.5e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "max_input_tokens": 400000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 5e-05, - "output_cost_per_token_above_272k_tokens": 7.5e-05, + "output_cost_per_token": 2e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -71618,40 +75156,34 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/~openai/gpt-luna-latest": { - "cache_creation_input_token_cost": 2.5e-07, - "cache_creation_input_token_cost_above_272k_tokens": 5e-07, - "cache_read_input_token_cost": 2e-08, - "cache_read_input_token_cost_above_272k_tokens": 4e-08, - "input_cost_per_token": 2e-07, - "input_cost_per_token_above_272k_tokens": 4e-07, + "openrouter/openai/gpt-5-pro:batch": { + "input_cost_per_token": 7.5e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "max_input_tokens": 400000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.2e-06, - "output_cost_per_token_above_272k_tokens": 1.8e-06, + "output_cost_per_token": 6e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "openrouter/~openai/gpt-mini-latest": { - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_token": 7.5e-07, + "openrouter/openai/gpt-5:batch": { + "cache_read_input_token_cost": 6.25e-08, + "input_cost_per_token": 6.25e-07, "litellm_provider": "openrouter", "max_input_tokens": 400000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 4.5e-06, + "output_cost_per_token": 5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -71663,20 +75195,15 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/~openai/gpt-sol-latest": { - "cache_creation_input_token_cost": 2.5e-06, - "cache_creation_input_token_cost_above_272k_tokens": 5e-06, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_272k_tokens": 4e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_272k_tokens": 4e-06, + "openrouter/openai/gpt-5.1:batch": { + "cache_read_input_token_cost": 6.25e-08, + "input_cost_per_token": 6.25e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "max_input_tokens": 400000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1e-05, - "output_cost_per_token_above_272k_tokens": 1.5e-05, + "output_cost_per_token": 5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -71688,43 +75215,34 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/~openai/gpt-terra-latest": { - "cache_creation_input_token_cost": 2.5e-06, - "cache_creation_input_token_cost_above_272k_tokens": 5e-06, - "cache_read_input_token_cost": 2e-07, - "cache_read_input_token_cost_above_272k_tokens": 4e-07, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_272k_tokens": 4e-06, + "openrouter/openai/gpt-5.2-pro:batch": { + "input_cost_per_token": 1.05e-05, "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "max_input_tokens": 400000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.2e-05, - "output_cost_per_token_above_272k_tokens": 1.8e-05, + "output_cost_per_token": 8.4e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "openrouter/~x-ai/grok-latest": { - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_above_200k_tokens": 1e-06, - "input_cost_per_token": 2e-06, - "input_cost_per_token_above_200k_tokens": 4e-06, + "openrouter/openai/gpt-5.2:batch": { + "cache_read_input_token_cost": 8.75e-08, + "input_cost_per_token": 8.75e-07, "litellm_provider": "openrouter", - "max_input_tokens": 500000, - "max_output_tokens": 450000, - "max_tokens": 450000, + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6e-06, - "output_cost_per_token_above_200k_tokens": 1.2e-05, + "output_cost_per_token": 7e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -71736,251 +75254,239 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/~z-ai/glm-flash-latest": { - "cache_read_input_token_cost": 1.8e-08, - "input_cost_per_token": 9e-08, + "openrouter/openai/gpt-5.4-image-2": { + "cache_read_input_token_cost": 2e-06, + "input_cost_per_token": 8e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1310720, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 272000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3e-07, + "output_cost_per_token": 1.5e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, + "supports_function_calling": false, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, + "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/~z-ai/glm-latest": { - "cache_read_input_token_cost": 1.69e-07, - "input_cost_per_token": 9.1e-07, + "openrouter/openai/gpt-5.4-mini:batch": { + "cache_read_input_token_cost": 3.75e-08, + "input_cost_per_token": 3.75e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1310720, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.86e-06, + "output_cost_per_token": 2.25e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/aion-labs/aion-2.0": { - "cache_read_input_token_cost": 2e-07, - "input_cost_per_token": 8e-07, + "openrouter/openai/gpt-5.4-nano:batch": { + "cache_read_input_token_cost": 1e-08, + "input_cost_per_token": 1e-07, "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_input_tokens": 400000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.6e-06, + "output_cost_per_token": 6.25e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/aion-labs/aion-3.0": { - "cache_read_input_token_cost": 7.5e-07, - "input_cost_per_token": 3e-06, + "openrouter/openai/gpt-5.4-pro:batch": { + "input_cost_per_token": 1.5e-05, + "input_cost_per_token_above_272k_tokens": 3e-05, "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6e-06, + "output_cost_per_token": 9e-05, + "output_cost_per_token_above_272k_tokens": 0.000135, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": true, + "supports_pdf_input": true, + "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/aion-labs/aion-3.0-mini": { - "cache_read_input_token_cost": 1.8e-07, - "input_cost_per_token": 7e-07, + "openrouter/openai/gpt-5.4:batch": { + "cache_read_input_token_cost": 1.25e-07, + "cache_read_input_token_cost_above_272k_tokens": 2.5e-07, + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_above_272k_tokens": 2.5e-06, "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.4e-06, + "output_cost_per_token": 7.5e-06, + "output_cost_per_token_above_272k_tokens": 1.125e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/aion-labs/aion-rp-llama-3.1-8b": { - "input_cost_per_token": 8e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 32768, - "max_output_tokens": 29491, - "max_tokens": 29491, - "mode": "chat", - "output_cost_per_token": 1.6e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/amazon/nova-2-lite-v1": { - "input_cost_per_token": 3e-07, + "openrouter/openai/gpt-5.5-pro:batch": { + "input_cost_per_token": 1.5e-05, + "input_cost_per_token_above_272k_tokens": 3e-05, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 65535, - "max_tokens": 65535, + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-06, + "output_cost_per_token": 9e-05, + "output_cost_per_token_above_272k_tokens": 0.000135, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/amazon/nova-lite-v1": { - "input_cost_per_token": 6e-08, + "openrouter/openai/gpt-5.5:batch": { + "cache_read_input_token_cost": 2.5e-07, + "cache_read_input_token_cost_above_272k_tokens": 5e-07, + "input_cost_per_token": 2.5e-06, + "input_cost_per_token_above_272k_tokens": 5e-06, "litellm_provider": "openrouter", - "max_input_tokens": 300000, - "max_output_tokens": 5120, - "max_tokens": 5120, + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.4e-07, + "output_cost_per_token": 1.5e-05, + "output_cost_per_token_above_272k_tokens": 2.25e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false - }, - "openrouter/amazon/nova-micro-v1": { - "input_cost_per_token": 3.5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 5120, - "max_tokens": 5120, - "mode": "chat", - "output_cost_per_token": 1.4e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/amazon/nova-premier-v1": { - "cache_read_input_token_cost": 6.25e-07, - "input_cost_per_token": 2.5e-06, + "openrouter/openai/gpt-5.6-luna-pro:batch": { + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_272k_tokens": 2e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 32000, - "max_tokens": 32000, + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.25e-05, + "output_cost_per_token": 6e-07, + "output_cost_per_token_above_272k_tokens": 9e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/amazon/nova-pro-v1": { - "input_cost_per_token": 8e-07, + "openrouter/openai/gpt-5.6-luna:batch": { + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_272k_tokens": 2e-07, "litellm_provider": "openrouter", - "max_input_tokens": 300000, - "max_output_tokens": 5120, - "max_tokens": 5120, + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3.2e-06, + "output_cost_per_token": 6e-07, + "output_cost_per_token_above_272k_tokens": 9e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/anthracite-org/magnum-v4-72b": { - "input_cost_per_token": 2.5e-06, + "openrouter/openai/gpt-5.6-sol-pro:batch": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_above_272k_tokens": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 32768, - "max_output_tokens": 4096, - "max_tokens": 4096, + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 5e-06, + "output_cost_per_token_above_272k_tokens": 7.5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true }, - "openrouter/anthropic/claude-fable-5:batch": { - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_1hr": 1e-05, - "cache_read_input_token_cost": 5e-07, - "input_cost_per_token": 5e-06, + "openrouter/openai/gpt-5.6-sol:batch": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_above_272k_tokens": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-05, + "output_cost_per_token": 5e-06, + "output_cost_per_token_above_272k_tokens": 7.5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -71992,17 +75498,18 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/anthropic/claude-fable-5.1:batch": { - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_1hr": 1e-05, - "cache_read_input_token_cost": 1.25e-07, - "input_cost_per_token": 5e-06, + "openrouter/openai/gpt-5.6-terra-pro:batch": { + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_above_272k_tokens": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-05, + "output_cost_per_token": 6e-06, + "output_cost_per_token_above_272k_tokens": 9e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72014,17 +75521,18 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/anthropic/claude-haiku-4.5:batch": { - "cache_creation_input_token_cost": 6.25e-07, - "cache_creation_input_token_cost_above_1hr": 1e-06, - "cache_read_input_token_cost": 5e-08, - "input_cost_per_token": 5e-07, + "openrouter/openai/gpt-5.6-terra:batch": { + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_above_272k_tokens": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-06, + "output_cost_per_token": 6e-06, + "output_cost_per_token_above_272k_tokens": 9e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72036,17 +75544,20 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/anthropic/claude-opus-4.1:batch": { - "cache_creation_input_token_cost": 9.375e-06, - "cache_creation_input_token_cost_above_1hr": 1.5e-05, - "cache_read_input_token_cost": 7.5e-07, - "input_cost_per_token": 7.5e-06, + "openrouter/openai/gpt-6-astra-pro:batch": { + "cache_creation_input_token_cost": 6.25e-06, + "cache_creation_input_token_cost_above_272k_tokens": 1.25e-05, + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_272k_tokens": 1e-06, + "input_cost_per_token": 5e-06, + "input_cost_per_token_above_272k_tokens": 1e-05, "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 32000, - "max_tokens": 32000, + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3.75e-05, + "output_cost_per_token": 2.5e-05, + "output_cost_per_token_above_272k_tokens": 3.75e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72058,17 +75569,20 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/anthropic/claude-opus-4.5:batch": { - "cache_creation_input_token_cost": 3.125e-06, - "cache_creation_input_token_cost_above_1hr": 5e-06, - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 2.5e-06, + "openrouter/openai/gpt-6-astra:batch": { + "cache_creation_input_token_cost": 6.25e-06, + "cache_creation_input_token_cost_above_272k_tokens": 1.25e-05, + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_272k_tokens": 1e-06, + "input_cost_per_token": 5e-06, + "input_cost_per_token_above_272k_tokens": 1e-05, "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.25e-05, + "output_cost_per_token": 2.5e-05, + "output_cost_per_token_above_272k_tokens": 3.75e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72080,17 +75594,20 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/anthropic/claude-opus-4.6:batch": { - "cache_creation_input_token_cost": 3.125e-06, - "cache_creation_input_token_cost_above_1hr": 5e-06, - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 2.5e-06, + "openrouter/openai/gpt-6-luna": { + "cache_creation_input_token_cost": 1.25e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-07, + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_272k_tokens": 2e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.25e-05, + "output_cost_per_token": 5e-07, + "output_cost_per_token_above_272k_tokens": 7.5e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72102,17 +75619,20 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/anthropic/claude-opus-4.7:batch": { - "cache_creation_input_token_cost": 3.125e-06, - "cache_creation_input_token_cost_above_1hr": 5e-06, - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 2.5e-06, + "openrouter/openai/gpt-6-luna-pro": { + "cache_creation_input_token_cost": 1.25e-07, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-07, + "cache_read_input_token_cost": 1e-08, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "input_cost_per_token": 1e-07, + "input_cost_per_token_above_272k_tokens": 2e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.25e-05, + "output_cost_per_token": 5e-07, + "output_cost_per_token_above_272k_tokens": 7.5e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72124,17 +75644,20 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/anthropic/claude-opus-4.8:batch": { - "cache_creation_input_token_cost": 3.125e-06, - "cache_creation_input_token_cost_above_1hr": 5e-06, - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 2.5e-06, + "openrouter/openai/gpt-6-sol": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.25e-05, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72146,17 +75669,20 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/anthropic/claude-opus-5:batch": { - "cache_creation_input_token_cost": 3.125e-06, - "cache_creation_input_token_cost_above_1hr": 5e-06, - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 2.5e-06, + "openrouter/openai/gpt-6-sol-pro": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.25e-05, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72168,21 +75694,15 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/anthropic/claude-sonnet-4.5:batch": { - "cache_creation_input_token_cost": 1.875e-06, - "cache_creation_input_token_cost_above_1hr": 3e-06, - "cache_creation_input_token_cost_above_200k_tokens": 3.75e-06, - "cache_read_input_token_cost": 1.5e-07, - "cache_read_input_token_cost_above_200k_tokens": 3e-07, - "input_cost_per_token": 1.5e-06, - "input_cost_per_token_above_200k_tokens": 3e-06, + "openrouter/openai/o3-mini:batch": { + "cache_read_input_token_cost": 2.75e-07, + "input_cost_per_token": 5.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, "mode": "chat", - "output_cost_per_token": 7.5e-06, - "output_cost_per_token_above_200k_tokens": 1.125e-05, + "output_cost_per_token": 2.2e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72191,20 +75711,18 @@ "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, + "supports_vision": false, "supports_web_search": true }, - "openrouter/anthropic/claude-sonnet-4.6:batch": { - "cache_creation_input_token_cost": 1.875e-06, - "cache_creation_input_token_cost_above_1hr": 3e-06, - "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_token": 1.5e-06, + "openrouter/openai/o3:batch": { + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 1e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, "mode": "chat", - "output_cost_per_token": 7.5e-06, + "output_cost_per_token": 4e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72216,17 +75734,15 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/anthropic/claude-sonnet-5:batch": { - "cache_creation_input_token_cost": 1.25e-06, - "cache_creation_input_token_cost_above_1hr": 2e-06, - "cache_read_input_token_cost": 1e-07, - "input_cost_per_token": 1e-06, + "openrouter/openai/o4-mini:batch": { + "cache_read_input_token_cost": 1.375e-07, + "input_cost_per_token": 5.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1000000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 200000, + "max_output_tokens": 100000, + "max_tokens": 100000, "mode": "chat", - "output_cost_per_token": 5e-06, + "output_cost_per_token": 2.2e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72238,117 +75754,128 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/arcee-ai/trinity-large-thinking": { - "cache_read_input_token_cost": 6e-08, - "input_cost_per_token": 2.5e-07, + "openrouter/perceptron/perceptron-mk1": { + "input_cost_per_token": 1.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 80000, - "max_tokens": 80000, + "max_input_tokens": 32768, + "max_output_tokens": 8192, + "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 8e-07, + "output_cost_per_token": 1.5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, - "supports_prompt_caching": true, + "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": false, - "supports_tool_choice": true, - "supports_vision": false, + "supports_response_schema": true, + "supports_tool_choice": false, + "supports_vision": true, "supports_web_search": false }, - "openrouter/baidu/ernie-4.5-vl-424b-a47b": { - "deprecation_date": "2026-10-08", - "input_cost_per_token": 4.2e-07, + "openrouter/perplexity/sonar": { + "input_cost_per_token": 1e-06, "litellm_provider": "openrouter", - "max_input_tokens": 123000, - "max_output_tokens": 16000, - "max_tokens": 16000, + "max_input_tokens": 127072, + "max_output_tokens": 114364, + "max_tokens": 114364, "mode": "chat", - "output_cost_per_token": 1.25e-06, + "output_cost_per_token": 1e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": false, "supports_pdf_input": false, "supports_prompt_caching": false, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": false, "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/bytedance-seed/seed-1.6": { - "input_cost_per_token": 2.5e-07, - "input_cost_per_token_above_128k_tokens": 5e-07, + "openrouter/perplexity/sonar-deep-research": { + "input_cost_per_token": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_input_tokens": 128000, + "max_output_tokens": 115200, + "max_tokens": 115200, "mode": "chat", - "output_cost_per_token": 2e-06, - "output_cost_per_token_above_128k_tokens": 4e-06, + "output_cost_per_token": 8e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": true + }, + "openrouter/perplexity/sonar-pro": { + "input_cost_per_token": 3e-06, + "litellm_provider": "openrouter", + "max_input_tokens": 200000, + "max_output_tokens": 8000, + "max_tokens": 8000, + "mode": "chat", + "output_cost_per_token": 1.5e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/bytedance-seed/seed-1.6-flash": { - "input_cost_per_token": 7.5e-08, - "input_cost_per_token_above_128k_tokens": 1e-07, + "openrouter/perplexity/sonar-pro-search": { + "input_cost_per_token": 3e-06, "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_input_tokens": 200000, + "max_output_tokens": 8000, + "max_tokens": 8000, "mode": "chat", - "output_cost_per_token": 3e-07, - "output_cost_per_token_above_128k_tokens": 8e-07, + "output_cost_per_token": 1.5e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, + "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/bytedance-seed/seed-2-1-turbo": { - "input_cost_per_token": 5e-07, + "openrouter/perplexity/sonar-reasoning-pro": { + "input_cost_per_token": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "max_input_tokens": 128000, + "max_output_tokens": 115200, + "max_tokens": 115200, "mode": "chat", - "output_cost_per_token": 2.5e-06, + "output_cost_per_token": 8e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "supports_response_schema": false, + "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/bytedance-seed/seed-2.0-code": { - "input_cost_per_token": 5e-07, - "input_cost_per_token_above_128k_tokens": 1e-06, + "openrouter/qwen/qwen3.8-27b:free": { + "input_cost_per_token": 0.0, "litellm_provider": "openrouter", "max_input_tokens": 262144, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 3e-06, - "output_cost_per_token_above_128k_tokens": 6e-06, + "output_cost_per_token": 0.0, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72360,113 +75887,195 @@ "supports_vision": true, "supports_web_search": false }, - "openrouter/bytedance-seed/seed-2.0-lite": { - "input_cost_per_token": 2.5e-07, - "input_cost_per_token_above_128k_tokens": 5e-07, + "openrouter/rekaai/reka-edge": { + "input_cost_per_token": 1e-07, "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 16384, + "max_output_tokens": 14745, + "max_tokens": 14745, "mode": "chat", - "output_cost_per_token": 2e-06, - "output_cost_per_token_above_128k_tokens": 4e-06, + "output_cost_per_token": 1e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": false, "supports_prompt_caching": false, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": false }, - "openrouter/bytedance-seed/seed-2.0-mini": { + "openrouter/rekaai/reka-flash-3": { "input_cost_per_token": 1e-07, - "input_cost_per_token_above_128k_tokens": 2e-07, "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 131072, - "max_tokens": 131072, + "max_input_tokens": 65536, + "max_output_tokens": 58982, + "max_tokens": 58982, "mode": "chat", - "output_cost_per_token": 4e-07, - "output_cost_per_token_above_128k_tokens": 8e-07, + "output_cost_per_token": 2e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, + "supports_tool_choice": false, + "supports_vision": false, "supports_web_search": false }, - "openrouter/cognitivecomputations/dolphin-mistral-24b-venice-edition": { - "input_cost_per_token": 2e-07, + "openrouter/relace/relace-apply-3": { + "input_cost_per_token": 8.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_input_tokens": 256000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 9e-07, + "output_cost_per_token": 1.25e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": false, "supports_pdf_input": false, "supports_prompt_caching": false, "supports_reasoning": false, - "supports_response_schema": true, + "supports_response_schema": false, "supports_tool_choice": false, "supports_vision": false, "supports_web_search": false }, - "openrouter/cohere/command-a": { - "input_cost_per_token": 2.5e-06, + "openrouter/relace/relace-search": { + "input_cost_per_token": 1e-06, "litellm_provider": "openrouter", "max_input_tokens": 256000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1e-05, + "output_cost_per_token": 3e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": false, + "supports_function_calling": true, "supports_pdf_input": false, "supports_prompt_caching": false, "supports_reasoning": false, "supports_response_schema": true, - "supports_tool_choice": false, + "supports_tool_choice": true, "supports_vision": false, "supports_web_search": false }, - "openrouter/cohere/command-r-08-2024": { - "input_cost_per_token": 1.5e-07, + "openrouter/sakana/fugu-max": { + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 4000, - "max_tokens": 4000, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 6e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, + "openrouter/sakana/fugu-ultra": { + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_272k_tokens": 1e-06, + "input_cost_per_token": 5e-06, + "input_cost_per_token_above_272k_tokens": 1e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 3e-05, + "output_cost_per_token_above_272k_tokens": 4.5e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, + "openrouter/sakana/fugu-ultra-v2": { + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_272k_tokens": 1e-06, + "input_cost_per_token": 5e-06, + "input_cost_per_token_above_272k_tokens": 1e-05, + "litellm_provider": "openrouter", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, + "mode": "chat", + "output_cost_per_token": 3e-05, + "output_cost_per_token_above_272k_tokens": 4.5e-05, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, + "openrouter/sakana/sakana-namazu": { + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 9.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 4e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true + }, + "openrouter/sao10k/l3-lunaris-8b": { + "input_cost_per_token": 4e-08, + "litellm_provider": "openrouter", + "max_input_tokens": 8192, + "max_output_tokens": 7372, + "max_tokens": 7372, "mode": "chat", - "output_cost_per_token": 6e-07, + "output_cost_per_token": 5e-08, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, "supports_prompt_caching": false, "supports_reasoning": false, "supports_response_schema": true, - "supports_tool_choice": true, + "supports_tool_choice": false, "supports_vision": false, "supports_web_search": false }, - "openrouter/cohere/command-r-plus-08-2024": { - "input_cost_per_token": 2.5e-06, + "openrouter/sao10k/l3.1-euryale-70b": { + "input_cost_per_token": 8.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 4000, - "max_tokens": 4000, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1e-05, + "output_cost_per_token": 8.5e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72478,14 +76087,14 @@ "supports_vision": false, "supports_web_search": false }, - "openrouter/cohere/command-r7b-12-2024": { - "input_cost_per_token": 3.75e-08, + "openrouter/sao10k/l3.3-euryale-70b": { + "input_cost_per_token": 6.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 4000, - "max_tokens": 4000, + "max_input_tokens": 131072, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1.5e-07, + "output_cost_per_token": 7.5e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": false, @@ -72497,15 +76106,31 @@ "supports_vision": false, "supports_web_search": false }, - "openrouter/cohere/north-mini-code:free": { + "openrouter/stealth/space-bunny-alpha": { + "deprecation_date": "2026-10-05", "input_cost_per_token": 0.0, "litellm_provider": "openrouter", - "max_input_tokens": 256000, - "max_output_tokens": 64000, - "max_tokens": 64000, + "max_input_tokens": 1000000, + "max_output_tokens": 524288, + "max_tokens": 524288, "mode": "chat", "output_cost_per_token": 0.0, "source": "https://openrouter.ai/api/v1/models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_video_input": true, + "supports_vision": true + }, + "openrouter/stepfun/step-3.5-flash": { + "input_cost_per_token": 1e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 262144, + "max_output_tokens": 65536, + "max_tokens": 65536, + "mode": "chat", + "output_cost_per_token": 3e-07, + "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": false, @@ -72516,15 +76141,15 @@ "supports_vision": false, "supports_web_search": false }, - "openrouter/deepseek/deepseek-v4-flash-0731:batch": { - "cache_read_input_token_cost": 3.5e-09, - "input_cost_per_token": 1.1e-07, + "openrouter/stepfun/step-3.7-flash": { + "cache_read_input_token_cost": 4e-08, + "input_cost_per_token": 2e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "max_input_tokens": 262144, + "max_output_tokens": 230400, + "max_tokens": 230400, "mode": "chat", - "output_cost_per_token": 3.3e-07, + "output_cost_per_token": 1.15e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72533,375 +76158,333 @@ "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, + "supports_vision": true, "supports_web_search": false }, - "openrouter/deepseek/deepseek-v4-flash-0731:free": { - "input_cost_per_token": 0.0, + "openrouter/tencent/hunyuan-a13b-instruct": { + "input_cost_per_token": 1.4e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 393216, - "max_tokens": 393216, + "max_input_tokens": 131072, + "max_output_tokens": 117964, + "max_tokens": 117964, "mode": "chat", - "output_cost_per_token": 0.0, + "output_cost_per_token": 5.7e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, + "supports_tool_choice": false, "supports_vision": false, "supports_web_search": false }, - "openrouter/deepseek/deepseek-v4-flash-vision-exp:batch": { - "cache_read_input_token_cost": 3.5e-09, - "input_cost_per_token": 1.1e-07, + "openrouter/tencent/hy-mt2-1.8b": { + "input_cost_per_token": 4.4e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "max_input_tokens": 8192, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 3.3e-07, + "output_cost_per_token": 1.77e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": false, "supports_web_search": false }, - "openrouter/deepseek/deepseek-v4-pro-0813:batch": { - "cache_read_input_token_cost": 2.2e-08, - "input_cost_per_token": 6.6e-07, + "openrouter/tencent/hy-mt2-30b-a3b": { + "input_cost_per_token": 7.4e-08, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "max_input_tokens": 8192, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 1.98e-06, + "output_cost_per_token": 2.95e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, - "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_prompt_caching": false, + "supports_reasoning": false, "supports_response_schema": true, - "supports_tool_choice": true, + "supports_tool_choice": false, "supports_vision": false, "supports_web_search": false }, - "openrouter/dots-studio/dots-3-note-preview:free": { - "deprecation_date": "2026-09-30", - "input_cost_per_token": 0.0, + "openrouter/tencent/hy-mt2-7b": { + "input_cost_per_token": 7.4e-08, "litellm_provider": "openrouter", - "max_input_tokens": 512000, - "max_output_tokens": 460800, - "max_tokens": 460800, + "max_input_tokens": 8192, + "max_output_tokens": 4096, + "max_tokens": 4096, "mode": "chat", - "output_cost_per_token": 0.0, + "output_cost_per_token": 2.95e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": true, + "supports_function_calling": false, "supports_pdf_input": false, "supports_prompt_caching": false, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, + "supports_tool_choice": false, + "supports_vision": false, "supports_web_search": false }, - "openrouter/google/gemini-2.5-flash-lite:batch": { - "cache_read_input_audio_token_cost": 3e-08, - "cache_read_input_token_cost": 1e-08, - "input_cost_per_audio_token": 1.5e-07, - "input_cost_per_token": 5e-08, + "openrouter/tencent/hy3": { + "cache_read_input_token_cost": 3.3e-08, + "input_cost_per_token": 1.32e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "max_input_tokens": 262144, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2e-07, + "off_peak_pricing": {"hours_utc":"16:00-00:00","input_cost_per_token":8.25e-8,"output_cost_per_token":3.3e-7,"cache_read_input_token_cost":2.0625e-8}, + "output_cost_per_token": 5.28e-07, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_video_input": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/google/gemini-2.5-flash:batch": { - "cache_read_input_audio_token_cost": 1e-07, - "cache_read_input_token_cost": 3e-08, - "deprecation_date": "2026-10-20", - "input_cost_per_audio_token": 5e-07, - "input_cost_per_token": 1.5e-07, + "openrouter/tencent/hy3-preview": { + "cache_read_input_token_cost": 6e-08, + "input_cost_per_token": 1.8e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65535, - "max_tokens": 65535, + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 1.25e-06, + "output_cost_per_token": 6e-07, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, + "supports_response_schema": false, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_video_input": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/google/gemini-2.5-pro:batch": { - "cache_read_input_audio_token_cost": 1.25e-07, - "cache_read_input_token_cost": 1.25e-07, - "cache_read_input_token_cost_above_200k_tokens": 2.5e-07, - "deprecation_date": "2026-10-20", - "input_cost_per_audio_token": 6.25e-07, - "input_cost_per_token": 6.25e-07, - "input_cost_per_token_above_200k_tokens": 1.25e-06, + "openrouter/tencent/hy4-preview": { + "cache_read_input_token_cost": 4.2e-08, + "input_cost_per_token": 8.34e-07, "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 5e-06, - "output_cost_per_token_above_200k_tokens": 7.5e-06, + "off_peak_pricing": {"input_cost_per_token":7.506e-7,"output_cost_per_token":0.0000022509,"cache_read_input_token_cost":3.78e-8,"hours_utc":"16:00-00:00"}, + "output_cost_per_token": 2.501e-06, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_video_input": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/google/gemini-3-flash-preview:batch": { - "input_cost_per_audio_token": 5e-07, - "input_cost_per_token": 2.5e-07, + "openrouter/thedrummer/cydonia-24b-v4.1": { + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 3e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 131072, + "max_output_tokens": 117964, + "max_tokens": 117964, "mode": "chat", - "output_cost_per_token": 1.5e-06, + "output_cost_per_token": 5e-07, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": false, - "supports_reasoning": true, + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": true, + "supports_reasoning": false, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_video_input": true + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "openrouter/google/gemini-3.1-flash-lite:batch": { - "cache_read_input_audio_token_cost": 2.5e-08, - "cache_read_input_token_cost": 1.25e-08, - "input_cost_per_audio_token": 2.5e-07, - "input_cost_per_token": 1.25e-07, + "openrouter/thedrummer/skyfall-36b-v2": { + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 5.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 32768, + "max_output_tokens": 29491, + "max_tokens": 29491, "mode": "chat", - "output_cost_per_token": 7.5e-07, + "output_cost_per_token": 8e-07, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, - "supports_function_calling": true, - "supports_pdf_input": true, + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, "supports_prompt_caching": true, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_video_input": true + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "openrouter/google/gemini-3.1-pro-preview:batch": { - "input_cost_per_audio_token": 1e-06, - "input_cost_per_token": 1e-06, - "input_cost_per_token_above_200k_tokens": 2e-06, + "openrouter/thedrummer/unslopnemo-12b": { + "input_cost_per_token": 4e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 1024000, + "max_output_tokens": 819200, + "max_tokens": 819200, "mode": "chat", - "output_cost_per_token": 6e-06, - "output_cost_per_token_above_200k_tokens": 9e-06, + "output_cost_per_token": 4e-07, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, - "supports_function_calling": true, - "supports_pdf_input": true, + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, "supports_prompt_caching": false, - "supports_reasoning": true, + "supports_reasoning": false, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true, - "supports_video_input": true + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false }, - "openrouter/google/gemini-3.5-flash-lite:batch": { - "cache_read_input_audio_token_cost": 1.5e-08, - "cache_read_input_token_cost": 1.5e-08, - "input_cost_per_audio_token": 1.5e-07, - "input_cost_per_token": 1.5e-07, + "openrouter/thinkingmachines/inkling": { + "cache_read_input_token_cost": 1.7e-07, + "input_cost_per_token": 1e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 524288, + "max_output_tokens": 471859, + "max_tokens": 471859, "mode": "chat", - "output_cost_per_token": 1.25e-06, + "output_cost_per_token": 4.05e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": true, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, + "supports_response_schema": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true, - "supports_video_input": true + "supports_web_search": false }, - "openrouter/google/gemini-3.5-flash:batch": { - "cache_read_input_audio_token_cost": 1.5e-07, - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_audio_token": 1.5e-06, - "input_cost_per_token": 7.5e-07, + "openrouter/thinkingmachines/inkling-small": { + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 4.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 524288, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 4.5e-06, + "output_cost_per_token": 1.2e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": true, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, + "supports_response_schema": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true, - "supports_video_input": true + "supports_web_search": false }, - "openrouter/google/gemini-3.6-flash:batch": { - "cache_creation_input_token_cost": 4.16666666666667e-08, - "cache_read_input_audio_token_cost": 3.75e-08, - "cache_read_input_token_cost": 3.75e-08, - "input_cost_per_audio_token": 3.75e-07, - "input_cost_per_token": 3.75e-07, + "openrouter/thinkingmachines/inkling-small:free": { + "input_cost_per_token": 0.0, "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 1.875e-06, + "output_cost_per_token": 0.0, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": true, "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "supports_response_schema": false, + "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": true, - "supports_video_input": true + "supports_web_search": false }, - "openrouter/google/gemini-3.7-flash:batch": { - "cache_creation_input_token_cost": 4.16666666666667e-08, - "cache_read_input_audio_token_cost": 3.75e-08, - "cache_read_input_token_cost": 3.75e-08, - "input_cost_per_audio_token": 3.75e-07, - "input_cost_per_token": 3.75e-07, + "openrouter/thinkingmachines/inkling:free": { + "input_cost_per_token": 0.0, "litellm_provider": "openrouter", "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 1.875e-06, + "output_cost_per_token": 0.0, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": true, "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_pdf_input": false, + "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "supports_response_schema": false, + "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": true, - "supports_video_input": true + "supports_web_search": false }, - "openrouter/google/gemini-3.8-flash:batch": { - "cache_creation_input_token_cost": 4.16666666666667e-08, - "cache_read_input_audio_token_cost": 3.75e-08, - "cache_read_input_token_cost": 3.75e-08, - "input_cost_per_audio_token": 3.75e-07, - "input_cost_per_token": 3.75e-07, + "openrouter/unbiased/pareto": { + "cache_read_input_token_cost": 2.5e-07, + "input_cost_per_token": 2.5e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 262144, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.875e-06, + "output_cost_per_token": 7.5e-06, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, + "supports_reasoning": false, + "supports_response_schema": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true, - "supports_video_input": true + "supports_web_search": false }, - "openrouter/ibm-granite/granite-4.0-h-micro": { - "input_cost_per_token": 1.7e-08, + "openrouter/upstage/solar-pro-3": { + "cache_read_input_token_cost": 1.5e-08, + "input_cost_per_token": 1.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 131000, - "max_output_tokens": 117900, - "max_tokens": 117900, + "max_input_tokens": 131072, + "max_output_tokens": 117964, + "max_tokens": 117964, "mode": "chat", - "output_cost_per_token": 1.12e-07, + "output_cost_per_token": 6e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": false, + "supports_function_calling": true, "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": false, + "supports_tool_choice": true, "supports_vision": false, "supports_web_search": false }, - "openrouter/ibm-granite/granite-4.2-8b": { - "cache_read_input_token_cost": 5e-08, - "input_cost_per_token": 1e-07, + "openrouter/upstage/solar-pro4": { + "cache_read_input_token_cost": 1.8e-08, + "input_cost_per_token": 9e-08, "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 117964, - "max_tokens": 117964, + "max_input_tokens": 524288, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.5e-07, + "output_cost_per_token": 3.6e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72913,15 +76496,15 @@ "supports_vision": false, "supports_web_search": false }, - "openrouter/inception/mercury-2": { - "cache_read_input_token_cost": 2.5e-08, - "input_cost_per_token": 2.5e-07, + "openrouter/upstage/solar-mini4": { + "cache_read_input_token_cost": 5e-09, + "input_cost_per_token": 5e-08, "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 50000, - "max_tokens": 50000, + "max_input_tokens": 524288, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 7.5e-07, + "output_cost_per_token": 2e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72933,35 +76516,57 @@ "supports_vision": false, "supports_web_search": false }, - "openrouter/inception/mercury-2.5": { - "cache_read_input_token_cost": 4e-09, - "input_cost_per_token": 4e-08, + "openrouter/writer/palmyra-x5": { + "input_cost_per_token": 6e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 1040000, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 6e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": false, + "supports_function_calling": false, + "supports_pdf_input": false, + "supports_prompt_caching": false, + "supports_reasoning": false, + "supports_response_schema": false, + "supports_tool_choice": false, + "supports_vision": false, + "supports_web_search": false + }, + "openrouter/x-ai/grok-4.3:batch": { + "cache_read_input_token_cost": 1.6e-07, + "cache_read_input_token_cost_above_200k_tokens": 3.2e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_above_200k_tokens": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 260000, - "max_output_tokens": 65536, - "max_tokens": 65536, + "max_input_tokens": 1000000, + "max_output_tokens": 900000, + "max_tokens": 900000, "mode": "chat", - "output_cost_per_token": 1.5e-07, + "output_cost_per_token": 2e-06, + "output_cost_per_token_above_200k_tokens": 4e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_web_search": true }, - "openrouter/inclusionai/ling-3.0-flash": { - "cache_read_input_token_cost": 4.2e-09, - "input_cost_per_token": 2.1e-08, + "openrouter/z-ai/glm-5.3-flash:batch": { + "cache_read_input_token_cost": 1.2e-08, + "input_cost_per_token": 6e-08, "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 6.3e-08, + "output_cost_per_token": 2e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72970,18 +76575,18 @@ "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, + "supports_vision": true, "supports_web_search": false }, - "openrouter/inclusionai/ling-3.0-flash-fin": { - "cache_read_input_token_cost": 1.2e-08, - "input_cost_per_token": 6e-08, + "openrouter/z-ai/glm-5.3:batch": { + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 4.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.8e-07, + "output_cost_per_token": 2e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -72993,53 +76598,56 @@ "supports_vision": false, "supports_web_search": false }, - "openrouter/inclusionai/ling-3.0-flash-fin:free": { - "input_cost_per_token": 0.0, + "openrouter/prism-ml/ternary-bonsai-2-27b": { + "cache_read_input_token_cost": 3.75e-08, + "input_cost_per_token": 7.5e-08, "litellm_provider": "openrouter", "max_input_tokens": 262144, "max_output_tokens": 32768, "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 0.0, + "output_cost_per_token": 5e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": false, "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, + "supports_vision": true, "supports_web_search": false }, - "openrouter/inclusionai/ling-3.0-flash-sante:free": { - "input_cost_per_token": 0.0, + "openrouter/z-ai/glm-5.3-prime": { + "cache_read_input_token_cost": 5.6e-07, + "input_cost_per_token": 2.8e-06, "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 0.0, + "output_cost_per_token": 8.8e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": false, - "supports_prompt_caching": false, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": false, "supports_web_search": false }, - "openrouter/inclusionai/ling-3.0-flash-vl": { - "cache_read_input_token_cost": 1.2e-08, - "input_cost_per_token": 6e-08, + "openrouter/z-ai/glm-5.3-flashx": { + "cache_read_input_token_cost": 9e-08, + "deprecation_date": "2098-12-31", + "input_cost_per_token": 3.7e-07, "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.8e-07, + "output_cost_per_token": 1.25e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -73051,820 +76659,1150 @@ "supports_vision": true, "supports_web_search": false }, - "openrouter/inclusionai/ling-3.0-flash-vl:free": { - "input_cost_per_token": 0.0, + "openrouter/x-ai/grok-4.7": { + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_200k_tokens": 1e-06, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_input_tokens": 500000, + "max_output_tokens": 450000, + "max_tokens": 450000, "mode": "chat", - "output_cost_per_token": 0.0, + "output_cost_per_token": 6e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true }, - "openrouter/inference-net/schematron-v2-small": { - "cache_read_input_token_cost": 5e-08, - "input_cost_per_token": 5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, + "moonshotai.kimi-k3": { + "cache_creation_input_token_cost": 4.125e-06, + "cache_read_input_token_cost": 3.3e-07, + "input_cost_per_token": 3.3e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 2.3e-07, - "source": "https://openrouter.ai/api/v1/models", + "output_cost_per_token": 1.65e-05, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrock/current/us-east-1/index.json", "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, + "supports_function_calling": true, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true }, - "openrouter/inference-net/schematron-v2-turbo": { - "cache_read_input_token_cost": 3e-08, - "input_cost_per_token": 3e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 8192, - "max_tokens": 8192, + "global.moonshotai.kimi-k3": { + "cache_creation_input_token_cost": 3.75e-06, + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 3e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.5e-07, - "source": "https://openrouter.ai/api/v1/models", + "output_cost_per_token": 1.5e-05, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, + "supports_function_calling": true, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true }, - "openrouter/kwaipilot/kat-coder-pro-v2": { - "cache_read_input_token_cost": 6e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 144000, - "max_tokens": 144000, + "us.moonshotai.kimi-k3": { + "cache_creation_input_token_cost": 4.125e-06, + "cache_read_input_token_cost": 3.3e-07, + "input_cost_per_token": 3.3e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://openrouter.ai/api/v1/models", + "output_cost_per_token": 1.65e-05, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": false, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, + "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/kwaipilot/kat-coder-pro-v2.5": { - "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_token": 7.4e-07, + "openrouter/xiaomi/mimo-v2.6-flash": { + "cache_read_input_token_cost": 2.8e-09, + "input_cost_per_token": 1.4e-07, "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 2.96e-06, + "output_cost_per_token": 2.8e-07, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_audio_input": true, "supports_function_calling": true, "supports_pdf_input": false, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, + "supports_vision": true, "supports_web_search": false }, - "openrouter/liquid/lfm-2.5-2.6b:free": { - "input_cost_per_token": 0.0, + "openrouter/xiaomi/mimo-v2.6-pro": { + "cache_read_input_token_cost": 3.6e-09, + "input_cost_per_token": 4.35e-07, "litellm_provider": "openrouter", - "max_input_tokens": 65536, - "max_output_tokens": 8192, - "max_tokens": 8192, + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 0.0, + "output_cost_per_token": 8.7e-07, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_audio_input": true, "supports_function_calling": true, "supports_pdf_input": false, - "supports_prompt_caching": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, + "supports_vision": true, "supports_web_search": false }, - "openrouter/meituan/longcat-2.0": { - "cache_read_input_token_cost": 6e-09, - "input_cost_per_token": 3e-07, + "openrouter/xiaomi/mimo-v2.6-pro-ultraspeed": { + "cache_read_input_token_cost": 3.6e-08, + "input_cost_per_token": 4.35e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1048756, - "max_output_tokens": 262144, - "max_tokens": 262144, + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.2e-06, + "output_cost_per_token": 8.7e-06, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_audio_input": true, "supports_function_calling": true, "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, + "supports_vision": true, "supports_web_search": false }, - "openrouter/meta/muse-glimmer-30b": { - "cache_read_input_token_cost": 4e-08, - "input_cost_per_token": 3e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "xiaomi_mimo/mimo-v2.6-pro": { + "cache_read_input_token_cost": 3.6e-09, + "input_cost_per_token": 4.35e-07, + "litellm_provider": "xiaomi_mimo", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 8.7e-07, + "source": "https://platform.xiaomimimo.com/static/docs/price/pay-as-you-go.md", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_audio_input": true, + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_video_input": true, + "supports_vision": true + }, + "xiaomi_mimo/mimo-v2.6-flash": { + "cache_read_input_token_cost": 2.8e-09, + "input_cost_per_token": 1.4e-07, + "litellm_provider": "xiaomi_mimo", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "chat", + "output_cost_per_token": 2.8e-07, + "source": "https://platform.xiaomimimo.com/static/docs/price/pay-as-you-go.md", + "supported_endpoints": [ + "/v1/chat/completions" + ], + "supports_audio_input": true, + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_video_input": true, + "supports_vision": true + }, + "xai/grok-4.20-0309": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1.6e-07, + "input_cost_per_token": 1.25e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "output_cost_per_token_batches": 2e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "input_cost_per_token_above_200k_tokens_batches": 2e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "output_cost_per_token_above_200k_tokens_batches": 4e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "cache_read_input_token_cost_above_200k_tokens_batches": 3.2e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true + }, + "xai/grok-4.20-beta": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true + }, + "xai/grok-4.20-beta-0309": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true + }, + "xai/grok-4.20-beta-latest": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true + }, + "xai/grok-4.20-beta-latest-non-reasoning": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_pdf_input": false, "supports_prompt_caching": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true + }, + "xai/grok-4.20-beta-latest-reasoning": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true + }, + "xai/grok-4.20-beta-non-reasoning": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true + }, + "xai/grok-4.20-beta-reasoning": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true + }, + "xai/grok-4.20-experimental-beta-0304": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true + }, + "xai/grok-4.20-experimental-beta-0304-non-reasoning": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true + }, + "xai/grok-4.20-experimental-beta-0304-reasoning": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true + }, + "xai/grok-4.20-experimental-beta-latest": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "chat", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true }, - "openrouter/meta/muse-glimmer-30b:batch": { - "cache_read_input_token_cost": 2e-08, - "input_cost_per_token": 1.75e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 117964, - "max_tokens": 117964, + "xai/grok-4.20-experimental-beta-non-reasoning-latest": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 7.5e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_pdf_input": false, "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true }, - "openrouter/meta/muse-spark-1.1": { - "cache_read_input_token_cost": 1.5e-07, + "xai/grok-4.20-experimental-beta-reasoning-latest": { + "cache_read_input_token_cost": 2e-07, "input_cost_per_token": 1.25e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 4.25e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true }, - "openrouter/meta/muse-spark-1.2": { - "cache_read_input_token_cost": 1.5e-07, + "xai/grok-4.20-multi-agent-beta-latest": { + "cache_read_input_token_cost": 2e-07, "input_cost_per_token": 1.25e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, - "mode": "chat", - "output_cost_per_token": 4.25e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, - "supports_function_calling": true, - "supports_pdf_input": true, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "responses", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": false, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, + "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true, + "supported_endpoints": [ + "/v1/responses" + ] }, - "openrouter/meta/muse-spark-1.2-contributor": { - "cache_read_input_token_cost": 2e-09, - "input_cost_per_token": 1e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, - "mode": "chat", - "output_cost_per_token": 2e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, - "supports_function_calling": true, - "supports_pdf_input": true, + "xai/grok-4.20-multi-agent-experimental-beta-0304": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "responses", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": false, "supports_prompt_caching": true, "supports_reasoning": true, + "supports_tool_choice": false, + "supports_vision": true, + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, "supports_response_schema": true, - "supports_tool_choice": true, + "supported_endpoints": [ + "/v1/responses" + ] + }, + "xai/grok-4.20-multi-agent-experimental-beta-latest": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, + "mode": "responses", + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true, + "supported_endpoints": [ + "/v1/responses" + ] }, - "openrouter/meta/muse-spark-1.3": { - "cache_read_input_token_cost": 1.5e-07, + "xai/grok-4.20-non-reasoning-gv2": { + "cache_read_input_token_cost": 2e-07, "input_cost_per_token": 1.25e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 4.25e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_response_schema": true }, - "openrouter/meta/muse-spark-1.3-contributor": { - "cache_read_input_token_cost": 2e-09, - "input_cost_per_token": 1e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "xai/grok-4.20-reasoning-gv2": { + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 1.25e-06, + "litellm_provider": "xai", + "max_input_tokens": 1000000, + "max_output_tokens": 1000000, + "max_tokens": 1000000, "mode": "chat", - "output_cost_per_token": 2e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "output_cost_per_token": 2.5e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": true, + "input_cost_per_token_above_200k_tokens": 2.5e-06, + "output_cost_per_token_above_200k_tokens": 5e-06, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1.25e-06, + "supports_prompt_caching": true, + "supports_response_schema": true }, - "openrouter/microsoft/phi-4": { - "input_cost_per_token": 7e-08, + "openrouter/nex-agi/nex-n2.5-mini": { + "cache_read_input_token_cost": 2.5e-09, + "input_cost_per_token": 2.5e-08, "litellm_provider": "openrouter", - "max_input_tokens": 16384, - "max_output_tokens": 14745, - "max_tokens": 14745, + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 1.4e-07, + "output_cost_per_token": 1e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": false, "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": false, - "supports_vision": false, + "supports_vision": true, "supports_web_search": false }, - "openrouter/microsoft/wizardlm-2-8x22b": { - "input_cost_per_token": 6.2e-07, + "openrouter/nex-agi/nex-n2.5-pro": { + "cache_read_input_token_cost": 1.5e-08, + "input_cost_per_token": 7.5e-08, "litellm_provider": "openrouter", - "max_input_tokens": 65535, - "max_output_tokens": 8000, - "max_tokens": 8000, + "max_input_tokens": 262144, + "max_output_tokens": 235929, + "max_tokens": 235929, "mode": "chat", - "output_cost_per_token": 6.2e-07, + "output_cost_per_token": 2.5e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": false, + "supports_function_calling": true, "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, + "supports_tool_choice": true, + "supports_vision": true, "supports_web_search": false }, - "openrouter/minimax/minimax-m3:batch": { - "cache_read_input_token_cost": 6e-08, + "baseten/deepseek-ai/DeepSeek-V4.1-Flash": { + "cache_read_input_token_cost": 7e-09, "input_cost_per_token": 3e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 524288, - "max_output_tokens": 471859, - "max_tokens": 471859, + "litellm_provider": "baseten", + "max_input_tokens": 1048576, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", "output_cost_per_token": 1.2e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false + "supports_vision": true }, - "openrouter/mistralai/codestral-2508:batch": { - "cache_read_input_token_cost": 1.5e-08, - "input_cost_per_token": 1.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 256000, - "max_output_tokens": 204800, - "max_tokens": 204800, + "baseten/moonshotai/Kimi-K2.6": { + "cache_read_input_token_cost": 1.6e-07, + "input_cost_per_token": 9.5e-07, + "litellm_provider": "baseten", + "max_input_tokens": 262000, + "max_output_tokens": 262000, + "max_tokens": 262000, "mode": "chat", - "output_cost_per_token": 4.5e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 4e-06, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/mistralai/ministral-8b-2512:batch": { - "cache_read_input_token_cost": 7.5e-09, - "input_cost_per_token": 7.5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 209715, - "max_tokens": 209715, + "baseten/moonshotai/Kimi-K2.7-Code": { + "cache_read_input_token_cost": 1.6e-07, + "input_cost_per_token": 9.5e-07, + "litellm_provider": "baseten", + "max_input_tokens": 262000, + "max_output_tokens": 262000, + "max_tokens": 262000, "mode": "chat", - "output_cost_per_token": 7.5e-08, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 4e-06, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false + "supports_vision": true }, - "openrouter/mistralai/mistral-large-2512:batch": { - "cache_read_input_token_cost": 2.5e-08, - "input_cost_per_token": 2.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 209715, - "max_tokens": 209715, + "baseten/moonshotai/Kimi-K3": { + "cache_read_input_token_cost": 3e-07, + "input_cost_per_token": 3e-06, + "litellm_provider": "baseten", + "max_input_tokens": 1048576, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 7.5e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.5e-05, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false + "supports_vision": true }, - "openrouter/mistralai/mistral-medium-3-5:batch": { - "input_cost_per_token": 7.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 209715, - "max_tokens": 209715, + "baseten/nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B": { + "cache_read_input_token_cost": 1.2e-07, + "input_cost_per_token": 6e-07, + "litellm_provider": "baseten", + "max_input_tokens": 202800, + "max_output_tokens": 202800, + "max_tokens": 202800, "mode": "chat", - "output_cost_per_token": 3.75e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.4e-06, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false + "supports_vision": false }, - "openrouter/mistralai/mistral-medium-3.1:batch": { - "cache_read_input_token_cost": 2e-08, - "input_cost_per_token": 2e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 104857, - "max_tokens": 104857, + "baseten/thinkingmachines/inkling": { + "cache_read_input_token_cost": 1.7e-07, + "input_cost_per_token": 1e-06, + "litellm_provider": "baseten", + "max_input_tokens": 1048576, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 1e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 4.05e-06, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false + "supports_vision": true }, - "openrouter/mistralai/mistral-small-2603:batch": { - "cache_read_input_token_cost": 7.5e-09, - "input_cost_per_token": 7.5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 209715, - "max_tokens": 209715, + "baseten/thinkingmachines/inkling-small": { + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 5e-07, + "litellm_provider": "baseten", + "max_input_tokens": 1048576, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 3e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.2e-06, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false + "supports_vision": true }, - "openrouter/moonshotai/kimi-k3:batch": { - "cache_read_input_token_cost": 3e-07, - "input_cost_per_token": 3e-06, - "litellm_provider": "openrouter", + "baseten/zai-org/GLM-5.2": { + "cache_read_input_token_cost": 1.4e-07, + "input_cost_per_token": 1.4e-06, + "litellm_provider": "baseten", "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 1.5e-05, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 4.4e-06, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false - }, - "openrouter/morph/morph-v3-fast": { - "input_cost_per_token": 8e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 81920, - "max_output_tokens": 38000, - "max_tokens": 38000, - "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/morph/morph-v3-large": { - "input_cost_per_token": 9e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, + "baseten/zai-org/GLM-5.3-Flash": { + "cache_read_input_token_cost": 3e-08, + "input_cost_per_token": 1.5e-07, + "litellm_provider": "baseten", + "max_input_tokens": 1048576, "max_output_tokens": 131072, "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.9e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, + "output_cost_per_token": 5e-07, + "source": "https://inference.baseten.co/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_tool_choice": true, + "supports_vision": true }, - "openrouter/nex-agi/nex-n2.5-mini:free": { - "input_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "baseten/deepseek-ai/DeepSeek-V4-Flash-0731": { + "cache_read_input_token_cost": 2.8e-08, + "input_cost_per_token": 1.3e-07, + "litellm_provider": "baseten", + "max_input_tokens": 1048576, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", - "output_cost_per_token": 0.0, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.6e-07, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false + "supports_vision": false }, - "openrouter/nex-agi/nex-n2.5-pro:free": { - "input_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "baseten/deepseek-ai/DeepSeek-V4-Pro": { + "cache_read_input_token_cost": 1.45e-07, + "input_cost_per_token": 1.74e-06, + "litellm_provider": "baseten", + "max_input_tokens": 1048576, + "max_output_tokens": 262144, + "max_tokens": 262144, "mode": "chat", - "output_cost_per_token": 0.0, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 3.48e-06, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false + }, + "baseten/deepseek-ai/DeepSeek-V4-Pro-0813": { + "cache_read_input_token_cost": 1.32e-07, + "input_cost_per_token": 1.32e-06, + "litellm_provider": "baseten", + "max_input_tokens": 1048576, + "max_output_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 3.96e-06, + "source": "https://inference.baseten.co/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": false + }, + "baseten/zai-org/GLM-5.2-Fast": { + "cache_read_input_token_cost": 2.1e-07, + "input_cost_per_token": 2.1e-06, + "litellm_provider": "baseten", + "max_input_tokens": 1048576, + "max_output_tokens": 262144, + "max_tokens": 262144, + "mode": "chat", + "output_cost_per_token": 6.6e-06, + "source": "https://inference.baseten.co/v1/models", + "supports_function_calling": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false + "supports_vision": true }, - "openrouter/nousresearch/hermes-3-llama-3.1-405b": { + "xai/grok-code-fast": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1e-06, "input_cost_per_token": 1e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 1e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/nousresearch/hermes-3-llama-3.1-70b": { - "input_cost_per_token": 7e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, + "input_cost_per_token_above_200k_tokens": 2e-06, + "litellm_provider": "xai", + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, "mode": "chat", - "output_cost_per_token": 7e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, + "output_cost_per_token": 2e-06, + "output_cost_per_token_above_200k_tokens": 4e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_tool_choice": true, + "supports_vision": true }, - "openrouter/nousresearch/hermes-4-405b": { + "xai/grok-code-fast-1": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1e-06, "input_cost_per_token": 1e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 117964, - "max_tokens": 117964, + "input_cost_per_token_above_200k_tokens": 2e-06, + "litellm_provider": "xai", + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, + "output_cost_per_token": 2e-06, + "output_cost_per_token_above_200k_tokens": 4e-06, + "source": "https://api.x.ai/v1/language-models", + "supports_function_calling": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_tool_choice": true, + "supports_vision": true }, - "openrouter/openai/gpt-3.5-turbo-0613": { + "xai/grok-code-fast-1-0825": { + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_above_200k_tokens": 4e-07, + "input_cost_per_image_token": 1e-06, "input_cost_per_token": 1e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 4095, - "max_output_tokens": 3685, - "max_tokens": 3685, + "input_cost_per_token_above_200k_tokens": 2e-06, + "litellm_provider": "xai", + "max_input_tokens": 256000, + "max_output_tokens": 256000, + "max_tokens": 256000, "mode": "chat", "output_cost_per_token": 2e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token_above_200k_tokens": 4e-06, + "source": "https://api.x.ai/v1/language-models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/openai/gpt-3.5-turbo:batch": { - "input_cost_per_token": 2.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 16385, - "max_output_tokens": 4096, - "max_tokens": 4096, + "fireworks_ai/accounts/fireworks/models/deepseek-v4-pro": { + "cache_read_input_token_cost": 6e-07, + "cache_read_input_token_cost_priority": 6e-07, + "deprecation_date": "2026-08-27", + "input_cost_per_token": 1.2e-06, + "input_cost_per_token_priority": 1.2e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 7.5e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.2e-06, + "output_cost_per_token_priority": 1.2e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": true + "supports_vision": false }, - "openrouter/openai/gpt-4-turbo:batch": { - "input_cost_per_token": 5e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 4096, - "max_tokens": 4096, + "fireworks_ai/accounts/fireworks/models/minimax-m2p7": { + "cache_read_input_token_cost_priority": 6e-07, + "deprecation_date": "2026-08-27", + "input_cost_per_token_priority": 1.2e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 196608, + "max_output_tokens": 196608, + "max_tokens": 196608, "mode": "chat", - "output_cost_per_token": 1.5e-05, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token_priority": 1.2e-06, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true + "supports_tool_choice": true }, - "openrouter/openai/gpt-4.1-mini:batch": { - "cache_read_input_token_cost": 5e-08, - "input_cost_per_token": 2e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1047576, - "max_output_tokens": 32768, - "max_tokens": 32768, + "fireworks_ai/accounts/fireworks/models/ember-1": { + "cache_read_input_token_cost": 3e-07, + "cache_read_input_token_cost_priority": 3.75e-07, + "input_cost_per_token": 3e-06, + "input_cost_per_token_priority": 3.75e-06, + "litellm_provider": "fireworks_ai", + "max_input_tokens": 1048576, "mode": "chat", - "output_cost_per_token": 8e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.5e-05, + "output_cost_per_token_priority": 1.875e-05, + "source": "https://api.fireworks.ai/v1/serverless/models", "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true + "supports_vision": true }, - "openrouter/openai/gpt-4.1-nano:batch": { - "cache_read_input_token_cost": 1.25e-08, - "input_cost_per_token": 5e-08, + "openrouter/anthropic/claude-opus-5.5:batch": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_1hr": 4e-06, + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 1047576, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2e-07, + "output_cost_per_token": 1e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "openrouter/openai/gpt-4.1:batch": { - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 1e-06, + "openrouter/cohere/command-a-plus": { + "cache_read_input_token_cost": 1.5e-07, + "input_cost_per_token": 3e-07, "litellm_provider": "openrouter", - "max_input_tokens": 1047576, - "max_output_tokens": 32768, - "max_tokens": 32768, + "max_input_tokens": 192000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 4e-06, + "output_cost_per_token": 1.5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, + "supports_tool_choice": false, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false }, - "openrouter/openai/gpt-4o-mini:batch": { - "cache_read_input_token_cost": 3.75e-08, - "input_cost_per_token": 7.5e-08, + "openrouter/deepseek/deepseek-v4.1-flash:batch": { + "cache_read_input_token_cost": 3.36e-09, + "input_cost_per_token": 1.12e-07, "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "max_input_tokens": 1048576, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 3e-07, + "output_cost_per_token": 3.36e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false }, - "openrouter/openai/gpt-4o:batch": { - "cache_read_input_token_cost": 6.25e-07, - "input_cost_per_token": 1.25e-06, + "openrouter/openai/gpt-6-luna-pro:batch": { + "cache_creation_input_token_cost": 6.25e-08, + "cache_creation_input_token_cost_above_272k_tokens": 1.25e-07, + "cache_read_input_token_cost": 5e-09, + "cache_read_input_token_cost_above_272k_tokens": 1e-08, + "input_cost_per_token": 5e-08, + "input_cost_per_token_above_272k_tokens": 1e-07, "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 16384, - "max_tokens": 16384, + "max_input_tokens": 1050000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 5e-06, + "output_cost_per_token": 2.5e-07, + "output_cost_per_token_above_272k_tokens": 3.75e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, - "supports_reasoning": false, + "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "openrouter/openai/gpt-5-image": { - "cache_read_input_token_cost": 1.25e-06, - "input_cost_per_token": 1e-05, + "openrouter/openai/gpt-6-luna:batch": { + "cache_creation_input_token_cost": 6.25e-08, + "cache_creation_input_token_cost_above_272k_tokens": 1.25e-07, + "cache_read_input_token_cost": 5e-09, + "cache_read_input_token_cost_above_272k_tokens": 1e-08, + "input_cost_per_token": 5e-08, + "input_cost_per_token_above_272k_tokens": 1e-07, "litellm_provider": "openrouter", - "max_input_tokens": 400000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1e-05, + "output_cost_per_token": 2.5e-07, + "output_cost_per_token_above_272k_tokens": 3.75e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": false, + "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": false, + "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "openrouter/openai/gpt-5-image-mini": { - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 2.5e-06, + "openrouter/openai/gpt-6-sol-pro:batch": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_above_272k_tokens": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 400000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2e-06, + "output_cost_per_token": 5e-06, + "output_cost_per_token_above_272k_tokens": 7.5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, - "supports_function_calling": false, + "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": false, + "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "openrouter/openai/gpt-5-mini:batch": { - "cache_read_input_token_cost": 1.25e-08, - "input_cost_per_token": 1.25e-07, + "openrouter/openai/gpt-6-sol:batch": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_above_272k_tokens": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 400000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1e-06, + "output_cost_per_token": 5e-06, + "output_cost_per_token_above_272k_tokens": 7.5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -73876,15 +77814,20 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/openai/gpt-5-nano:batch": { - "cache_read_input_token_cost": 2.5e-09, - "input_cost_per_token": 2.5e-08, + "openrouter/openai/gpt-6.1-sol": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, "litellm_provider": "openrouter", - "max_input_tokens": 400000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2e-07, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -73896,34 +77839,45 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/openai/gpt-5-pro:batch": { - "input_cost_per_token": 7.5e-06, + "openrouter/openai/gpt-6.1-sol-pro": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, "litellm_provider": "openrouter", - "max_input_tokens": 400000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6e-05, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, "supports_pdf_input": true, - "supports_prompt_caching": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, "supports_web_search": true }, - "openrouter/openai/gpt-5:batch": { - "cache_read_input_token_cost": 6.25e-08, - "input_cost_per_token": 6.25e-07, + "openrouter/openai/gpt-6.1-sol-pro:batch": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-06, + "cache_read_input_token_cost": 5e-08, + "cache_read_input_token_cost_above_272k_tokens": 1e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_above_272k_tokens": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 400000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 5e-06, + "output_cost_per_token_above_272k_tokens": 7.5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -73935,15 +77889,20 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/openai/gpt-5.1:batch": { - "cache_read_input_token_cost": 6.25e-08, - "input_cost_per_token": 6.25e-07, + "openrouter/openai/gpt-6.1-sol:batch": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_creation_input_token_cost_above_272k_tokens": 2.5e-06, + "cache_read_input_token_cost": 5e-08, + "cache_read_input_token_cost_above_272k_tokens": 1e-07, + "input_cost_per_token": 1e-06, + "input_cost_per_token_above_272k_tokens": 2e-06, "litellm_provider": "openrouter", - "max_input_tokens": 400000, + "max_input_tokens": 1050000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", "output_cost_per_token": 5e-06, + "output_cost_per_token_above_272k_tokens": 7.5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -73955,1279 +77914,1429 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/openai/gpt-5.2-pro:batch": { - "input_cost_per_token": 1.05e-05, + "openrouter/openai/gpt-oss-20b:batch": { + "input_cost_per_token": 2.4e-08, "litellm_provider": "openrouter", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 131072, + "max_output_tokens": 117964, + "max_tokens": 117964, "mode": "chat", - "output_cost_per_token": 8.4e-05, + "output_cost_per_token": 1.12e-07, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": false, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true + "supports_vision": false, + "supports_web_search": false }, - "openrouter/openai/gpt-5.2:batch": { - "cache_read_input_token_cost": 8.75e-08, - "input_cost_per_token": 8.75e-07, + "openrouter/qwen/qwen3.8-omni-flash": { + "cache_read_input_token_cost": 1.6e-08, + "input_cost_per_token": 1.5e-07, "litellm_provider": "openrouter", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "max_input_tokens": 1000000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 7e-06, + "output_cost_per_token": 4.7e-07, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_audio_input": true, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_web_search": false + }, + "openrouter/perceptron/perceptron-mk1.5": { + "input_cost_per_token": 1.5e-07, + "litellm_provider": "openrouter", + "max_input_tokens": 36864, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 1.5e-06, + "source": "https://openrouter.ai/api/v1/models", + "supports_audio_input": true, + "supports_function_calling": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_video_input": true, + "supports_vision": true + }, + "vertex_ai/gemini-2.0-flash": { + "deprecation_date": "2026-06-01", + "input_cost_per_audio_token": 1e-06, + "input_cost_per_audio_token_batches": 5e-07, + "input_cost_per_character": 3.75e-08, + "input_cost_per_token": 1.5e-07, + "input_cost_per_token_batches": 7.5e-08, + "litellm_provider": "vertex_ai", + "mode": "chat", + "output_cost_per_token": 6e-07, + "output_cost_per_token_batches": 3e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "vertex_ai/gemini-2.0-flash-lite": { + "deprecation_date": "2026-06-01", + "input_cost_per_audio_token": 7.5e-08, + "input_cost_per_audio_token_batches": 3.75e-08, + "input_cost_per_character": 1.875e-08, + "input_cost_per_token": 7.5e-08, + "input_cost_per_token_batches": 3.75e-08, + "litellm_provider": "vertex_ai", + "mode": "chat", + "output_cost_per_token": 3e-07, + "output_cost_per_token_batches": 1.5e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" + }, + "vertex_ai/zai-org/glm-5.2-maas": { + "cache_read_input_token_cost": 1.4e-07, + "input_cost_per_token": 1.4e-06, + "litellm_provider": "vertex_ai-zai_models", + "max_input_tokens": 1000000, + "max_output_tokens": 64000, + "max_tokens": 64000, + "mode": "chat", + "output_cost_per_token": 4.4e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_regions": ["global"], + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true + }, + "vertex_ai/meta/llama-3.3-70b-instruct-maas": { + "deprecation_date": "2026-10-21", + "input_cost_per_token": 7.2e-07, + "input_cost_per_token_batches": 3.6e-07, + "litellm_provider": "vertex_ai-llama_models", + "max_input_tokens": 128000, + "max_output_tokens": 8192, + "max_tokens": 8192, + "mode": "chat", + "output_cost_per_token": 7.2e-07, + "output_cost_per_token_batches": 3.6e-07, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_modalities": [ + "text" + ], + "supported_output_modalities": [ + "text", + "code" + ], + "supports_function_calling": true, + "supports_tool_choice": true + }, + "vertex_ai/veo-3.0-generate-001": { + "deprecation_date": "2026-06-30", + "litellm_provider": "vertex_ai-video-models", + "max_input_tokens": 1024, + "max_tokens": 1024, + "mode": "video_generation", + "output_cost_per_second": 0.4, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing#veo", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "video" + ] + }, + "vertex_ai/veo-3.0-fast-generate-001": { + "deprecation_date": "2026-06-30", + "litellm_provider": "vertex_ai-video-models", + "max_input_tokens": 1024, + "max_tokens": 1024, + "mode": "video_generation", + "output_cost_per_second": 0.1, + "output_cost_per_second_1080p": 0.12, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing#veo", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "video" + ] + }, + "vertex_ai/veo-2.0-generate-001": { + "litellm_provider": "vertex_ai-video-models", + "max_input_tokens": 1024, + "max_tokens": 1024, + "mode": "video_generation", + "output_cost_per_second": 0.5, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing#veo", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "video" + ] + }, + "vertex_ai/virtual-try-on-001": { + "deprecation_date": "2027-03-15", + "litellm_provider": "vertex_ai", + "mode": "image_generation", + "output_cost_per_image": 0.06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_modalities": [ + "image" + ], + "supported_output_modalities": [ + "image" + ] }, - "openrouter/openai/gpt-5.4-image-2": { - "cache_read_input_token_cost": 2e-06, - "input_cost_per_token": 8e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 272000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 1.5e-05, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": true, - "supports_web_search": true + "vertex_ai/gemini-2.5-flash-tts": { + "input_cost_per_token": 5e-07, + "input_cost_per_token_batches": 2.5e-07, + "litellm_provider": "vertex_ai", + "mode": "audio_speech", + "output_cost_per_audio_token": 1e-05, + "output_cost_per_token": 1e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, - "openrouter/openai/gpt-5.4-mini:batch": { - "cache_read_input_token_cost": 3.75e-08, - "input_cost_per_token": 3.75e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 400000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 2.25e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true + "vertex_ai/gemini-2.5-pro-tts": { + "input_cost_per_token": 1e-06, + "input_cost_per_token_batches": 5e-07, + "litellm_provider": "vertex_ai", + "mode": "audio_speech", + "output_cost_per_audio_token": 2e-05, + "output_cost_per_token": 2e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, - "openrouter/openai/gpt-5.4-nano:batch": { - "cache_read_input_token_cost": 1e-08, - "input_cost_per_token": 1e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 400000, + "anthropic.claude-mythos-5-1": { + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6.25e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true - }, - "openrouter/openai/gpt-5.4-pro:batch": { - "input_cost_per_token": 1.5e-05, - "input_cost_per_token_above_272k_tokens": 3e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, - "mode": "chat", - "output_cost_per_token": 9e-05, - "output_cost_per_token_above_272k_tokens": 0.000135, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": false, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": true, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "cache_creation_input_token_cost_above_1hr": 2e-05, + "cache_creation_input_token_cost": 1.25e-05, + "cache_read_input_token_cost": 2.5e-07, + "output_cost_per_token": 5e-05, + "input_cost_per_token": 1e-05, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/gpt-5.4:batch": { - "cache_read_input_token_cost": 1.25e-07, - "cache_read_input_token_cost_above_272k_tokens": 2.5e-07, - "input_cost_per_token": 1.25e-06, - "input_cost_per_token_above_272k_tokens": 2.5e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "global.anthropic.claude-mythos-5-1": { + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 7.5e-06, - "output_cost_per_token_above_272k_tokens": 1.125e-05, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": true, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "cache_read_input_token_cost": 2.5e-07, + "cache_creation_input_token_cost": 1.25e-05, + "input_cost_per_token": 1e-05, + "output_cost_per_token": 5e-05, + "cache_creation_input_token_cost_above_1hr": 2e-05, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/gpt-5.5-pro:batch": { - "input_cost_per_token": 1.5e-05, - "input_cost_per_token_above_272k_tokens": 3e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "us.anthropic.claude-mythos-5-1": { + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 9e-05, - "output_cost_per_token_above_272k_tokens": 0.000135, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, - "supports_prompt_caching": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": true, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "input_cost_per_token": 1.1e-05, + "output_cost_per_token": 5.5e-05, + "cache_read_input_token_cost": 2.75e-07, + "cache_creation_input_token_cost": 1.375e-05, + "cache_creation_input_token_cost_above_1hr": 2.2e-05, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/gpt-5.5:batch": { - "cache_read_input_token_cost": 2.5e-07, - "cache_read_input_token_cost_above_272k_tokens": 5e-07, - "input_cost_per_token": 2.5e-06, - "input_cost_per_token_above_272k_tokens": 5e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "us.anthropic.claude-mythos-5": { + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.5e-05, - "output_cost_per_token_above_272k_tokens": 2.25e-05, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": true, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "cache_creation_input_token_cost": 1.375e-05, + "input_cost_per_token": 1.1e-05, + "cache_read_input_token_cost": 1.1e-06, + "output_cost_per_token": 5.5e-05, + "cache_creation_input_token_cost_above_1hr": 2.2e-05, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/gpt-5.6-luna-pro:batch": { - "cache_read_input_token_cost": 1e-08, - "cache_read_input_token_cost_above_272k_tokens": 2e-08, - "input_cost_per_token": 1e-07, - "input_cost_per_token_above_272k_tokens": 2e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "apac.anthropic.claude-fable-5": { + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6e-07, - "output_cost_per_token_above_272k_tokens": 9e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": true, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "output_cost_per_token": 5.5e-05, + "cache_creation_input_token_cost": 1.375e-05, + "cache_read_input_token_cost": 1.1e-06, + "input_cost_per_token": 1.1e-05, + "cache_creation_input_token_cost_above_1hr": 2.2e-05, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/gpt-5.6-luna:batch": { - "cache_read_input_token_cost": 1e-08, - "cache_read_input_token_cost_above_272k_tokens": 2e-08, - "input_cost_per_token": 1e-07, - "input_cost_per_token_above_272k_tokens": 2e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "au.anthropic.claude-fable-5": { + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6e-07, - "output_cost_per_token_above_272k_tokens": 9e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_adaptive_thinking": true, + "thinking_always_on": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": true, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "output_cost_per_token": 5.5e-05, + "cache_creation_input_token_cost": 1.375e-05, + "cache_read_input_token_cost": 1.1e-06, + "input_cost_per_token": 1.1e-05, + "cache_creation_input_token_cost_above_1hr": 2.2e-05, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/gpt-5.6-sol-pro:batch": { - "cache_creation_input_token_cost": 1.25e-06, - "cache_creation_input_token_cost_above_272k_tokens": 2.5e-06, - "cache_read_input_token_cost": 1e-07, - "cache_read_input_token_cost_above_272k_tokens": 2e-07, - "input_cost_per_token": 1e-06, - "input_cost_per_token_above_272k_tokens": 2e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "apac.anthropic.claude-opus-4-7": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 5e-06, - "output_cost_per_token_above_272k_tokens": 7.5e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 2048, + "output_cost_per_token": 2.75e-05, + "cache_creation_input_token_cost": 6.875e-06, + "input_cost_per_token": 5.5e-06, + "cache_creation_input_token_cost_above_1hr": 1.1e-05, + "cache_read_input_token_cost": 5.5e-07, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/gpt-5.6-sol:batch": { - "cache_creation_input_token_cost": 1.25e-06, - "cache_creation_input_token_cost_above_272k_tokens": 2.5e-06, - "cache_read_input_token_cost": 1e-07, - "cache_read_input_token_cost_above_272k_tokens": 2e-07, - "input_cost_per_token": 1e-06, - "input_cost_per_token_above_272k_tokens": 2e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "apac.anthropic.claude-opus-4-8": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 5e-06, - "output_cost_per_token_above_272k_tokens": 7.5e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 1024, + "input_cost_per_token": 5.5e-06, + "cache_creation_input_token_cost_above_1hr": 1.1e-05, + "output_cost_per_token": 2.75e-05, + "cache_read_input_token_cost": 5.5e-07, + "cache_creation_input_token_cost": 6.875e-06, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/gpt-5.6-terra-pro:batch": { - "cache_read_input_token_cost": 1e-07, - "cache_read_input_token_cost_above_272k_tokens": 2e-07, - "input_cost_per_token": 1e-06, - "input_cost_per_token_above_272k_tokens": 2e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "apac.anthropic.claude-opus-5": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6e-06, - "output_cost_per_token_above_272k_tokens": 9e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "cache_creation_input_token_cost_above_1hr": 1.1e-05, + "cache_creation_input_token_cost": 6.875e-06, + "input_cost_per_token": 5.5e-06, + "cache_read_input_token_cost": 5.5e-07, + "output_cost_per_token": 2.75e-05, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/gpt-5.6-terra:batch": { - "cache_read_input_token_cost": 1e-07, - "cache_read_input_token_cost_above_272k_tokens": 2e-07, - "input_cost_per_token": 1e-06, - "input_cost_per_token_above_272k_tokens": 2e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "apac.anthropic.claude-opus-5-5": { + "bedrock_converse_supports_strict_tools": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6e-06, - "output_cost_per_token_above_272k_tokens": 9e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 512, + "thinking_always_on": true, + "supports_forced_tool_use": false, + "cache_creation_input_token_cost_above_1hr": 8.8e-06, + "cache_creation_input_token_cost": 5.5e-06, + "input_cost_per_token": 4.4e-06, + "output_cost_per_token": 2.2e-05, + "cache_read_input_token_cost": 2.2e-07, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/gpt-6-astra-pro:batch": { - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_272k_tokens": 1.25e-05, - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_above_272k_tokens": 1e-06, - "input_cost_per_token": 5e-06, - "input_cost_per_token_above_272k_tokens": 1e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, - "max_output_tokens": 128000, - "max_tokens": 128000, + "apac.anthropic.claude-sonnet-4-6": { + "supports_adaptive_thinking": true, + "supports_legacy_thinking": true, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 2.5e-05, - "output_cost_per_token_above_272k_tokens": 3.75e-05, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_assistant_prefill": true, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_max_reasoning_effort": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_native_structured_output": true, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 1024, + "output_cost_per_token": 1.65e-05, + "cache_creation_input_token_cost_above_1hr": 6.6e-06, + "cache_read_input_token_cost": 3.3e-07, + "cache_creation_input_token_cost": 4.125e-06, + "input_cost_per_token": 3.3e-06, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/gpt-6-astra:batch": { - "cache_creation_input_token_cost": 6.25e-06, - "cache_creation_input_token_cost_above_272k_tokens": 1.25e-05, - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_above_272k_tokens": 1e-06, - "input_cost_per_token": 5e-06, - "input_cost_per_token_above_272k_tokens": 1e-05, - "litellm_provider": "openrouter", - "max_input_tokens": 1050000, + "apac.anthropic.claude-sonnet-5": { + "bedrock_converse_supports_strict_tools": false, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-05, - "output_cost_per_token_above_272k_tokens": 3.75e-05, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true - }, - "openrouter/openai/gpt-oss-120b:batch": { - "input_cost_per_token": 1.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 117964, - "max_tokens": 117964, - "mode": "chat", - "output_cost_per_token": 6e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/openai/o3-mini:batch": { - "cache_read_input_token_cost": 2.75e-07, - "input_cost_per_token": 5.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "prompt_cache_min_tokens": 1024, + "cache_creation_input_token_cost_above_1hr": 4.4e-06, + "cache_creation_input_token_cost": 2.75e-06, + "input_cost_per_token": 2.2e-06, + "output_cost_per_token": 1.1e-05, + "cache_read_input_token_cost": 2.2e-07, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" + }, + "us.anthropic.claude-mythos-preview": { + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.2e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "thinking_always_on": true, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_vision": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": true + "supports_output_config": true, + "cache_creation_input_token_cost_above_1hr": 5.5e-05, + "cache_read_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost": 3.4375e-05, + "output_cost_per_token": 0.0001375, + "input_cost_per_token": 2.75e-05, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/o3:batch": { - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 1e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, + "apac.anthropic.claude-mythos-preview": { + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 4e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "thinking_always_on": true, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_vision": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true + "supports_output_config": true, + "input_cost_per_token": 2.75e-05, + "cache_creation_input_token_cost": 3.4375e-05, + "output_cost_per_token": 0.0001375, + "cache_creation_input_token_cost_above_1hr": 5.5e-05, + "cache_read_input_token_cost": 2.75e-06, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/openai/o4-mini:batch": { - "cache_read_input_token_cost": 1.375e-07, - "input_cost_per_token": 5.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 100000, - "max_tokens": 100000, + "au.anthropic.claude-mythos-preview": { + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.2e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "thinking_always_on": true, "supports_function_calling": true, - "supports_pdf_input": true, + "supports_vision": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": true + "supports_output_config": true, + "input_cost_per_token": 2.75e-05, + "cache_creation_input_token_cost": 3.4375e-05, + "output_cost_per_token": 0.0001375, + "cache_creation_input_token_cost_above_1hr": 5.5e-05, + "cache_read_input_token_cost": 2.75e-06, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/perceptron/perceptron-mk1": { - "input_cost_per_token": 1.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 32768, + "deepseek.r1-v1:0": { + "input_cost_per_token": 1.35e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 128000, "max_output_tokens": 8192, "max_tokens": 8192, "mode": "chat", - "output_cost_per_token": 1.5e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 5.4e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": true, - "supports_web_search": false - }, - "openrouter/perplexity/sonar": { - "input_cost_per_token": 1e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 127072, - "max_output_tokens": 114364, - "max_tokens": 114364, - "mode": "chat", - "output_cost_per_token": 1e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": true, - "supports_web_search": true + "supports_tool_choice": false }, - "openrouter/perplexity/sonar-deep-research": { + "mistral.pixtral-large-2502-v1:0": { "input_cost_per_token": 2e-06, - "litellm_provider": "openrouter", + "litellm_provider": "bedrock_converse", "max_input_tokens": 128000, - "max_output_tokens": 115200, - "max_tokens": 115200, - "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": true - }, - "openrouter/perplexity/sonar-pro": { - "input_cost_per_token": 3e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 8000, - "max_tokens": 8000, + "max_output_tokens": 16384, + "max_tokens": 16384, "mode": "chat", - "output_cost_per_token": 1.5e-05, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": true, - "supports_web_search": true + "output_cost_per_token": 6e-06, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_function_calling": true, + "supports_tool_choice": false }, - "openrouter/perplexity/sonar-pro-search": { - "input_cost_per_token": 3e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 200000, - "max_output_tokens": 8000, - "max_tokens": 8000, + "azure_ai/MAI-Cyber-1-Flash": { + "cache_read_input_token_cost": 6e-08, + "input_cost_per_token": 6e-07, + "litellm_provider": "azure_ai", + "max_input_tokens": 256000, + "max_output_tokens": 64000, + "max_tokens": 64000, "mode": "chat", - "output_cost_per_token": 1.5e-05, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, + "output_cost_per_token": 3.5e-06, + "source": "https://azure.microsoft.com/en-us/pricing/details/ai-foundry-models/microsoft/", + "supports_function_calling": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": true, - "supports_web_search": true + "supports_tool_choice": true }, - "openrouter/perplexity/sonar-reasoning-pro": { - "input_cost_per_token": 2e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 128000, - "max_output_tokens": 115200, - "max_tokens": 115200, - "mode": "chat", - "output_cost_per_token": 8e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": true, - "supports_web_search": true + "azure_ai/mistral-ocr-2505": { + "litellm_provider": "azure_ai", + "mode": "ocr", + "ocr_cost_per_page": 0.001, + "source": "https://azure.microsoft.com/en-us/pricing/details/ai-foundry-models/mistral-ai/" }, - "openrouter/qwen/qwen3.5-9b:batch": { - "input_cost_per_token": 1.7e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "azure_ai/mistral-ocr-2512": { + "litellm_provider": "azure_ai", + "mode": "ocr", + "ocr_cost_per_page": 0.002, + "source": "https://azure.microsoft.com/en-us/pricing/details/ai-foundry-models/mistral-ai/" + }, + "anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_1hr": 4e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/qwen/qwen3.8-2.4t-a95b:batch": { - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 2e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1010000, - "max_output_tokens": 909000, - "max_tokens": 909000, + "apac.anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "cache_creation_input_token_cost_above_1hr": 4.4e-06, + "cache_creation_input_token_cost": 2.75e-06, + "input_cost_per_token": 2.2e-06, + "output_cost_per_token": 1.1e-05, + "cache_read_input_token_cost": 2.2e-07, + "source": "https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrockFoundationModels/current/index.json" }, - "openrouter/qwen/qwen3.8-27b:free": { - "input_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, + "au.anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_1hr": 4.4e-06, + "cache_read_input_token_cost": 2.2e-07, + "input_cost_per_token": 2.2e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 0.0, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.1e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "openrouter/rekaai/reka-edge": { - "input_cost_per_token": 1e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 16384, - "max_output_tokens": 14745, - "max_tokens": 14745, + "azure_ai/claude-sonnet-5-5": { + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_1hr": 4e-06, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "azure_ai", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_xhigh_reasoning_effort": true, + "supports_max_reasoning_effort": true, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512 }, - "openrouter/rekaai/reka-flash-3": { - "input_cost_per_token": 1e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 65536, - "max_output_tokens": 58982, - "max_tokens": 58982, + "bedrock/us-gov-east-1/anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "bedrock_output_config_effort_ceiling": "xhigh", + "cache_creation_input_token_cost": 3e-06, + "cache_creation_input_token_cost_above_1hr": 4.8e-06, + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 2.4e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, + "output_cost_per_token": 1.2e-05, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true }, - "openrouter/relace/relace-apply-3": { - "input_cost_per_token": 8.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 256000, + "bedrock/us-gov-west-1/anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "bedrock_output_config_effort_ceiling": "xhigh", + "cache_creation_input_token_cost": 3e-06, + "cache_creation_input_token_cost_above_1hr": 4.8e-06, + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 2.4e-06, + "litellm_provider": "bedrock", + "supports_tool_search": true, + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.25e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "output_cost_per_token": 1.2e-05, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_sampling_params": false, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true }, - "openrouter/relace/relace-search": { - "input_cost_per_token": 1e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 256000, + "eu.anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_1hr": 4.4e-06, + "cache_read_input_token_cost": 2.2e-07, + "input_cost_per_token": 2.2e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.1e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, + "supports_pdf_input": true, + "supports_prompt_caching": true, + "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "openrouter/sakana/fugu-max": { - "cache_read_input_token_cost": 2.5e-07, + "global.anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_1hr": 4e-06, + "cache_read_input_token_cost": 2e-07, "input_cost_per_token": 2e-06, - "litellm_provider": "openrouter", + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 6e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "openrouter/sakana/fugu-ultra": { - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_above_272k_tokens": 1e-06, - "input_cost_per_token": 5e-06, - "input_cost_per_token_above_272k_tokens": 1e-05, - "litellm_provider": "openrouter", + "jp.anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_1hr": 4.4e-06, + "cache_read_input_token_cost": 2.2e-07, + "input_cost_per_token": 2.2e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3e-05, - "output_cost_per_token_above_272k_tokens": 4.5e-05, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.1e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "openrouter/sakana/fugu-ultra-v2": { - "cache_read_input_token_cost": 5e-07, - "cache_read_input_token_cost_above_272k_tokens": 1e-06, - "input_cost_per_token": 5e-06, - "input_cost_per_token_above_272k_tokens": 1e-05, + "openrouter/anthropic/claude-sonnet-5.5": { + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1e-05, "litellm_provider": "openrouter", "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 3e-05, - "output_cost_per_token_above_272k_tokens": 4.5e-05, + "supports_sampling_params": false, + "supports_adaptive_thinking": true, "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, "supports_function_calling": true, - "supports_pdf_input": true, - "supports_prompt_caching": true, + "supports_tool_choice": true, "supports_reasoning": true, "supports_response_schema": true, - "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": true - }, - "openrouter/sakana/sakana-namazu": { - "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_token": 9.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "chat", - "output_cost_per_token": 4e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, "supports_pdf_input": true, + "supports_audio_input": false, + "cache_read_input_token_cost": 2e-07, "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_1hr": 4e-06, "supports_web_search": true }, - "openrouter/sao10k/l3-lunaris-8b": { - "input_cost_per_token": 4e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 8192, - "max_output_tokens": 7372, - "max_tokens": 7372, - "mode": "chat", - "output_cost_per_token": 5e-08, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/sao10k/l3.1-euryale-70b": { - "input_cost_per_token": 8.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 8.5e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "perplexity/anthropic/claude-sonnet-5-5": { + "litellm_provider": "perplexity", + "mode": "responses", + "supports_adaptive_thinking": true, + "supports_web_search": true, "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1e-05, + "cache_read_input_token_cost": 2e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "openrouter/sao10k/l3.3-euryale-70b": { - "input_cost_per_token": 6.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 16384, - "max_tokens": 16384, - "mode": "chat", - "output_cost_per_token": 7.5e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "perplexity/anthropic/claude-fable-5-1": { + "litellm_provider": "perplexity", + "mode": "responses", + "input_cost_per_token": 1e-05, + "output_cost_per_token": 5e-05, + "cache_read_input_token_cost": 2.5e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "openrouter/stepfun/step-3.5-flash": { - "input_cost_per_token": 1e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 65536, - "max_tokens": 65536, - "mode": "chat", - "output_cost_per_token": 3e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "perplexity/anthropic/claude-opus-5-5": { + "litellm_provider": "perplexity", + "mode": "responses", + "input_cost_per_token": 4e-06, + "output_cost_per_token": 2e-05, + "cache_read_input_token_cost": 2e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "openrouter/stepfun/step-3.7-flash": { - "cache_read_input_token_cost": 4e-08, - "input_cost_per_token": 2e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 230400, - "max_tokens": 230400, - "mode": "chat", - "output_cost_per_token": 1.15e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false + "perplexity/openai/gpt-6.1-sol": { + "litellm_provider": "perplexity", + "mode": "responses", + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1e-05, + "cache_read_input_token_cost": 1e-07, + "input_cost_per_token_above_272k_tokens": 4e-06, + "output_cost_per_token_above_272k_tokens": 1.5e-05, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "openrouter/tencent/hunyuan-a13b-instruct": { - "input_cost_per_token": 1.4e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 117964, - "max_tokens": 117964, - "mode": "chat", - "output_cost_per_token": 5.7e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": true, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "perplexity/openai/gpt-6-sol": { + "litellm_provider": "perplexity", + "mode": "responses", + "input_cost_per_token": 2e-06, + "output_cost_per_token": 1e-05, + "cache_read_input_token_cost": 2e-07, + "input_cost_per_token_above_272k_tokens": 4e-06, + "output_cost_per_token_above_272k_tokens": 1.5e-05, + "cache_read_input_token_cost_above_272k_tokens": 4e-07, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "openrouter/tencent/hy-mt2-1.8b": { - "input_cost_per_token": 4.4e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 8192, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 1.77e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "perplexity/openai/gpt-6-luna": { + "litellm_provider": "perplexity", + "mode": "responses", + "input_cost_per_token": 1e-07, + "output_cost_per_token": 5e-07, + "cache_read_input_token_cost": 1e-08, + "input_cost_per_token_above_272k_tokens": 2e-07, + "output_cost_per_token_above_272k_tokens": 7.5e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-08, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "openrouter/tencent/hy-mt2-30b-a3b": { - "input_cost_per_token": 7.4e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 8192, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 2.95e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "perplexity/google/gemini-3.8-flash": { + "litellm_provider": "perplexity", + "mode": "responses", + "input_cost_per_token": 7.5e-07, + "output_cost_per_token": 3.75e-06, + "cache_read_input_token_cost": 7.5e-08, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "openrouter/tencent/hy-mt2-7b": { - "input_cost_per_token": 7.4e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 8192, - "max_output_tokens": 4096, - "max_tokens": 4096, - "mode": "chat", - "output_cost_per_token": 2.95e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "perplexity/xai/grok-4.7": { + "litellm_provider": "perplexity", + "mode": "responses", + "input_cost_per_token": 2e-06, + "output_cost_per_token": 6e-06, + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token_above_200k_tokens": 4e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "cache_read_input_token_cost_above_200k_tokens": 1e-06, + "source": "https://docs.perplexity.ai/docs/agent-api/models" }, - "openrouter/tencent/hy3": { - "cache_read_input_token_cost": 3.3e-08, - "input_cost_per_token": 1.32e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, + "us-gov.anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "bedrock_output_config_effort_ceiling": "xhigh", + "cache_creation_input_token_cost": 3e-06, + "cache_creation_input_token_cost_above_1hr": 4.8e-06, + "cache_read_input_token_cost": 2.4e-07, + "input_cost_per_token": 2.4e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, "max_output_tokens": 128000, "max_tokens": 128000, "mode": "chat", - "off_peak_pricing": {"hours_utc":"16:00-00:00","input_cost_per_token":8.25e-8,"output_cost_per_token":3.3e-7,"cache_read_input_token_cost":2.0625e-8}, - "output_cost_per_token": 5.28e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.2e-05, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/", + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_max_reasoning_effort": true, + "supports_mid_conversation_system": true, + "supports_native_structured_output": false, + "supports_output_config": true, + "supports_parallel_tool_use_config": true, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/tencent/hy3-preview": { - "cache_read_input_token_cost": 6e-08, - "input_cost_per_token": 1.8e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 235929, - "max_tokens": 235929, - "mode": "chat", - "output_cost_per_token": 6e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": true, - "supports_reasoning": true, - "supports_response_schema": false, - "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_xhigh_reasoning_effort": true }, - "openrouter/tencent/hy4-preview": { - "cache_read_input_token_cost": 4.2e-08, - "input_cost_per_token": 8.34e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 64000, - "max_tokens": 64000, + "us.anthropic.claude-sonnet-5-5": { + "bedrock_converse_supports_strict_tools": false, + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_1hr": 4.4e-06, + "cache_read_input_token_cost": 2.2e-07, + "input_cost_per_token": 2.2e-06, + "litellm_provider": "bedrock_converse", + "supports_tool_search": true, + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.501e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.1e-05, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "supports_mid_conversation_system": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/thedrummer/cydonia-24b-v4.1": { - "cache_read_input_token_cost": 1.5e-07, - "input_cost_per_token": 3e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 117964, - "max_tokens": 117964, - "mode": "chat", - "output_cost_per_token": 5e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/thedrummer/skyfall-36b-v2": { - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 5.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 32768, - "max_output_tokens": 29491, - "max_tokens": 29491, - "mode": "chat", - "output_cost_per_token": 8e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/thedrummer/unslopnemo-12b": { - "input_cost_per_token": 4e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1024000, - "max_output_tokens": 819200, - "max_tokens": 819200, - "mode": "chat", - "output_cost_per_token": 4e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": true, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_xhigh_reasoning_effort": true, + "supports_native_structured_output": false, + "supports_max_reasoning_effort": true, + "supports_output_config": true, + "bedrock_output_config_effort_ceiling": "xhigh", + "supports_parallel_tool_use_config": true, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "source": "https://aws.amazon.com/bedrock/pricing/" }, - "openrouter/thinkingmachines/inkling": { - "cache_read_input_token_cost": 1.7e-07, - "input_cost_per_token": 1e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 471859, - "max_tokens": 471859, + "vertex_ai/claude-sonnet-5-5": { + "regional_endpoint_uplift_multiplier": 1.1, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_1hr": 4e-06, + "cache_creation_input_token_cost_batches": 1.25e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "vertex_ai-anthropic_models", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 4.05e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "output_cost_per_token": 1e-05, + "output_cost_per_token_batches": 5e-06, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_xhigh_reasoning_effort": true, + "supports_max_reasoning_effort": true, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, - "openrouter/thinkingmachines/inkling-small": { - "cache_read_input_token_cost": 1e-07, - "input_cost_per_token": 4.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 262144, - "max_tokens": 262144, + "vertex_ai/claude-sonnet-5-5@default": { + "regional_endpoint_uplift_multiplier": 1.1, + "supports_mid_conversation_system": true, + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_1hr": 4e-06, + "cache_creation_input_token_cost_batches": 1.25e-06, + "cache_read_input_token_cost": 2e-07, + "cache_read_input_token_cost_batches": 1e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_batches": 1e-06, + "litellm_provider": "vertex_ai-anthropic_models", + "max_input_tokens": 1000000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 1.2e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "output_cost_per_token": 1e-05, + "output_cost_per_token_batches": 5e-06, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "supports_adaptive_thinking": true, + "supports_assistant_prefill": false, + "supports_computer_use": true, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_pdf_input": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, + "supports_sampling_params": false, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_xhigh_reasoning_effort": true, + "supports_max_reasoning_effort": true, + "supports_forced_tool_use": false, + "thinking_always_on": true, + "prompt_cache_min_tokens": 512, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing" }, - "openrouter/thinkingmachines/inkling-small:free": { - "input_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 262144, - "max_tokens": 262144, + "prism/deepseek-v4.1-flash": { + "cache_read_input_token_cost": 7e-08, + "input_cost_per_token": 1.7e-07, + "litellm_provider": "prism", + "max_input_tokens": 1000000, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", - "output_cost_per_token": 0.0, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "output_cost_per_token": 6.3e-07, + "source": "https://prisminference.com/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses", + "/v1/messages" + ], "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, + "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": true, - "supports_web_search": false + "supports_response_schema": true, + "supports_system_messages": true, + "supports_tool_choice": true, + "supports_vision": true }, - "openrouter/thinkingmachines/inkling:batch": { - "cache_read_input_token_cost": 1.7e-07, - "input_cost_per_token": 1e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 524288, - "max_output_tokens": 471859, - "max_tokens": 471859, + "prism/deepseek-v4-flash": { + "cache_read_input_token_cost": 7e-08, + "input_cost_per_token": 1.7e-07, + "litellm_provider": "prism", + "max_input_tokens": 1000000, + "max_output_tokens": 384000, + "max_tokens": 384000, "mode": "chat", - "output_cost_per_token": 4.05e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "output_cost_per_token": 2.1e-07, + "source": "https://prisminference.com/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses", + "/v1/messages" + ], "supports_function_calling": true, - "supports_pdf_input": false, + "supports_native_streaming": true, + "supports_parallel_function_calling": true, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": false, + "supports_response_schema": true, + "supports_system_messages": true, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false + "supports_vision": false }, - "openrouter/thinkingmachines/inkling:free": { - "input_cost_per_token": 0.0, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 262144, - "max_tokens": 262144, + "global.xai.grok-4.7": { + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 0.0, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": true, + "output_cost_per_token": 6e-06, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, - "supports_pdf_input": false, "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": true, - "supports_web_search": false - }, - "openrouter/unbiased/pareto": { - "cache_read_input_token_cost": 2.5e-07, - "input_cost_per_token": 2.5e-06, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 131072, - "max_tokens": 131072, - "mode": "chat", - "output_cost_per_token": 7.5e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": true, - "supports_reasoning": false, - "supports_response_schema": false, "supports_tool_choice": true, - "supports_vision": true, - "supports_web_search": false + "supports_vision": true }, - "openrouter/upstage/solar-pro-3": { - "cache_read_input_token_cost": 1.5e-08, - "input_cost_per_token": 1.5e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 131072, - "max_output_tokens": 117964, - "max_tokens": 117964, + "us.xai.grok-4.7": { + "cache_read_input_token_cost": 5.5e-07, + "input_cost_per_token": 2.2e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 6e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 6.6e-06, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": true, + "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/upstage/solar-pro4": { - "cache_read_input_token_cost": 1.8e-08, - "input_cost_per_token": 9e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 524288, - "max_output_tokens": 131072, - "max_tokens": 131072, + "xai.grok-4.7": { + "cache_read_input_token_cost": 5e-07, + "input_cost_per_token": 2e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 500000, + "max_output_tokens": 500000, + "max_tokens": 500000, "mode": "chat", - "output_cost_per_token": 3.6e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 6e-06, + "source": "https://b0.p.awsstatic.com/pricing/2.0/meteredUnitMaps/bedrock/USD/current/bedrock.json", "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": true, + "supports_prompt_caching": false, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false - }, - "openrouter/writer/palmyra-x5": { - "input_cost_per_token": 6e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1040000, - "max_output_tokens": 8192, - "max_tokens": 8192, - "mode": "chat", - "output_cost_per_token": 6e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, - "supports_function_calling": false, - "supports_pdf_input": false, - "supports_prompt_caching": false, - "supports_reasoning": false, - "supports_response_schema": false, - "supports_tool_choice": false, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/x-ai/grok-4.3:batch": { - "cache_read_input_token_cost": 1.6e-07, - "cache_read_input_token_cost_above_200k_tokens": 3.2e-07, + "openrouter/anthropic/claude-sonnet-5.5:batch": { + "cache_creation_input_token_cost": 1.25e-06, + "cache_creation_input_token_cost_above_1hr": 2e-06, + "cache_read_input_token_cost": 1e-07, "input_cost_per_token": 1e-06, - "input_cost_per_token_above_200k_tokens": 2e-06, "litellm_provider": "openrouter", "max_input_tokens": 1000000, - "max_output_tokens": 900000, - "max_tokens": 900000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2e-06, - "output_cost_per_token_above_200k_tokens": 4e-06, + "output_cost_per_token": 5e-06, "source": "https://openrouter.ai/api/v1/models", "supports_audio_input": false, "supports_function_calling": true, @@ -75239,103 +79348,285 @@ "supports_vision": true, "supports_web_search": true }, - "openrouter/z-ai/glm-5.2:batch": { - "cache_read_input_token_cost": 7e-08, - "input_cost_per_token": 7e-07, - "litellm_provider": "openrouter", + "baseten/deepseek-ai/DeepSeek-V4.1-Flash-Fast": { + "cache_read_input_token_cost": 1.4e-07, + "input_cost_per_token": 6e-07, + "litellm_provider": "baseten", "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "max_output_tokens": 32768, + "max_tokens": 32768, "mode": "chat", - "output_cost_per_token": 2.2e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 2.4e-06, + "source": "https://inference.baseten.co/v1/models", "supports_function_calling": true, - "supports_pdf_input": false, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true }, - "openrouter/z-ai/glm-5.3-flash:batch": { - "cache_read_input_token_cost": 1.5e-08, - "input_cost_per_token": 7.5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "gpt-6.1-sol": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_creation_input_token_cost_above_272k_tokens_batches": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens_flex": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens_priority": 1e-05, + "cache_creation_input_token_cost_batches": 1.25e-06, + "cache_creation_input_token_cost_flex": 1.25e-06, + "cache_creation_input_token_cost_priority": 5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "cache_read_input_token_cost_above_272k_tokens_batches": 1e-07, + "cache_read_input_token_cost_above_272k_tokens_flex": 1e-07, + "cache_read_input_token_cost_above_272k_tokens_priority": 4e-07, + "cache_read_input_token_cost_batches": 5e-08, + "cache_read_input_token_cost_flex": 5e-08, + "cache_read_input_token_cost_priority": 2e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, + "input_cost_per_token_above_272k_tokens_batches": 2e-06, + "input_cost_per_token_above_272k_tokens_flex": 2e-06, + "input_cost_per_token_above_272k_tokens_priority": 8e-06, + "input_cost_per_token_batches": 1e-06, + "input_cost_per_token_flex": 1e-06, + "input_cost_per_token_priority": 4e-06, + "litellm_provider": "openai", + "max_input_tokens": 922000, + "max_output_tokens": 128000, + "max_tokens": 128000, "mode": "chat", - "output_cost_per_token": 2.5e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, + "output_cost_per_token_above_272k_tokens_batches": 7.5e-06, + "output_cost_per_token_above_272k_tokens_flex": 7.5e-06, + "output_cost_per_token_above_272k_tokens_priority": 3e-05, + "output_cost_per_token_batches": 5e-06, + "output_cost_per_token_flex": 5e-06, + "output_cost_per_token_priority": 2e-05, + "regional_processing_uplift_multiplier_eu": 1.1, + "regional_processing_uplift_multiplier_us": 1.1, + "search_context_cost_per_query": { + "search_context_size_high": 0.01, + "search_context_size_low": 0.01, + "search_context_size_medium": 0.01 + }, + "source": "https://developers.openai.com/api/docs/pricing", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/batch", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_computer_use": true, "supports_function_calling": true, - "supports_pdf_input": false, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_native_streaming": true, + "supports_none_reasoning_effort": false, + "supports_parallel_function_calling": true, + "supports_pdf_input": true, + "supports_prompt_cache_breakpoint": true, "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, + "supports_system_messages": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_web_search": true, + "supports_xhigh_reasoning_effort": true }, - "openrouter/z-ai/glm-5.3:batch": { - "cache_read_input_token_cost": 1.3e-07, - "input_cost_per_token": 7e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, - "max_output_tokens": 943718, - "max_tokens": 943718, + "global.openai.gpt-6.1-sol": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1050000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 2.2e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-6-1-sol.html", + "supported_endpoints": [ + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], "supports_function_calling": true, - "supports_pdf_input": false, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, - "supports_vision": false, - "supports_web_search": false + "supports_vision": true, + "supports_xhigh_reasoning_effort": true }, - "openrouter/prism-ml/ternary-bonsai-2-27b": { - "input_cost_per_token": 7.5e-08, - "litellm_provider": "openrouter", - "max_input_tokens": 262144, - "max_output_tokens": 32768, - "max_tokens": 32768, + "openai.gpt-6.1-sol": { + "cache_creation_input_token_cost": 2.5e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5e-06, + "cache_read_input_token_cost": 1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2e-07, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_272k_tokens": 4e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1050000, + "max_output_tokens": 131072, + "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 5e-07, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1e-05, + "output_cost_per_token_above_272k_tokens": 1.5e-05, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-6-1-sol.html", + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], "supports_function_calling": true, - "supports_pdf_input": false, - "supports_prompt_caching": false, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_tool_choice": true, + "supports_vision": true, + "supports_xhigh_reasoning_effort": true + }, + "bedrock_mantle/openai.gpt-6.1-sol": { + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5.5e-06, + "cache_read_input_token_cost": 1.1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2.2e-07, + "input_cost_per_token": 2.2e-06, + "input_cost_per_token_above_272k_tokens": 4.4e-06, + "litellm_provider": "bedrock_mantle", + "max_input_tokens": 1050000, + "max_output_tokens": 131072, + "max_tokens": 131072, + "mode": "responses", + "output_cost_per_token": 1.1e-05, + "output_cost_per_token_above_272k_tokens": 1.65e-05, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-6-1-sol.html", + "supported_endpoints": [ + "/v1/chat/completions", + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], + "supports_function_calling": true, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, + "supports_prompt_caching": true, "supports_reasoning": true, "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_xhigh_reasoning_effort": true, + "use_openai_responses_path": true }, - "openrouter/z-ai/glm-5.3-flashx": { - "cache_read_input_token_cost": 7.5e-08, - "input_cost_per_token": 3.7e-07, - "litellm_provider": "openrouter", - "max_input_tokens": 1048576, + "us.openai.gpt-6.1-sol": { + "cache_creation_input_token_cost": 2.75e-06, + "cache_creation_input_token_cost_above_272k_tokens": 5.5e-06, + "cache_read_input_token_cost": 1.1e-07, + "cache_read_input_token_cost_above_272k_tokens": 2.2e-07, + "input_cost_per_token": 2.2e-06, + "input_cost_per_token_above_272k_tokens": 4.4e-06, + "litellm_provider": "bedrock_converse", + "max_input_tokens": 1050000, "max_output_tokens": 131072, "max_tokens": 131072, "mode": "chat", - "output_cost_per_token": 1.25e-06, - "source": "https://openrouter.ai/api/v1/models", - "supports_audio_input": false, + "output_cost_per_token": 1.1e-05, + "output_cost_per_token_above_272k_tokens": 1.65e-05, + "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-6-1-sol.html", + "supported_endpoints": [ + "/v1/responses" + ], + "supported_modalities": [ + "text", + "image" + ], + "supported_output_modalities": [ + "text" + ], "supports_function_calling": true, - "supports_pdf_input": false, + "supports_max_reasoning_effort": true, + "supports_minimal_reasoning_effort": false, + "supports_none_reasoning_effort": false, "supports_prompt_caching": true, "supports_reasoning": true, - "supports_response_schema": true, "supports_tool_choice": true, "supports_vision": true, - "supports_web_search": false + "supports_xhigh_reasoning_effort": true + }, + "vertex_ai/gemini-3.8-flash-tts": { + "input_cost_per_token": 5e-07, + "litellm_provider": "vertex_ai", + "max_input_tokens": 8192, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "audio_speech", + "output_cost_per_audio_token": 9e-06, + "output_cost_per_token": 9e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1/audio/speech" + ] + }, + "vertex_ai/gemini-3.8-flash-lite-tts": { + "input_cost_per_token": 5e-07, + "litellm_provider": "vertex_ai", + "max_input_tokens": 8192, + "max_output_tokens": 16384, + "max_tokens": 16384, + "mode": "audio_speech", + "output_cost_per_audio_token": 6e-06, + "output_cost_per_token": 6e-06, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supported_endpoints": [ + "/v1/audio/speech" + ] + }, + "vertex_ai/xai/grok-4.7": { + "cache_read_input_token_cost": 5e-07, + "cache_read_input_token_cost_above_200k_tokens": 1e-06, + "input_cost_per_token": 2e-06, + "input_cost_per_token_above_200k_tokens": 4e-06, + "litellm_provider": "vertex_ai", + "max_input_tokens": 524288, + "max_output_tokens": 524288, + "max_tokens": 524288, + "mode": "chat", + "output_cost_per_token": 6e-06, + "output_cost_per_token_above_200k_tokens": 1.2e-05, + "source": "https://cloud.google.com/gemini-enterprise-agent-platform/generative-ai/pricing", + "supports_function_calling": true, + "supports_prompt_caching": true, + "supports_reasoning": true, + "supports_response_schema": true, + "supports_tool_choice": true, + "supports_vision": true } } diff --git a/packages/core/package.json b/packages/core/package.json index aa806b8c..b1786db1 100644 --- a/packages/core/package.json +++ b/packages/core/package.json @@ -32,5 +32,5 @@ "@types/ws": "^8.18.1", "jszip": "^3.10.1" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/desktop/package.json b/packages/desktop/package.json index 7a906ca8..dbefbfa9 100644 --- a/packages/desktop/package.json +++ b/packages/desktop/package.json @@ -37,5 +37,5 @@ "esbuild": "^0.27.4", "typescript": "^5.9.3" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/gui/package.json b/packages/gui/package.json index 27e7c218..d4d868a9 100644 --- a/packages/gui/package.json +++ b/packages/gui/package.json @@ -18,5 +18,5 @@ "devDependencies": { "@types/sharp": "^0.32.0" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/org-manager/package.json b/packages/org-manager/package.json index 6b3a477d..83f9d156 100644 --- a/packages/org-manager/package.json +++ b/packages/org-manager/package.json @@ -22,5 +22,5 @@ "devDependencies": { "@types/ws": "^8.18.1" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/remote/package.json b/packages/remote/package.json index 4051265d..7438d9ee 100644 --- a/packages/remote/package.json +++ b/packages/remote/package.json @@ -18,5 +18,5 @@ "devDependencies": { "@types/ws": "^8.18.1" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/shared/package.json b/packages/shared/package.json index 1cbb6503..bb2937ce 100644 --- a/packages/shared/package.json +++ b/packages/shared/package.json @@ -10,5 +10,5 @@ "dev": "tsc -b --watch", "clean": "rm -rf dist *.tsbuildinfo" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/storage/package.json b/packages/storage/package.json index 7dada825..33715867 100644 --- a/packages/storage/package.json +++ b/packages/storage/package.json @@ -13,5 +13,5 @@ "dependencies": { "@markus/shared": "workspace:*" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" } diff --git a/packages/web-ui/package.json b/packages/web-ui/package.json index 7b3b849c..b1bb949a 100644 --- a/packages/web-ui/package.json +++ b/packages/web-ui/package.json @@ -65,5 +65,5 @@ "typescript": "^5.9.3", "vite": "^7.3.1" }, - "version": "0.10.1" + "version": "0.11.0-rc.0" }