Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
849d2c2
add tag support
jbaross May 8, 2026
db00cd6
initial skeleton
jbaross May 8, 2026
8658f15
add how-tos
jbaross May 8, 2026
d221c64
add main provider page
jbaross May 8, 2026
f18f21c
add vercel as reseller note
jbaross May 8, 2026
bff9804
correct version numbers of deps
jbaross May 8, 2026
2c6e45c
liquid fix for vale
jbaross May 11, 2026
efc7a1e
add vercel icon svg
jbaross May 12, 2026
473e2fc
Merge branch 'main' into feat/vercel-ai-provider
jbaross May 12, 2026
4764f23
Merge branch 'main' into feat/vercel-ai-provider
jbaross May 15, 2026
116ced5
add yaml files for provider
jbaross May 15, 2026
e03383e
use correct svg for vercel in ai-providers yaml
jbaross May 18, 2026
933344c
copilot fixes
jbaross May 18, 2026
657efb0
Merge branch 'release/ai-gateway-2.0' into feat/vercel-ai-provider
jbaross May 18, 2026
a23dedd
vale fix
jbaross May 18, 2026
565f491
Merge branch 'feat/vercel-ai-provider' into feat/providers-clean-up
jbaross May 29, 2026
bc308c9
remove new provider how-tos
jbaross May 29, 2026
62e498f
links to entities
jbaross May 29, 2026
6958441
add links to new entities
jbaross Jun 1, 2026
4de6c5c
Merge branch 'release/ai-gateway-2.0' into feat/providers-clean-up
jbaross Jun 1, 2026
3f39fa1
fix links
jbaross Jun 1, 2026
79b608e
move kmi icon to right location
jbaross Jun 1, 2026
9ee9950
add generic ai proxy example
jbaross Jun 1, 2026
55a2236
one topic for basic and advanced
jbaross Jun 1, 2026
d9166f0
fix links
jbaross Jun 1, 2026
9c08b5d
add new standard links
jbaross Jun 1, 2026
781caea
remove old provider how tos
jbaross Jun 1, 2026
f6002de
test new entity examples
jbaross Jun 2, 2026
81c33f1
test new entity examples
jbaross Jun 2, 2026
ee2f192
Merge branch 'release/ai-gateway-2.0' into feat/providers-clean-up
jbaross Jun 8, 2026
9a2da20
Merge branch 'release/ai-gateway-2.0' into feat/providers-clean-up
jbaross Jun 18, 2026
a858ed3
frontmatter cleanup
jbaross Jun 18, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .github/styles/base/Dictionary.txt
Original file line number Diff line number Diff line change
Expand Up @@ -890,6 +890,8 @@ validators
Valkey
vararg
vc
vercel
Vercel
viewport
viewports
vllm
Expand Down
22 changes: 22 additions & 0 deletions app/_data/plugins/ai-proxy.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -941,6 +941,28 @@ providers:
provider_specific: []
statistics_logging: []

- name: 'Vercel'
url_patterns:
- 'https://ai-gateway.vercel.sh'
min_version: '2.0.0'
chat:
supported: true
streaming: true
upstream_path: '`/v1/chat/completions`'
route_type: 'llm/v1/chat'
model_example: 'openai/gpt-5.5'
min_version: '2.0.0'
embeddings:
supported: false
image:
generations:
supported: false
edits:
supported: false
limitations:
provider_specific: []
statistics_logging: []

parameters:
provider: 'config.model.provider'
route_type: 'config.route_type'
Expand Down
1 change: 1 addition & 0 deletions app/_data/schemas/frontmatter/tags.json
Original file line number Diff line number Diff line change
Expand Up @@ -215,6 +215,7 @@
"upgrade",
"validation",
"vault",
"vercel",
"versioning",
"vertex-ai",
"vllm",
Expand Down
Original file line number Diff line number Diff line change
@@ -1,50 +1,36 @@
---
title: Set up AI Proxy with OpenAI in {{site.base_gateway}}
permalink: /how-to/set-up-ai-proxy-with-openai/
title: Set up a model with AI proxy
permalink: /how-to/set-up-a-model-with-ai-proxy
content_type: how_to
related_resources:
- text: "{{site.ai_gateway}}"
url: /ai-gateway/
- text: AI Proxy
url: /plugins/ai-proxy/

description: Configure the AI Proxy plugin to create a chat route using OpenAI.
description: Configure the AI Proxy plugin to create a chat route.

products:
- gateway

- ai-gateway

works_on:
- on-prem
- konnect

min_version:
gateway: '3.6'

plugins:
- ai-proxy

entities:
- service
- route
- plugin

tags:
- ai
- openai

- ai-proxy
tldr:
q: How do I use the AI Proxy plugin with OpenAI?
a: Create a Gateway Service and a Route, then enable the AI Proxy plugin and configure it with the OpenAI provider and add the model and your API key.
q: How do I use the AI Proxy plugin?
a: Create a Gateway Service and a Route, then enable the AI Proxy plugin and configure it with a provider, model, and API key.

tools:
- deck

prereqs:
inline:
- title: OpenAI
include_content: prereqs/openai
icon_url: /assets/icons/openai.svg
entities:
services:
- example-service
Expand All @@ -63,9 +49,11 @@ cleanup:

## Configure the plugin

To set up AI Proxy with OpenAI, specify the [model](https://platform.openai.com/docs/models) and set the appropriate authentication header.
To set up AI Proxy specify a [provider](/ai-gateway/ai-providers/) and a compatible model and set the appropriate authentication header and optionally an upstream URL.

In this example, we'll use the gpt-4o model:
Additionally, you will need an API key from the upstream API provider.

In this minimal example, we'll use the OpenAI provider and the `gpt-5.5` model:

{% entity_examples %}
entities:
Expand All @@ -75,18 +63,20 @@ entities:
route_type: llm/v1/chat
auth:
header_name: Authorization
header_value: Bearer ${openai_api_key}
header_value: Bearer ${api_key}
model:
provider: openai
name: gpt-4o
name: gpt-5.5
options:
max_tokens: 512
temperature: 1.0
variables:
openai_api_key:
value: $OPENAI_API_KEY
api_key:
value: $API_KEY
{% endentity_examples %}

Further information can be found in the [AI Proxy configuration reference](/plugins/ai-proxy/reference/) or [AI Proxy Advanced configuration reference](/plugins/ai-proxy-advanced/reference/).

## Validate

{% include how-tos/steps/ai-proxy-validate.md %}

This file was deleted.

114 changes: 0 additions & 114 deletions app/_how-tos/ai-gateway/set-up-ai-proxy-advanced-with-aws-bedrock.md

This file was deleted.

Loading
Loading