Skip to content

Ability to use VertexAI (Google AI provider) not just for Gemini but also for Claude etc.. #2355

@MattFanto

Description

@MattFanto

Is your feature request related to a problem? Please describe.
At the moment is not possible for me to use Claude models via Vertex-AI

Describe the solution you'd like
Similar to what is possible for Azure AI-Foundry where I can configure claude as well

Describe alternatives you've considered

Additional context
Example request

e.g.
cat << EOF > request.json
{
"anthropic_version": "vertex-2023-10-16"
,"stream": true
,"max_tokens": 512
,"temperature": 1
,"messages": [
{
"role": "user",
"content": [
]
}
]
}
EOF

ENDPOINT="aiplatform.googleapis.com"
LOCATION_ID="europe-west-1"
PROJECT_ID="xxxx"
MODEL_ID="claude-sonnet-4-6"
METHOD="streamRawPredict"

curl -X POST
-H "Authorization: Bearer $(gcloud auth print-access-token)"
-H "Content-Type: application/json; charset=utf-8"
-d @request.json
"https://${ENDPOINT}/v1/projects/${PROJECT_ID}/locations/${LOCATION_ID}/publishers/anthropic/models/${MODEL_ID}:${METHOD}"

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions