AI Gateway
Last updated December 1, 2025
AI Gateway is available on all plans. Your use of each AI provider is subject to their terms listed on each model's page and subject to Vercel's AI Product Terms.
The AI Gateway provides a unified API to access hundreds of models through a single endpoint. It gives you the ability to set budgets, monitor usage, load-balance requests, and manage fallbacks.
The design allows it to work seamlessly with AI SDK v5 and v6, OpenAI SDK, Anthropic SDK, or your preferred framework.
- Unified API: helps you switch between providers and models with minimal code changes
- High reliability: automatically retries requests to other providers if one fails
- Embeddings support: generate vector embeddings for search, retrieval, and other tasks
- Spend monitoring: monitor your spending across different providers
- No markup on tokens: tokens cost the same as they would from the provider directly, with 0% markup, including with Bring Your Own Key (BYOK).
index.ts
import { generateText } from 'ai';
const { text } = await generateText({
model: 'anthropic/claude-sonnet-4.5',
prompt: 'What is the capital of France?',
});
index.py
import os
from openai import OpenAI
client = OpenAI(
api_key=os.getenv('AI_GATEWAY_API_KEY'),
base_url='https://ai-gateway.vercel.sh/v1'
)
response = client.chat.completions.create(
model='xai/grok-4',
messages=[
{
'role': 'user',
'content': 'Why is the sky blue?'
}
]
)index.sh
curl -X POST "https://ai-gateway.vercel.sh/v1/chat/completions" \
-H "Authorization: Bearer $AI_GATEWAY_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "openai/gpt-5.2",
"messages": [
{
"role": "user",
"content": "Why is the sky blue?"
}
],
"stream": false
}'Was this helpful?