Baseten models
Route requests to Baseten through Vercel AI Gateway. Compare the models Baseten serves, with unified billing and automatic failover across providers.
| Model | Context | Input | Output | Latency | Throughput | Cache | Search | Capabilities | ZDR | No Training | Regional Inference | Free AI Gateway Credit | Released |
|---|
| 16K | $0.10/M | — | — | — | — | — | — | US | 10/21/2026 | ||||
| 16K | $0.04/M | — | — | — | — | — | — | US | 10/21/2026 | ||||
| 1M | $0.30/M+1 more | $1.20/M+1 more | 0.3 s | 287 tps | Read$0.007/M | — | +2 | US | 10/17/2026 | ||||
| 1M | $0.60/M | $2.40/M | — | — | Read$0.01/M | — | +2 | US | 10/17/2026 | ||||
| 1M | $0.40/M | $1.20/M | 0.3 s | — | Read$0.04/M | — | +1 | — | 10/16/2026 | ||||
| 1M | $0.20/M | $0.50/M | 1.5 s | 403 tps | Read$0.04/M | — | +2 | US | 10/15/2026 | ||||
| 1M | $1.25/M | $4.25/M | 0.2 s | 177 tps | Read$0.15/M | — | +2 | US | 10/15/2026 | ||||
| 1M | $0.60/M | $2.40/M | — | — | Read$0.01/M | — | +2 | US | 09/29/2026 | ||||
| 1M | $0.30/M+1 more | $1.20/M+1 more | 0.4 s | 383 tps | Read$0.007/M | — | +2 | US | 09/08/2026 | ||||
| 1M | $2.10/M | $6.60/M | — | — | Read$0.21/M | — | +1 | US | 09/02/2026 | ||||
| 1M | $0.15/M | $0.50/M | 0.7 s | 84 tps | Read$0.03/M | — | +2 | US | 08/26/2026 | ||||
| 1M | $1.40/M+1 more | $4.40/M+1 more | 0.5 s | 127 tps | Read$0.14/M | — | +1 | US | 08/18/2026 | ||||
| 1M | $1.32/M | $3.96/M | 148.3 s | 65 tps | Read$0.13/M | — | +1 | US | 08/12/2026 | ||||
| 1M | $0.13/M | $0.26/M | 0.3 s | 386 tps | Read$0.03/M | — | +1 | US | 07/31/2026 | ||||
| 1M | $3/M | $15/M | 2.1 s | 71 tps | Read$0.30/M | — | +3 | US | 07/16/2026 | ||||
| 1M | $2.10/M | $6.60/M | — | — | Read$0.21/M | — | +1 | US | 06/23/2026 | ||||
| 1M | $1.40/M+1 more | $4.40/M+1 more | 1.5 s | 115 tps | Read$0.14/M | — | +1 | US | 06/16/2026 | ||||
| 1M | $0.60/M | $2.40/M | 2.2 s | 106 tps | Read$0.12/M | — | US | 06/04/2026 | |||||
| 1M | $1.32/M | $3.96/M | 137.0 s | 81 tps | Read$0.13/M | — | US | 04/23/2026 | |||||
| 1M | $0.13/M | $0.26/M | 0.4 s | 298 tps | Read$0.03/M | — | US | 04/23/2026 | |||||
| 131K | $0.10/M | $0.50/M | 0.3 s | 158 tps | Read$0.10/M | — | US | 08/05/2025 |