Skip to content
Dashboard

Groq models

Route requests to Groq through Vercel AI Gateway. Compare the models Groq serves, with unified billing and automatic failover across providers.
Model
Context
Latency
Throughput
Input
Output
Cache
Web Search
Capabilities
Providers
ZDR
No Training
Regional Inference
Free Tier
Released
131K
0.2s
$0.07/M
$0.30/M
Read:$0.04/M
Write:
groq logo
10/29/2025
131K
0.2s
482tps
$0.35/M
$0.75/M
Read:$0.25/M
Write:
baseten logo
bedrock logo
cerebras logo
+5
US
08/05/2025
131K
0.2s
956tps
$0.07/M
$0.30/M
Read:$0.04/M
Write:
bedrock logo
deepinfra logo
fireworks logo
+4
08/05/2025
128K
0.2s
177tps
$0.59/M
$0.72/M
bedrock logo
groq logo
12/06/2024
131K
0.1s
139tps
$0.02/M
$0.05/M
Read:$0.03/M
Write:
bedrock logo
deepinfra logo
groq logo
+1
07/23/2024