Sort providers by cost, latency, or throughput on AI Gateway
AI Gateway now gives you the choice to sort providers behind a model by cost, time to first token, or throughput, so each request routes to the provider that fits your priorities.
Walter Korman, Jerilyn Zheng