Model
Context
Max Output
Latency
Throughput
Input
Output
Cache
Image Gen
Video Gen
Web Search
Capabilities
Providers
1M64K
0.7s
73tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
1M65K
0.8s
162tps
$0.50/M$3.00/M
Read:$0.05/M
Write:
$14.00/K
+ input costs
google logo
vertex logo
256K32K
2.2s
87tps
$0.03/M$1.20/M
Read:$0.06/M
Write:
novita logo
streamlake logo
1M128K
1.8s
58tps
$5.00/M$25.00/M
Read:$0.50/M
Write:$6.25/M
$10/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
1M66K
0.3s
256tps
$0.10/M$0.40/M
Read:$0.01/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
262K262K
0.9s
161tps
$0.50/M$2.80/M
Read:$0.10/M
Write:
fireworks logo
moonshotai logo
novita logo
+1
200K64K
0.4s
109tps
$1.00/M$5.00/M
Read:$0.10/M
Write:$1.25/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
203K131K
11.9s
42tps
$1.00/M$3.20/M
Read:$0.20/M
Write:
novita logo
zai logo
400K128K
0.7s
60tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
200K64K
0.4s
61tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
anthropic logo
bedrock logo
vertexAnthropic logo
164K66K
1.0s
51tps
$0.26/M$0.38/M
Read:$0.13/M
Write:
deepinfra logo
deepseek logo
novita logo
205K131K
2.4s
55tps
$0.30/M$1.20/M
Read:$0.03/M
Write:$0.38/M
minimax logo
128K16K
0.5s
123tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
+1
openai logo
1M64K
3.5s
123tps
$2.00/M$12.00/M
Read:$0.20/M
Write:
$14.00/K
+ input costs
google logo
vertex logo
1M64K
0.7s
68tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
256K256K
0.3s
175tps
$0.20/M$1.50/M
Read:$0.02/M
Write:
xai logo
1M66K
0.3s
331tps
$0.30/M$2.50/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
deepinfra logo
google logo
vertex logo
200K64K
0.7s
50tps
$5.00/M$25.00/M
Read:$0.50/M
Write:$6.25/M
anthropic logo
bedrock logo
vertexAnthropic logo
2M30K
0.8s
131tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
400K128K
2.7s
246tps
$0.25/M$2.00/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
400K128K
1.1s
186tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10/K
+ input costs
openai logo
400K128K
0.7s
152tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
+1
azure logo
openai logo
1M66K
2.0s
204tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$35.00/K
+ input costs
deepinfra logo
google logo
vertex logo
2M30K
3.7s
285tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
1M8K
0.4s
149tps
$0.15/M$0.60/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
128K16K
0.5s
104tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
400K128K
2.1s
525tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
azure logo
openai logo
128K16K
0.6s
111tps
$0.15/M$0.60/M
Read:$0.07/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
400K128K
6.9s
1010tps
$0.05/M$0.40/M
Read:$0.01/M
Write:
$0.40/M
$10.00/K
+ input costs
azure logo
openai logo
131K131K
0.1s
1877tps
$0.25/M$0.69/M
Read:$0.25/M
Write:
baseten logo
bedrock logo
cerebras logo
+5
2M256K
0.8s
48tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
205K131K
0.4s
204tps
$0.43/M$1.75/M
Read:$0.08/M
Write:
deepinfra logo
novita logo
zai logo
1M33K
0.7s
75tps
$0.40/M$1.60/M
Read:$0.10/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
256K256K
1.4s
79tps
mistral logo
131K66K
0.1s
$0.07/M$0.30/M
Read:$0.04/M
Write:
groq logo
1M33K
0.5s
67tps
$2.00/M$8.00/M
Read:$0.50/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
128K16K
0.5s
49tps
$2.50/M$10.00/M
Read:$1.25/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
205K203K
0.4s
205tps
$0.45/M$1.80/M
Read:$0.11/M
Write:
baseten logo
deepinfra logo
fireworks logo
+2
$0.02/M
azure logo
openai logo
205K200K
0.7s
138tps
$0.30/M$1.20/M
Read:$0.03/M
Write:$0.38/M
bedrock logo
deepinfra logo
fireworks logo
+2
1M8K
0.3s
165tps
$0.07/M$0.30/M
$35.00/K
+ input costs
google logo
vertex logo
2M256K
1.9s
128tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
400K128K
0.5s
18tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
33K66K
0.4s
190tps
$0.30/M$2.50/M$0.04/img
google logo
vertex logo
128K4K
0.2s
258tps
$0.04/M$0.04/M
mistral logo
400K128K
0.6s
111tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
131K128K
0.1s
219tps
$0.07/M$0.30/M
Read:$0.04/M
Write:
bedrock logo
fireworks logo
groq logo
$0.10/M
mistral logo
$0.13/M
azure logo
openai logo
82K16K
0.3s
$0.80/M$1.20/M
morph logo
128K64K
1.2s
63tps
$0.28/M$0.42/M
Read:$0.03/M
Write:
deepseek logo
66K33K
12.5s
213tps
$2.00/M$120.00/M$120.00/M
$14.00/K
+ input costs
google logo
vertex logo
400K128K
1.6s
398tps
$0.25/M$2.00/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
openai logo
262K128K
0.1s
197tps
$1.00/M$3.00/M
Read:$0.50/M
Write:
baseten logo
fireworks logo
groq logo
+1
400K128K
3.0s
168tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
openai logo
1M33K
0.3s
$0.10/M$0.40/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
131K131K
2.7s
71tps
$0.25/M$1.00/M
arcee-ai logo
262K262K
0.3s
179tps
$0.60/M$2.50/M
Read:$0.15/M
Write:
baseten logo
deepinfra logo
fireworks logo
+2
128K16K
1.0s
50tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10.00/K
+ input costs
openai logo
128K33K
0.1s
154tps
$0.59/M$0.72/M
bedrock logo
groq logo
1M66K
0.5s
218tps
$0.30/M$2.50/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
$0.03/M
vertex logo
128K8K
0.3s
$0.04/M$0.14/M
bedrock logo
$0.15/M
google logo
vertex logo
200K131K
4.3s
47tps
zai logo
131K8K
0.1s
106tps
$0.17/M$0.66/M
bedrock logo
deepinfra logo
groq logo
262K66K
1.9s
33tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
novita logo
164K16K
0.3s
169tps
$1.35/M$5.40/M
Read:$0.40/M
Write:
bedrock logo
deepinfra logo
parasail logo
127K8K
1.4s
98tps
$1.00/M$1.00/M
perplexity logo
164K164K
0.8s
64tps
$0.77/M$0.77/M
baseten logo
novita logo
164K164K
0.3s
270tps
$0.50/M$1.50/M
baseten logo
deepinfra logo
fireworks logo
+3
$0.06/M
voyage logo
200K100K
1.1s
270tps
$1.10/M$4.40/M
Read:$0.28/M
Write:
azure logo
openai logo
200K100K
1.2s
96tps
$2.00/M$8.00/M
Read:$0.50/M
Write:
openai logo
1M66K
0.3s
308tps
$0.10/M$0.40/M
Read:$0.01/M
Write:
$35/K
+ input costs
google logo
vertex logo
205K131K
0.8s
85tps
$0.30/M$2.40/M
Read:$0.03/M
Write:$0.38/M
minimax logo
200K8K
1.5s
134tps
$3.00/M$15.00/M
perplexity logo
131K131K
0.2s
84tps
$0.10/M$0.10/M
bedrock logo
cerebras logo
deepinfra logo
+2
262K67K
0.6s
111tps
$0.40/M$1.60/M
Read:$0.30/M
Write:
alibaba logo
deepinfra logo
fireworks logo
+1
262K32K
0.8s
87tps
$0.10/M$0.30/M
Read:$0.02/M
Write:
chutes logo
novita logo
524K8K
0.2s
47tps
$0.24/M$0.97/M
bedrock logo
deepinfra logo
vertex logo
300K8K
0.4s
122tps
$0.06/M$0.24/M
bedrock logo
256K256K
4.1s
65tps
$3.00/M$15.00/M
xai logo
200K8K
0.9s
62tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
bedrock logo
vertexAnthropic logo
200K8K
0.4s
56tps
$0.80/M$4.00/M
Read:$0.08/M
Write:$1.00/M
$10/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
131K131K
0.3s
84tps
$0.15/M$0.15/M
deepinfra logo
mistral logo
novita logo
256K256K
0.3s
141tps
mistral logo
128K4K
2.9s
149tps
$0.10/M$0.10/M
mistral logo
200K32K
1.1s
44tps
$15.00/M$75.00/M
Read:$1.50/M
Write:$18.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
262K262K
33.4s
95tps
$1.15/M$8.00/M
Read:$0.15/M
Write:
moonshotai logo
131K33K
0.8s
23tps
$0.07/M$0.46/M
Read:$0.11/M
Write:
deepinfra logo
fireworks logo
novita logo
205K205K
2.7s
46tps
$0.30/M$1.20/M
Read:$0.03/M
Write:$0.38/M
minimax logo
novita logo
131K131K
0.5s
78tps
$0.50/M$2.00/M
deepinfra logo
fireworks logo
moonshotai logo
+2
131K41K
0.1s
344tps
$0.10/M$0.30/M
alibaba logo
bedrock logo
deepinfra logo
+1
131K66K
1.1s
44tps
$0.27/M$1.00/M
novita logo
256K256K
0.5s
63tps
$0.50/M$1.50/M
mistral logo
200K100K
2.0s
$1.10/M$4.40/M
Read:$0.55/M
Write:
azure logo
openai logo
200K4K
0.3s
143tps
$0.25/M$1.25/M
Read:$0.03/M
Write:$0.30/M
anthropic logo
bedrock logo
vertexAnthropic logo
128K24K
4.9s
38tps
$0.30/M$0.90/M
Read:$0.05/M
Write:
zai logo
16K4K
0.5s
$0.50/M$1.50/M
openai logo
131K131K
0.3s
138tps
$0.20/M$0.60/M
bedrock logo
deepinfra logo
$0.03/M
vertex logo
1M64K
$0.40/M$2.40/M
Read:$0.04/M
Write:$0.50/M
alibaba logo
256K66K
2.2s
33tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
262K262K
0.7s
58tps
$0.20/M$1.20/M
Read:$0.11/M
Write:
alibaba logo
deepinfra logo
fireworks logo
+1
262K66K
0.6s
153tps
$0.09/M$1.10/M
alibaba logo
deepinfra logo
novita logo
1M1M
0.4s
171tps
$0.30/M$2.50/M
bedrock logo
128K4K
0.2s
354tps
$0.30/M$0.90/M
mistral logo
256K256K
0.2s
86tps
$0.20/M$0.20/M
mistral logo
131K131K
0.4s
141tps
$0.30/M$0.50/M
xai logo
131K131K
0.9s
76tps
$0.60/M$2.20/M
Read:$0.11/M
Write:
novita logo
zai logo
128K100K
3.1s
110tps
chutes logo
meituan logo
256K16K
0.8s
$2.40/M$10.00/M
moonshotai logo
1M66K
1.6s
53tps
$1.00/M$5.00/M
Read:$0.20/M
Write:
alibaba logo
200K100K
2.7s
125tps
$15.00/M$60.00/M
Read:$7.50/M
Write:
azure logo
openai logo
32K4K
0.2s
114tps
$0.10/M$0.30/M
mistral logo
131K131K
0.7s
81tps
$3.00/M$15.00/M
xai logo
256K256K
1.0s
$0.50/M$1.20/M
togetherai logo
128K64K
0.2s
130tps
$0.40/M$2.00/M
mistral logo
128K96K
2.5s
53tps
$0.20/M$1.10/M
Read:$0.03/M
Write:
zai logo
200K32K
1.1s
42tps
$15.00/M$75.00/M
Read:$1.50/M
Write:$18.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
128K8K
0.3s
53tps
$0.15/M$0.15/M
bedrock logo
200K100K
65.2s
$20.00/M$80.00/M
openai logo
128K4K
1.2s
40tps
$10.00/M$30.00/M
openai logo
$0.10/M
azure logo
openai logo
400K128K
$21.00/M$168.00/M
$10.00/K
+ input costs
openai logo
131K66K
0.9s
267tps
$0.15/M$1.50/M
alibaba logo
novita logo
33K33K
3.8s
118tps
meituan logo
200K128K
2.7s
47tps
$0.06/M$0.40/M
Read:$0.01/M
Write:
zai logo
131K131K
0.3s
133tps
$0.60/M$4.00/M
xai logo
256K256K
1.0s
80tps
$0.22/M$0.88/M
alibaba logo
fireworks logo
novita logo
131K131K
0.5s
218tps
$0.04/M$0.15/M
arcee-ai logo
131K131K
0.3s
83tps
$5.00/M$25.00/M
xai logo
262K262K
0.3s
80tps
$0.30/M$2.90/M
deepinfra logo
novita logo
127K8K
1.7s
103tps
$2.00/M$8.00/M
perplexity logo
82K16K
0.3s
$0.90/M$1.90/M
morph logo
262K33K
0.4s
127tps
$0.15/M$0.60/M
bedrock logo
novita logo
$0.02/M
voyage logo
300K8K
0.4s
139tps
$0.80/M$3.20/M
bedrock logo
128K32K
4.0s
58tps
$3.00/M$15.00/M
vercel logo
131K16K
0.4s
34tps
$0.72/M$0.72/M
bedrock logo
deepinfra logo
128K24K
1.6s
139tps
zai logo
128K33K
4.0s
58tps
$3.00/M$15.00/M
vercel logo
400K272K
$15.00/M$120.00/M$120.00/M
$10.00/K
+ input costs
+1
openai logo
256K32K
1.1s
56tps
$0.25/M$2.00/M
Read:$0.05/M
Write:
bytedance logo
41K16K
0.2s
31tps
$0.08/M$0.29/M
deepinfra logo
131K131K
0.3s
150tps
$0.06/M$0.23/M
bedrock logo
deepinfra logo
41K16K
0.2s
79tps
$0.06/M$0.24/M
deepinfra logo
$0.12/M
cohere logo
33K33K
$0.01/M
deepinfra logo
256K64K
1.2s
76tps
$0.25/M$2.00/M
Read:$0.05/M
Write:
bytedance logo
66K16K
1.0s
75tps
$0.60/M$1.80/M
Read:$0.11/M
Write:
novita logo
zai logo
33K33K
$0.05/M
deepinfra logo
131K131K
0.4s
116tps
$0.20/M$1.10/M
parasail logo
128K4K
0.3s
142tps
$0.15/M$0.15/M
mistral logo
256K8K
0.5s
39tps
$2.50/M$10.00/M
cohere logo
33K33K
0.6s
102tps
$2.00/M$10.00/M
xai logo
$0.18/M
voyage logo
128K8K
0.3s
60tps
$0.72/M$0.72/M
bedrock logo
128K64K
0.3s
$0.10/M$0.30/M
mistral logo
200K8K
0.5s
83tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
bedrock logo
vertexAnthropic logo
33K33K
$0.02/M
deepinfra logo
128K16K
1.3s
127tps
$0.15/M$0.60/M
$10.00/K
+ input costs
openai logo
128K64K
0.3s
107tps
$0.50/M$1.50/M
mistral logo
262K262K
0.2s
$0.06/M$0.24/M
deepinfra logo
128K4K
0.3s
72tps
$2.00/M$6.00/M
mistral logo
128K8K
0.2s
168tps
$0.16/M$0.16/M
bedrock logo
128K8K
0.3s
88tps
$0.10/M$0.10/M
bedrock logo
128K64K
0.3s
43tps
$2.00/M$5.00/M
mistral logo
262K33K
2.0s
81tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
200K8K
0.7s
21tps
$15.00/M$75.00/M
bedrock logo
66K2K
0.4s
$1.20/M$1.20/M
fireworks logo
$0.02/M
bedrock logo
$0.15/M
mistral logo
$0.06/img
bfl logo
$0.02/img
xai logo
200K100K
$10.00/M$40.00/M
Read:$2.50/M
Write:
$10.00/K
+ input costs
openai logo
$0.06/MP
bfl logo
67K67K
$0.03/MP
bfl logo
480
$0.02/img
vertex logo
127K8K
$1.00/M$5.00/M
perplexity logo
128K8K
$0.15/M$1.50/M
chutes logo
$0.015/MP
bfl logo
$0.07/img
xai logo
$0.02/img
recraft logo
8K4K
$1.50/M$2.00/M
openai logo
$0.04/img
bfl logo
$0.014/MP
bfl logo
67K67K
$0.07/MP
bfl logo
480
$0.04/img
vertex logo
200K100K
$1.50/M$6.00/M
Read:$0.38/M
Write:
openai logo
480
$0.06/img
vertex logo
512
$0.04/img
bfl logo
prodia logo
32K16K
0.5s
$0.25/M$1.00/M
inception logo
$0.04/img
recraft logo
$0.05/img
bfl logo
512
$0.08/img
bfl logo
$0.12/M
voyage logo
$0.18/M
voyage logo
$0.12/M
voyage logo
$0.12/M
voyage logo