Model
Context
Max Output
Latency
Throughput
Input
Output
Cache
Image Gen
Web Search
Capabilities
Providers
256K32K
2.0s
69tps
$0.03/M$1.20/M
Read:$0.06/M
Write:
novita logo
streamlake logo
1000K64K
0.8s
72tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
262K262K
0.4s
184tps
$0.50/M$2.80/M
Read:$0.10/M
Write:
fireworks logo
moonshotai logo
novita logo
+1
1000K65K
0.7s
163tps
$0.50/M$3.00/M
Read:$0.05/M
Write:
$14.00/K
+ input costs
google logo
vertex logo
205K200K
0.4s
137tps
$0.28/M$1.20/M
Read:$0.03/M
Write:$0.38/M
bedrock logo
deepinfra logo
fireworks logo
+2
1049K66K
0.3s
276tps
$0.10/M$0.40/M
Read:$0.01/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
200K64K
0.5s
119tps
$1.00/M$5.00/M
Read:$0.10/M
Write:$1.25/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
400K128K
1.0s
56tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
200K64K
0.4s
57tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
anthropic logo
bedrock logo
vertexAnthropic logo
1000K128K
2.2s
68tps
$5.00/M$25.00/M
Read:$0.50/M
Write:$6.25/M
$10/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
200K64K
1.0s
56tps
$5.00/M$25.00/M
Read:$0.50/M
Write:$6.25/M
anthropic logo
bedrock logo
vertexAnthropic logo
128K16K
0.5s
140tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
+1
openai logo
1000K64K
0.8s
74tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
1000K64K
3.6s
131tps
$2.00/M$12.00/M
Read:$0.20/M
Write:
$14.00/K
+ input costs
google logo
vertex logo
205K131K
0.2s
442tps
$0.43/M$1.75/M
Read:$0.08/M
Write:
cerebras logo
deepinfra logo
novita logo
+1
400K128K
1.0s
62tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10/K
+ input costs
openai logo
1000K66K
0.4s
328tps
$0.30/M$2.50/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
deepinfra logo
google logo
vertex logo
1049K66K
1.8s
195tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$35.00/K
+ input costs
deepinfra logo
google logo
vertex logo
400K128K
4.9s
439tps
$0.25/M$2.00/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
164K66K
0.9s
39tps
$0.27/M$0.40/M
Read:$0.03/M
Write:
deepinfra logo
deepseek logo
novita logo
128K16K
0.6s
190tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
400K128K
3.8s
259tps
$0.05/M$0.40/M
Read:$0.01/M
Write:
$0.40/M
$10.00/K
+ input costs
azure logo
openai logo
2000K30K
0.8s
76tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
400K128K
4.5s
615tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
azure logo
openai logo
2000K30K
4.0s
231tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
131K131K
0.2s
1535tps
$0.10/M$0.50/M
Read:$0.08/M
Write:
baseten logo
bedrock logo
cerebras logo
+5
400K128K
0.6s
72tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
+1
azure logo
openai logo
128K16K
0.5s
125tps
$0.15/M$0.60/M
Read:$0.07/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
2000K256K
0.8s
131tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
33K66K
0.4s
207tps
$0.30/M$2.50/M$0.04/img
google logo
vertex logo
256K256K
5.4s
66tps
mistral logo
$0.02/M
azure logo
openai logo
131K66K
0.1s
$0.07/M$0.30/M
Read:$0.04/M
Write:
groq logo
1048K33K
0.6s
75tps
$0.40/M$1.60/M
Read:$0.10/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
1048K33K
0.6s
61tps
$2.00/M$8.00/M
Read:$0.50/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
256K256K
1.7s
286tps
$0.20/M$1.50/M
Read:$0.02/M
Write:
xai logo
262K128K
0.1s
52tps
$0.60/M$2.50/M
baseten logo
fireworks logo
groq logo
+1
131K128K
0.1s
244tps
$0.07/M$0.30/M
bedrock logo
fireworks logo
groq logo
$0.10/M
mistral logo
128K16K
0.5s
114tps
$2.50/M$10.00/M
Read:$1.25/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
2000K256K
1.7s
280tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
1049K8K
0.3s
154tps
$0.07/M$0.30/M
$35.00/K
+ input costs
google logo
vertex logo
400K128K
0.6s
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
205K203K
0.4s
151tps
$0.45/M$1.80/M
Read:$0.11/M
Write:
baseten logo
deepinfra logo
fireworks logo
+2
128K4K
0.2s
$0.04/M$0.04/M
mistral logo
400K128K
0.5s
33tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
1049K8K
0.3s
154tps
$0.10/M$0.40/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
400K128K
0.7s
316tps
$0.25/M$2.00/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
openai logo
128K8K
0.3s
$0.04/M$0.14/M
bedrock logo
262K67K
0.2s
88tps
$0.40/M$1.60/M
Read:$0.30/M
Write:
alibaba logo
deepinfra logo
fireworks logo
+1
128K64K
1.6s
49tps
$0.28/M$0.42/M
Read:$0.03/M
Write:
deepseek logo
$0.13/M
azure logo
openai logo
$0.03/M
vertex logo
66K33K
12.3s
248tps
$2.00/M$120.00/M$120.00/M
$14.00/K
+ input costs
google logo
vertex logo
1048K33K
0.4s
136tps
$0.10/M$0.40/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
131K131K
1.5s
23tps
$0.25/M$1.00/M
arcee-ai logo
$0.15/M
google logo
vertex logo
82K16K
0.3s
$0.80/M$1.20/M
morph logo
164K164K
0.8s
38tps
$0.27/M$0.40/M
deepinfra logo
novita logo
400K128K
3.6s
460tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
openai logo
164K16K
0.3s
173tps
$0.50/M$2.15/M
Read:$0.40/M
Write:
bedrock logo
deepinfra logo
parasail logo
1049K66K
0.3s
285tps
$0.10/M$0.40/M
Read:$0.01/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
205K131K
2.1s
70tps
$0.30/M$2.40/M
Read:$0.03/M
Write:$0.38/M
minimax logo
164K164K
0.8s
84tps
$0.28/M$0.77/M
baseten logo
novita logo
200K8K
0.5s
57tps
$0.80/M$4.00/M
Read:$0.08/M
Write:$1.00/M
anthropic logo
bedrock logo
vertexAnthropic logo
131K33K
0.6s
70tps
$0.07/M$0.46/M
Read:$0.11/M
Write:
deepinfra logo
fireworks logo
novita logo
200K131K
9.5s
61tps
zai logo
256K256K
3.6s
65tps
$3.00/M$15.00/M
xai logo
262K66K
0.9s
33tps
$0.84/M$3.38/M
Read:$0.24/M
Write:
alibaba logo
novita logo
128K16K
1.1s
67tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10.00/K
+ input costs
openai logo
128K4K
0.2s
159tps
$0.10/M$0.10/M
mistral logo
127K8K
1.4s
108tps
$1.00/M$1.00/M
perplexity logo
262K32K
1.0s
121tps
$0.09/M$0.29/M
Read:$0.02/M
Write:
chutes logo
novita logo
205K205K
0.8s
103tps
$0.30/M$1.20/M
Read:$0.03/M
Write:$0.38/M
minimax logo
novita logo
200K100K
1.7s
148tps
$2.00/M$8.00/M
Read:$0.50/M
Write:
openai logo
1000K66K
0.5s
209tps
$0.30/M$2.50/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
131K131K
0.2s
110tps
$0.02/M$0.05/M
bedrock logo
cerebras logo
deepinfra logo
+2
131K131K
0.2s
55tps
$0.02/M$0.04/M
deepinfra logo
mistral logo
novita logo
164K164K
0.1s
268tps
$0.30/M$1.00/M
baseten logo
deepinfra logo
fireworks logo
+3
131K41K
0.1s
260tps
$0.10/M$0.30/M
alibaba logo
bedrock logo
cerebras logo
+2
300K8K
0.3s
135tps
$0.06/M$0.24/M
bedrock logo
131K131K
0.6s
56tps
$0.50/M$2.00/M
deepinfra logo
fireworks logo
moonshotai logo
+2
200K100K
1.5s
270tps
$1.10/M$4.40/M
Read:$0.28/M
Write:
azure logo
openai logo
131K8K
0.1s
203tps
$0.08/M$0.30/M
bedrock logo
deepinfra logo
groq logo
200K128K
2.3s
65tps
$0.06/M$0.40/M
Read:$0.01/M
Write:
zai logo
200K8K
0.5s
69tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
bedrock logo
vertexAnthropic logo
200K100K
1.8s
$15.00/M$60.00/M
Read:$7.50/M
Write:
azure logo
openai logo
256K256K
0.4s
67tps
$0.50/M$1.50/M
mistral logo
262K262K
0.3s
190tps
$0.47/M$2.00/M
Read:$0.14/M
Write:
baseten logo
deepinfra logo
fireworks logo
+2
200K8K
1.5s
99tps
$3.00/M$15.00/M
perplexity logo
200K100K
2.5s
168tps
$1.10/M$4.40/M
Read:$0.55/M
Write:
azure logo
openai logo
128K33K
0.2s
393tps
$0.59/M$0.72/M
Read:$0.85/M
Write:
bedrock logo
cerebras logo
groq logo
$0.10/M
azure logo
openai logo
131K66K
0.8s
42tps
$0.27/M$1.00/M
novita logo
200K32K
1.1s
48tps
$15.00/M$75.00/M
Read:$1.50/M
Write:$18.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
200K32K
1.1s
46tps
$15.00/M$75.00/M
Read:$1.50/M
Write:$18.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
200K4K
0.3s
138tps
$0.25/M$1.25/M
Read:$0.03/M
Write:$0.30/M
anthropic logo
bedrock logo
vertexAnthropic logo
262K33K
0.4s
70tps
$0.07/M$0.27/M
bedrock logo
novita logo
262K262K
0.3s
56tps
$0.30/M$2.90/M
deepinfra logo
novita logo
131K131K
3.6s
283tps
$0.60/M$4.00/M
xai logo
$0.15/M
mistral logo
$0.03/M
vertex logo
256K256K
0.9s
50tps
$0.50/M$1.20/M
togetherai logo
131K131K
0.2s
187tps
$0.20/M$0.60/M
bedrock logo
deepinfra logo
33K33K
3.0s
143tps
meituan logo
256K256K
0.3s
116tps
mistral logo
128K100K
2.9s
124tps
chutes logo
meituan logo
1000K66K
1.7s
62tps
$1.00/M$5.00/M
Read:$0.20/M
Write:
alibaba logo
128K24K
1.7s
120tps
zai logo
33K33K
0.4s
191tps
$0.30/M$2.50/M$0.04/img
google logo
256K16K
0.9s
$2.40/M$10.00/M
moonshotai logo
131K131K
3.8s
260tps
$0.30/M$0.50/M
xai logo
400K128K
13.0s
$21.00/M$168.00/M
$10.00/K
+ input costs
openai logo
262K262K
0.8s
127tps
$1.15/M$8.00/M
Read:$0.15/M
Write:
moonshotai logo
32K4K
0.2s
$0.10/M$0.30/M
mistral logo
131K131K
0.3s
79tps
$3.00/M$15.00/M
xai logo
128K4K
0.2s
328tps
$0.30/M$0.90/M
mistral logo
128K24K
2.7s
79tps
$0.30/M$0.90/M
Read:$0.05/M
Write:
zai logo
200K8K
0.5s
85tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
bedrock logo
vertexAnthropic logo
256K256K
0.5s
87tps
$0.22/M$0.88/M
alibaba logo
fireworks logo
novita logo
1000K1000K
0.4s
179tps
$0.30/M$2.50/M
bedrock logo
128K8K
0.3s
54tps
$0.15/M$0.15/M
bedrock logo
256K256K
0.2s
118tps
$0.20/M$0.20/M
mistral logo
131K66K
0.9s
303tps
$0.15/M$1.50/M
alibaba logo
novita logo
33K33K
0.6s
102tps
$2.00/M$10.00/M
xai logo
262K262K
0.4s
56tps
$0.20/M$0.88/M
Read:$0.11/M
Write:
alibaba logo
deepinfra logo
fireworks logo
+1
16K4K
0.4s
$0.50/M$1.50/M
openai logo
$0.12/M
cohere logo
200K100K
44.7s
$20.00/M$80.00/M
openai logo
131K131K
0.4s
116tps
$0.20/M$1.10/M
parasail logo
262K66K
0.4s
163tps
$0.09/M$1.10/M
alibaba logo
deepinfra logo
novita logo
128K33K
5.0s
58tps
$3.00/M$15.00/M
vercel logo
128K32K
6.1s
58tps
$3.00/M$15.00/M
vercel logo
131K131K
1.9s
83tps
$0.60/M$2.20/M
Read:$0.11/M
Write:
novita logo
zai logo
128K96K
1.7s
113tps
$0.20/M$1.10/M
Read:$0.03/M
Write:
zai logo
127K8K
1.4s
105tps
$2.00/M$8.00/M
perplexity logo
41K16K
0.2s
52tps
$0.08/M$0.29/M
deepinfra logo
41K16K
0.2s
68tps
$0.06/M$0.24/M
deepinfra logo
128K4K
0.8s
21tps
$10.00/M$30.00/M
openai logo
128K64K
0.3s
$0.10/M$0.30/M
mistral logo
400K272K
$15.00/M$120.00/M$120.00/M
$10.00/K
+ input costs
+1
openai logo
256K32K
1.3s
62tps
$0.25/M$2.00/M
Read:$0.05/M
Write:
bytedance logo
524K8K
0.3s
246tps
$0.15/M$0.60/M
bedrock logo
deepinfra logo
vertex logo
256K66K
1.5s
31tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
256K64K
1.1s
94tps
$0.25/M$2.00/M
Read:$0.05/M
Write:
bytedance logo
128K16K
1.9s
$0.15/M$0.60/M
$10.00/K
+ input costs
openai logo
$0.06/M
voyage logo
131K131K
0.2s
148tps
$0.04/M$0.16/M
bedrock logo
deepinfra logo
131K131K
0.6s
221tps
$0.04/M$0.15/M
arcee-ai logo
66K16K
0.7s
77tps
$0.60/M$1.80/M
Read:$0.11/M
Write:
novita logo
zai logo
256K8K
0.4s
70tps
$2.50/M$10.00/M
cohere logo
262K262K
0.2s
$0.06/M$0.24/M
deepinfra logo
300K8K
0.4s
126tps
$0.80/M$3.20/M
bedrock logo
131K131K
0.3s
78tps
$5.00/M$25.00/M
xai logo
128K4K
0.3s
119tps
$0.15/M$0.15/M
mistral logo
128K64K
0.2s
121tps
$0.40/M$2.00/M
mistral logo
131K16K
0.3s
32tps
$0.40/M$0.40/M
bedrock logo
deepinfra logo
200K100K
2.0s
234tps
$1.50/M$6.00/M
Read:$0.38/M
Write:
openai logo
128K64K
0.3s
122tps
$0.50/M$1.50/M
mistral logo
262K33K
1.8s
78tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
128K8K
0.2s
109tps
$0.16/M$0.16/M
bedrock logo
33K33K
$0.05/M
deepinfra logo
128K8K
0.2s
93tps
$0.10/M$0.10/M
bedrock logo
128K4K
0.3s
71tps
$2.00/M$6.00/M
mistral logo
128K64K
0.3s
43tps
$2.00/M$5.00/M
mistral logo
128K8K
0.3s
63tps
$0.72/M$0.72/M
bedrock logo
200K8K
0.7s
24tps
$15.00/M$75.00/M
bedrock logo
$0.18/M
voyage logo
82K16K
0.3s
$0.90/M$1.90/M
morph logo
66K2K
0.3s
$1.20/M$1.20/M
fireworks logo
33K33K
$0.01/M
deepinfra logo
$0.02/M
bedrock logo
$0.02/M
voyage logo
33K33K
$0.02/M
deepinfra logo
67K67K
$0.07/MP
bfl logo
$0.014/MP
bfl logo
8K4K
$1.50/M$2.00/M
openai logo
512
$0.04/img
bfl logo
prodia logo
$0.02/img
recraft logo
$0.04/img
bfl logo
480
$0.04/img
vertex logo
480
$0.06/img
vertex logo
32K16K
0.8s
$0.25/M$1.00/M
inception logo
$0.015/MP
bfl logo
$0.06/img
bfl logo
200K100K
$10.00/M$40.00/M
Read:$2.50/M
Write:
$10.00/K
+ input costs
openai logo
480
$0.02/img
vertex logo
512
$0.08/img
bfl logo
128K8K
$0.15/M$1.50/M
chutes logo
127K8K
$1.00/M$5.00/M
perplexity logo
67K67K
$0.03/MP
bfl logo
$0.06/MP
bfl logo
$0.04/img
recraft logo
$0.05/img
bfl logo
$0.12/M
voyage logo
$0.18/M
voyage logo
$0.12/M
voyage logo
$0.12/M
voyage logo