Through an API

Open and closed models answer the same suite-standard 1.0 through their APIs, ranked together. 1 ranked model.

#ModelPass rate
1DeepSeek V4.1 Flash 1017Open weights100%

Model leaderboard

191 models ranked by LMArena score · updated Nov 11, 2026

#ModelScore
191PaLM 2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1027
190GPT-3.5 Turbo (1106)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1094
189GPT-3.5 Turbo (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1125
188Gemini ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1131
187Gemini Pro (Dev API)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1149
186Reka Flash 21B (20240226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1165
185Mistral MediumClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1165
184Reka Flash 21B (Online, 20240226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1170
183Mistral Large (2402)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1177
182GPT-4 (0613)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1186
181Claude 3 Haiku (20240307)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1195
180Hunyuan Standard 256KClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1202
179GPT-4 (0314)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1206
178Amazon Nova Micro 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1208
177Reka Flash (20240904)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1218
176Claude 3 Sonnet (20240229)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1218
175Gemini 1.5 Flash-8B (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1226
174GLM-4 (0520)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1226
173Amazon Nova Lite 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1229
172Gemini 1.5 Flash (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1239
171Reka Core (20240904)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1248
170Magistral Medium (2506)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1255
169Claude 3.5 Haiku (20241022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1255
168Amazon Nova Pro 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1259
167Claude 3 Opus (20240229)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1262
166GPT-4 Turbo Preview (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1262
165Hunyuan Large VisionClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1263
164GPT-4 Turbo Preview (1106)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1263
163GPT-4 Turbo (2024-04-09)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1272
162Gemini 1.5 Pro (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1274
161Hunyuan Standard (2025-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1274
160Gemini Advanced (0514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1279
159Grok 2 mini (2024-08-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1281
158Claude 3.5 Sonnet (20240620)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1281
157MercuryClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1282
156GPT-4o (2024-08-06)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1283
155GPT-4.1 nano (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1285
154GPT-4o mini (2024-07-18)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1286
153Gemini 1.5 Flash (002)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1287
152Hunyuan Large (2025-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1288
151GLM-4-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1290
150Claude 3.5 Sonnet (20241022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1298
149Qwen2.5-Plus (1127)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1299
148Claude 3.7 Sonnet (20250219)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1299
147GPT-4o (2024-05-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1300
146Yi LightningClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1302
145Grok 2 (2024-08-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1305
144Hunyuan Turbo (0110)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1311
143Claude 3.7 Sonnet (Thinking 32K, 20250219)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1314
142o1-miniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1317
141Gemini 1.5 Pro (002)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1319
140o3-miniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1320
139Hunyuan TurboS (20250226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1320
138GPT-5 nano (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1320
137Step-2 16K Exp (202412)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1321
136Qwen-Plus (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1326
135Gemini 2.0 Flash-Lite Preview (02-05)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1330
134GLM-4-Plus (0111)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1331
133Step-1o Turbo (202506)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1336
132o3-mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1337
131Claude Sonnet 4 (20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1339
130GPT-4.1 mini (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1341
129Claude Sonnet 4 (Thinking 32K, 20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1351
128o1-previewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1353
127o4-mini (2025-04-16)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1353
126Gemini 2.0 Flash (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1354
125Mercury 2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1355
124Amazon Nova 2 LiteClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1362
123amazon-nova-experimental-chat (10-09)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
122Grok 3 Mini BetaClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
121o1 (2024-12-17)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1366
120Claude Opus 4 (20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1366
119Qwen2.5-MaxClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
118Gemini 2.5 Flash-Lite Preview (Thinking, 06-17)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1369
117Grok 3 Mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1370
116Mistral Medium 3 (2505)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1370
115GPT-5.4 nano (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1372
114GPT-5 mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1373
113Claude Opus 4 (Thinking 16K, 20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1377
112Hunyuan TurboS (20250416)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1377
111Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1379
110GPT-4.1 (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1383
109Solar Pro 4Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1388
108GPT-6 Luna (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1388
107GPT-5.3 ChatClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1389
106amazon-nova-experimental-chat (10-20)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1394
105amazon-nova-experimental-chat (26-01-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
104Claude Haiku 4.5 (20251001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
103GPT-6 Sol (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1397
102Grok 4.3Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1397
101Qwen3.5-FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1397
100Claude Haiku 5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
99Grok 4 Fast (Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
98Grok 4.7 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
97Hunyuan T1 (20250711)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1401
96GPT-5 ChatClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
95Hunyuan Vision 1.5 ThinkingClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1406
94GPT-5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1406
93Gemini 2.5 Flash Preview (09-2025)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1407
92Grok 4 Fast (Non-Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1407
91Grok 4.1 Fast (Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1408
90o3 (2025-04-16)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1410
89Grok 4 (0709)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
88GPT-5.4 mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
87GPT-5.2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
86Qwen3-Max (2025-09-23)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1413
85amazon-nova-experimental-chat (11-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1415
84Gemini 3.1 Flash-Lite PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1416
83GPT-5.2 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1416
82Gemini 2.5 FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1417
81GPT-4.5 Preview (2025-02-27)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1417
80Claude Opus 4.1 (20250805)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
79amazon-nova-experimental-chat (12-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
78GPT-5.5 InstantClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
77Claude Opus 4.1 (Thinking 16K, 20250805)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
76GPT-5.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1422
75MiMo-V2-OmniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1423
74Mistral Medium 3.1 (2508)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
73Grok 3 Preview (02-24)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1426
72LongCat-Flash-Chat Exp (2602)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1426
71ChatGPT-4o Latest (20250326)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1429
70ERNIE-5.0-Preview (1022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1430
69Grok 4.6 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1430
68GPT-5.6 Luna (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1431
67Claude Sonnet 4.5 (High, 32K, 20250929)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1434
66Gemini 3.5 Flash-LiteClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1435
65Qwen3.6-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
64Grok 4.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
63MiMo-V2-ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
62Grok 4.1 (Thinking)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
61GPT-5.2 Chat (20260210)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1438
60Claude Sonnet 4.5 (20250929)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
59Qwen3-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
58GPT-6 Astra (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1440
57Claude Sonnet 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
56Gemini 3 Flash (Minimal)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
55GPT-5.1 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
54ERNIE-5.0-Preview (1203)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
53Step 5 PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
52ERNIE 5.0 (0110)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
51Grok 4.20 Beta 1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
50GPT-6.1 Sol (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1445
49Qwen3.6-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1446
48Grok 4.5Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
47Claude Opus 4.5 (High, 32K, 20251101)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
46Dola Seed 2.0 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
45amazon-nova-experimental-chat (26-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1449
44GPT-5.6 Terra (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1449
43Claude Opus 4.5 (20251101)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1451
42Grok 4.20 Multi-Agent Beta (0309)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1451
41Grok 4.20 Beta (Reasoning, 0309)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1451
40GPT-5.4Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1453
39Claude Opus 4.8Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
38Qwen3.7-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
37GPT-5.6 Sol (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1457
36Gemini 2.5 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1458
35Claude Sonnet 4.6Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1458
34Claude Opus 4.8 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1462
33Gemini 3 FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
32GPT-5.5Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
31ERNIE 5.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1468
30GPT-5.4 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1469
29Claude Sonnet 5.5 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1469
28Qwen3.5-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1471
27GPT-5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1471
26Muse SparkClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1474
25Qwen3.7-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1475
24Gemini 3.5 Flash (Medium)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1478
23Muse Spark 1.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1479
22Gemini 3.6 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1479
21Gemini 3 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1480
20Gemini 3.1 Pro PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1480
19Gemini 3.5 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
18Claude Opus 4.7Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
17Muse Spark 1.2 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
16Qwen3.8-MaxClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
15Gemini 3.7 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1489
14Claude Opus 4.7 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1490
13Muse Spark 1.3 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1492
12Claude Fable 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1492
11Claude Opus 4.6Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1497
10Gemini 3.8 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1500
9Claude Opus 4.6 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1501
8Gemini 4 Hydrogen (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1502
7Claude Opus 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1502
6Muse Wonder (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1503
5Claude Opus 5 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1507
4Claude Fable 5.1 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1512
3Claude Opus 5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1514
2Gemini 4 Argon (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1529
1Gemini 4 Carbon (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1538
Show the top 20

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.