Through an API

Open and closed models answer the same suite-standard 1.0 through their APIs, ranked together. 1 ranked model.

#ModelPass rate
1DeepSeek V4.1 Flash 1017Open weights100%

Model leaderboard

191 models ranked by LMArena score · updated Nov 11, 2026

#ModelScore
1Gemini 4 Carbon (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1538
2Gemini 4 Argon (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1529
3Claude Opus 5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1514
4Claude Fable 5.1 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1512
5Claude Opus 5 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1507
6Muse Wonder (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1503
7Claude Opus 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1502
8Gemini 4 Hydrogen (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1502
9Claude Opus 4.6 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1501
10Gemini 3.8 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1500
11Claude Opus 4.6Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1497
12Claude Fable 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1492
13Muse Spark 1.3 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1492
14Claude Opus 4.7 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1490
15Gemini 3.7 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1489
16Qwen3.8-MaxClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
17Muse Spark 1.2 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
18Claude Opus 4.7Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
19Gemini 3.5 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
20Gemini 3.1 Pro PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1480
21Gemini 3 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1480
22Gemini 3.6 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1479
23Muse Spark 1.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1479
24Gemini 3.5 Flash (Medium)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1478
25Qwen3.7-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1475
26Muse SparkClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1474
27GPT-5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1471
28Qwen3.5-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1471
29Claude Sonnet 5.5 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1469
30GPT-5.4 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1469
31ERNIE 5.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1468
32GPT-5.5Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
33Gemini 3 FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
34Claude Opus 4.8 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1462
35Claude Sonnet 4.6Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1458
36Gemini 2.5 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1458
37GPT-5.6 Sol (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1457
38Qwen3.7-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
39Claude Opus 4.8Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
40GPT-5.4Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1453
41Grok 4.20 Beta (Reasoning, 0309)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1451
42Grok 4.20 Multi-Agent Beta (0309)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1451
43Claude Opus 4.5 (20251101)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1451
44GPT-5.6 Terra (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1449
45amazon-nova-experimental-chat (26-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1449
46Dola Seed 2.0 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
47Claude Opus 4.5 (High, 32K, 20251101)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
48Grok 4.5Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
49Qwen3.6-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1446
50GPT-6.1 Sol (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1445
51Grok 4.20 Beta 1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
52ERNIE 5.0 (0110)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
53Step 5 PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
54ERNIE-5.0-Preview (1203)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
55GPT-5.1 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
56Gemini 3 Flash (Minimal)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
57Claude Sonnet 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
58GPT-6 Astra (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1440
59Qwen3-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
60Claude Sonnet 4.5 (20250929)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
61GPT-5.2 Chat (20260210)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1438
62Grok 4.1 (Thinking)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
63MiMo-V2-ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
64Grok 4.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
65Qwen3.6-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
66Gemini 3.5 Flash-LiteClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1435
67Claude Sonnet 4.5 (High, 32K, 20250929)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1434
68GPT-5.6 Luna (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1431
69Grok 4.6 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1430
70ERNIE-5.0-Preview (1022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1430
71ChatGPT-4o Latest (20250326)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1429
72LongCat-Flash-Chat Exp (2602)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1426
73Grok 3 Preview (02-24)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1426
74Mistral Medium 3.1 (2508)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
75MiMo-V2-OmniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1423
76GPT-5.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1422
77Claude Opus 4.1 (Thinking 16K, 20250805)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
78GPT-5.5 InstantClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
79amazon-nova-experimental-chat (12-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
80Claude Opus 4.1 (20250805)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
81GPT-4.5 Preview (2025-02-27)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1417
82Gemini 2.5 FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1417
83GPT-5.2 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1416
84Gemini 3.1 Flash-Lite PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1416
85amazon-nova-experimental-chat (11-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1415
86Qwen3-Max (2025-09-23)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1413
87GPT-5.2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
88GPT-5.4 mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
89Grok 4 (0709)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
90o3 (2025-04-16)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1410
91Grok 4.1 Fast (Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1408
92Grok 4 Fast (Non-Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1407
93Gemini 2.5 Flash Preview (09-2025)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1407
94GPT-5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1406
95Hunyuan Vision 1.5 ThinkingClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1406
96GPT-5 ChatClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
97Hunyuan T1 (20250711)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1401
98Grok 4.7 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
99Grok 4 Fast (Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
100Claude Haiku 5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
101Qwen3.5-FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1397
102Grok 4.3Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1397
103GPT-6 Sol (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1397
104Claude Haiku 4.5 (20251001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
105amazon-nova-experimental-chat (26-01-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
106amazon-nova-experimental-chat (10-20)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1394
107GPT-5.3 ChatClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1389
108GPT-6 Luna (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1388
109Solar Pro 4Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1388
110GPT-4.1 (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1383
111Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1379
112Hunyuan TurboS (20250416)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1377
113Claude Opus 4 (Thinking 16K, 20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1377
114GPT-5 mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1373
115GPT-5.4 nano (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1372
116Mistral Medium 3 (2505)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1370
117Grok 3 Mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1370
118Gemini 2.5 Flash-Lite Preview (Thinking, 06-17)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1369
119Qwen2.5-MaxClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
120Claude Opus 4 (20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1366
121o1 (2024-12-17)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1366
122Grok 3 Mini BetaClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
123amazon-nova-experimental-chat (10-09)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
124Amazon Nova 2 LiteClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1362
125Mercury 2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1355
126Gemini 2.0 Flash (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1354
127o4-mini (2025-04-16)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1353
128o1-previewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1353
129Claude Sonnet 4 (Thinking 32K, 20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1351
130GPT-4.1 mini (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1341
131Claude Sonnet 4 (20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1339
132o3-mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1337
133Step-1o Turbo (202506)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1336
134GLM-4-Plus (0111)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1331
135Gemini 2.0 Flash-Lite Preview (02-05)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1330
136Qwen-Plus (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1326
137Step-2 16K Exp (202412)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1321
138GPT-5 nano (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1320
139Hunyuan TurboS (20250226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1320
140o3-miniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1320
141Gemini 1.5 Pro (002)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1319
142o1-miniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1317
143Claude 3.7 Sonnet (Thinking 32K, 20250219)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1314
144Hunyuan Turbo (0110)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1311
145Grok 2 (2024-08-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1305
146Yi LightningClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1302
147GPT-4o (2024-05-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1300
148Claude 3.7 Sonnet (20250219)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1299
149Qwen2.5-Plus (1127)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1299
150Claude 3.5 Sonnet (20241022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1298
151GLM-4-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1290
152Hunyuan Large (2025-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1288
153Gemini 1.5 Flash (002)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1287
154GPT-4o mini (2024-07-18)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1286
155GPT-4.1 nano (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1285
156GPT-4o (2024-08-06)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1283
157MercuryClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1282
158Claude 3.5 Sonnet (20240620)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1281
159Grok 2 mini (2024-08-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1281
160Gemini Advanced (0514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1279
161Hunyuan Standard (2025-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1274
162Gemini 1.5 Pro (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1274
163GPT-4 Turbo (2024-04-09)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1272
164GPT-4 Turbo Preview (1106)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1263
165Hunyuan Large VisionClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1263
166GPT-4 Turbo Preview (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1262
167Claude 3 Opus (20240229)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1262
168Amazon Nova Pro 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1259
169Claude 3.5 Haiku (20241022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1255
170Magistral Medium (2506)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1255
171Reka Core (20240904)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1248
172Gemini 1.5 Flash (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1239
173Amazon Nova Lite 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1229
174GLM-4 (0520)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1226
175Gemini 1.5 Flash-8B (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1226
176Claude 3 Sonnet (20240229)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1218
177Reka Flash (20240904)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1218
178Amazon Nova Micro 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1208
179GPT-4 (0314)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1206
180Hunyuan Standard 256KClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1202
181Claude 3 Haiku (20240307)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1195
182GPT-4 (0613)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1186
183Mistral Large (2402)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1177
184Reka Flash 21B (Online, 20240226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1170
185Mistral MediumClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1165
186Reka Flash 21B (20240226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1165
187Gemini Pro (Dev API)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1149
188Gemini ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1131
189GPT-3.5 Turbo (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1125
190GPT-3.5 Turbo (1106)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1094
191PaLM 2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1027
Show the top 20

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.