Through an API

Open and closed models answer the same suite-standard 1.0 through their APIs, ranked together. 1 ranked model.

#ModelPass rate
1DeepSeek V4.1 Flash 1017Open weights100%

Model leaderboard

191 models in hard prompts ranked by LMArena score · updated Nov 11, 2026

#ModelScore
1Gemini 4 Carbon (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1551
2Gemini 4 Argon (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1542
3Claude Opus 5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1531
4Claude Fable 5.1 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1527
5Claude Opus 5 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1525
6Claude Opus 4.6 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1524
7Claude Opus 4.6Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1522
8Claude Opus 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1522
9Gemini 4 Hydrogen (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1520
10Muse Wonder (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1514
11Gemini 3.8 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1510
12Claude Fable 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1508
13Claude Opus 4.7 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1506
14Muse Spark 1.3 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1502
15Claude Opus 4.7Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1500
16Qwen3.8-MaxClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1499
17Gemini 3.7 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1498
18Muse Spark 1.2 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1492
19Gemini 3.5 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1489
20GPT-5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1488
21Claude Sonnet 5.5 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1488
22Muse Spark 1.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1486
23Gemini 3.6 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1486
24GPT-5.5Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
25Gemini 3.5 Flash (Medium)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
26GPT-5.4 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
27Gemini 3.1 Pro PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
28Claude Sonnet 4.6Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1484
29Qwen3.5-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
30GPT-5.6 Sol (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
31Claude Opus 4.8 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1482
32Qwen3.7-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1482
33ERNIE 5.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1481
34Gemini 3 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1480
35Claude Opus 4.5 (20251101)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1477
36Muse SparkClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1474
37Claude Opus 4.8Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1474
38Claude Opus 4.5 (High, 32K, 20251101)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1473
39GPT-5.6 Terra (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1470
40GPT-5.4Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1469
41GPT-6.1 Sol (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
42Gemini 3 FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1465
43Step 5 PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1463
44GPT-6 Astra (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1462
45Grok 4.5Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1462
46Claude Sonnet 4.5 (20250929)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1462
47Claude Sonnet 4.5 (High, 32K, 20250929)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1461
48Claude Sonnet 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1461
49Qwen3.7-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1459
50amazon-nova-experimental-chat (26-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1459
51MiMo-V2-ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1458
52GPT-5.1 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1457
53Qwen3.6-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1456
54Gemini 2.5 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1455
55Dola Seed 2.0 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1453
56GPT-5.6 Luna (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1452
57Grok 4.20 Beta (Reasoning, 0309)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1452
58Grok 4.20 Multi-Agent Beta (0309)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1449
59Qwen3-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
60Grok 4.6 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
61Qwen3.6-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
62GPT-5.2 Chat (20260210)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1445
63ERNIE 5.0 (0110)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1445
64MiMo-V2-OmniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
65Claude Opus 4.1 (Thinking 16K, 20250805)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
66Claude Opus 4.1 (20250805)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
67Grok 4.20 Beta 1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1441
68Gemini 3.5 Flash-LiteClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1441
69LongCat-Flash-Chat Exp (2602)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
70ERNIE-5.0-Preview (1203)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1438
71Gemini 3 Flash (Minimal)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1438
72Grok 4.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
73GPT-5.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1435
74Grok 3 Preview (02-24)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1434
75Grok 4.1 (Thinking)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1433
76GPT-5.2 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1428
77amazon-nova-experimental-chat (12-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1427
78GPT-5.2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1427
79GPT-5.5 InstantClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1426
80Mistral Medium 3.1 (2508)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1426
81GPT-5.4 mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
82ChatGPT-4o Latest (20250326)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1424
83Qwen3-Max (2025-09-23)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1423
84Gemini 2.5 FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1422
85amazon-nova-experimental-chat (11-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1422
86ERNIE-5.0-Preview (1022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1420
87Claude Haiku 4.5 (20251001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1420
88GPT-6 Sol (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
89Claude Haiku 5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1418
90Hunyuan Vision 1.5 ThinkingClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1417
91GPT-5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1416
92Grok 4.7 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1416
93amazon-nova-experimental-chat (26-01-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1414
94Grok 4 Fast (Non-Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
95Gemini 2.5 Flash Preview (09-2025)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1409
96Grok 4 (0709)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1409
97Grok 4.1 Fast (Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1408
98Gemini 3.1 Flash-Lite PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1408
99GPT-6 Luna (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1407
100GPT-5 ChatClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
101Grok 4 Fast (Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
102Qwen3.5-FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
103GPT-4.5 Preview (2025-02-27)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1403
104o3 (2025-04-16)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1402
105Claude Opus 4 (Thinking 16K, 20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
106Solar Pro 4Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1399
107Hunyuan T1 (20250711)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1399
108GPT-5.3 ChatClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1399
109Grok 4.3Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
110amazon-nova-experimental-chat (10-20)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
111GPT-4.1 (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1384
112GPT-5 mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1380
113GPT-5.4 nano (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1380
114Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1377
115Claude Opus 4 (20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1376
116Grok 3 Mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1375
117Hunyuan TurboS (20250416)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1374
118Gemini 2.5 Flash-Lite Preview (Thinking, 06-17)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1374
119Claude Sonnet 4 (Thinking 32K, 20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1372
120o1 (2024-12-17)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1371
121o3-mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1365
122Mistral Medium 3 (2505)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
123Amazon Nova 2 LiteClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
124Grok 3 Mini BetaClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
125Mercury 2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1362
126Qwen2.5-MaxClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1360
127amazon-nova-experimental-chat (10-09)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1355
128Claude Sonnet 4 (20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1355
129o1-previewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1354
130o4-mini (2025-04-16)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1350
131GPT-4.1 mini (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1349
132Gemini 2.0 Flash (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1346
133Step-1o Turbo (202506)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1335
134Claude 3.7 Sonnet (Thinking 32K, 20250219)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1333
135o1-miniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1333
136o3-miniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1333
137GPT-5 nano (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1328
138Hunyuan TurboS (20250226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1325
139Gemini 2.0 Flash-Lite Preview (02-05)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1324
140Qwen-Plus (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1316
141Claude 3.7 Sonnet (20250219)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1315
142Hunyuan Turbo (0110)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1308
143Claude 3.5 Sonnet (20241022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1305
144Yi LightningClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1302
145Qwen2.5-Plus (1127)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1299
146Step-2 16K Exp (202412)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1299
147Gemini 1.5 Pro (002)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1296
148GLM-4-Plus (0111)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1293
149Hunyuan Large (2025-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1286
150GPT-4.1 nano (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1286
151MercuryClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1284
152GPT-4o (2024-05-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1281
153Claude 3.5 Sonnet (20240620)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1275
154GLM-4-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1273
155Grok 2 (2024-08-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1272
156GPT-4o mini (2024-07-18)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1267
157Magistral Medium (2506)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1267
158Hunyuan Standard (2025-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1264
159GPT-4o (2024-08-06)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1264
160Gemini 1.5 Flash (002)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1257
161Hunyuan Large VisionClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1257
162Grok 2 mini (2024-08-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1255
163Gemini 1.5 Pro (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1255
164Claude 3.5 Haiku (20241022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1251
165GPT-4 Turbo (2024-04-09)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1251
166Gemini Advanced (0514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1248
167Amazon Nova Pro 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1245
168Claude 3 Opus (20240229)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1245
169GPT-4 Turbo Preview (1106)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1241
170GPT-4 Turbo Preview (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1238
171Amazon Nova Lite 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1220
172Gemini 1.5 Flash (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1220
173Hunyuan Standard 256KClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1218
174GLM-4 (0520)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1212
175Reka Core (20240904)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1211
176Gemini 1.5 Flash-8B (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1209
177GPT-4 (0314)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1200
178Claude 3 Sonnet (20240229)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1197
179Amazon Nova Micro 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1191
180Reka Flash (20240904)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1181
181GPT-4 (0613)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1174
182Claude 3 Haiku (20240307)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1174
183Mistral Large (2402)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1167
184Mistral MediumClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1149
185Reka Flash 21B (Online, 20240226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1137
186Reka Flash 21B (20240226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1136
187Gemini Pro (Dev API)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1109
188GPT-3.5 Turbo (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1108
189GPT-3.5 Turbo (1106)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1098
190Gemini ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1094
191PaLM 2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1005
Show the top 20

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.