Through an API

Open and closed models answer the same suite-standard 1.0 through their APIs, ranked together. 1 ranked model.

#ModelPass rate
1DeepSeek V4.1 Flash 1017Open weights100%

Model leaderboard

191 models in multi-turn ranked by LMArena score · updated Nov 11, 2026

#ModelScore
1Gemini 4 Carbon (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1569
2Gemini 4 Argon (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1548
3Muse Wonder (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1514
4Claude Opus 4.6 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1512
5Claude Opus 4.7 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1506
6Claude Opus 4.6Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1505
7Claude Fable 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1505
8Claude Opus 4.7Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1504
9Gemini 3.8 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1503
10Claude Opus 5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1502
11Claude Opus 5 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1499
12Muse Spark 1.2 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1498
13Claude Opus 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1494
14Claude Fable 5.1 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1492
15Qwen3.8-MaxClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1492
16Muse Spark 1.3 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1488
17Gemini 3.7 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1487
18Gemini 3.1 Pro PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1486
19Gemini 4 Hydrogen (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
20Muse Spark 1.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
21Gemini 3 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1484
22Gemini 3.6 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
23GPT-5.4 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1482
24Gemini 3.5 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1480
25Qwen3.5-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1478
26Qwen3.7-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1477
27GPT-5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1477
28Muse SparkClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1477
29Gemini 3.5 Flash (Medium)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1477
30Claude Opus 4.8 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1476
31GPT-5.5Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1473
32Claude Opus 4.8Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1472
33Gemini 3 FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1471
34ERNIE 5.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1471
35Claude Opus 4.5 (20251101)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
36Claude Sonnet 4.5 (20250929)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1465
37GPT-5.4Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1464
38Claude Sonnet 4.6Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1463
39GPT-5.6 Sol (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1462
40Claude Sonnet 5.5 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1462
41Claude Opus 4.5 (High, 32K, 20251101)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1460
42Qwen3.7-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1460
43GPT-5.2 Chat (20260210)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1458
44MiMo-V2-ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1457
45Grok 4.20 Beta (Reasoning, 0309)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1456
46Gemini 3 Flash (Minimal)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1455
47GPT-5.6 Terra (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1455
48Grok 4.5Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1455
49ChatGPT-4o Latest (20250326)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
50Claude Sonnet 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
51Qwen3.6-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
52Claude Sonnet 4.5 (High, 32K, 20250929)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1453
53Gemini 2.5 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1452
54Grok 4.20 Multi-Agent Beta (0309)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1452
55Grok 4.20 Beta 1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1451
56GPT-5.1 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1450
57GPT-6.1 Sol (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1449
58GPT-6 Astra (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
59Qwen3-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1446
60MiMo-V2-OmniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1446
61Gemini 3.5 Flash-LiteClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1445
62GPT-4.5 Preview (2025-02-27)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
63Claude Opus 4.1 (Thinking 16K, 20250805)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
64Claude Opus 4.1 (20250805)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
65amazon-nova-experimental-chat (26-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
66Dola Seed 2.0 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1441
67Step 5 PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1440
68Qwen3.6-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1438
69Grok 4.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1438
70GPT-5.6 Luna (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1434
71GPT-5.5 InstantClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1434
72Qwen3-Max (2025-09-23)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1433
73ERNIE 5.0 (0110)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1433
74GPT-5.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1433
75Grok 4.1 (Thinking)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1431
76GPT-5.4 mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1429
77Grok 4.6 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1427
78GPT-5 ChatClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1426
79Hunyuan Vision 1.5 ThinkingClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
80Grok 3 Preview (02-24)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1424
81GPT-5.2 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
82Mistral Medium 3.1 (2508)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
83GPT-5.2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1418
84ERNIE-5.0-Preview (1022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1418
85LongCat-Flash-Chat Exp (2602)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1417
86Gemini 3.1 Flash-Lite PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1417
87Grok 4 (0709)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1416
88GPT-6 Sol (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1414
89Grok 4 Fast (Non-Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1414
90GPT-5.3 ChatClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
91Claude Haiku 4.5 (20251001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1409
92ERNIE-5.0-Preview (1203)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1409
93amazon-nova-experimental-chat (12-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1408
94Gemini 2.5 FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1408
95Grok 4.3Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1407
96o3 (2025-04-16)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
97Grok 4 Fast (Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
98GPT-5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1399
99GPT-4.1 (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
100Gemini 2.5 Flash Preview (09-2025)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1397
101Grok 4.7 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1397
102Claude Opus 4 (Thinking 16K, 20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
103Hunyuan T1 (20250711)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1393
104GPT-6 Luna (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1393
105Qwen3.5-FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1393
106Grok 4.1 Fast (Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1389
107Solar Pro 4Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1389
108Claude Opus 4 (20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1388
109Claude Haiku 5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1388
110Hunyuan TurboS (20250416)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1387
111Mistral Medium 3 (2505)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1384
112GPT-5.4 nano (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1382
113amazon-nova-experimental-chat (26-01-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1380
114amazon-nova-experimental-chat (11-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1379
115Claude Sonnet 4 (Thinking 32K, 20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1376
116o1-previewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1368
117Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1366
118Claude Sonnet 4 (20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1365
119Qwen2.5-MaxClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
120amazon-nova-experimental-chat (10-20)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
121GPT-5 mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1363
122Gemini 2.5 Flash-Lite Preview (Thinking, 06-17)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1360
123Mercury 2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1356
124Grok 3 Mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1355
125o1 (2024-12-17)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1355
126amazon-nova-experimental-chat (10-09)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1355
127GPT-4.1 mini (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1354
128Grok 3 Mini BetaClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1351
129Gemini 2.0 Flash (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1350
130o4-mini (2025-04-16)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1350
131Step-1o Turbo (202506)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1340
132Claude 3.7 Sonnet (20250219)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1339
133Amazon Nova 2 LiteClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1338
134Claude 3.7 Sonnet (Thinking 32K, 20250219)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1337
135Qwen-Plus (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1336
136Claude 3.5 Sonnet (20241022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1326
137GLM-4-Plus (0111)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1324
138o3-mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1320
139Hunyuan TurboS (20250226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1319
140o1-miniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1314
141o3-miniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1313
142Yi LightningClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1311
143GPT-5 nano (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1311
144Gemini 2.0 Flash-Lite Preview (02-05)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1307
145Hunyuan Turbo (0110)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1303
146GPT-4o (2024-05-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1302
147Qwen2.5-Plus (1127)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1299
148Claude 3.5 Sonnet (20240620)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1299
149Gemini 1.5 Pro (002)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1296
150Step-2 16K Exp (202412)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1292
151Grok 2 (2024-08-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1290
152GLM-4-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1289
153GPT-4o mini (2024-07-18)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1285
154Hunyuan Large (2025-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1284
155MercuryClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1282
156GPT-4o (2024-08-06)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1279
157GPT-4.1 nano (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1277
158Claude 3 Opus (20240229)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1275
159Hunyuan Standard (2025-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1275
160Magistral Medium (2506)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1275
161Gemini Advanced (0514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1269
162Gemini 1.5 Pro (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1268
163GPT-4 Turbo (2024-04-09)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1267
164Grok 2 mini (2024-08-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1265
165Claude 3.5 Haiku (20241022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1265
166GPT-4 Turbo Preview (1106)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1257
167Hunyuan Large VisionClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1253
168Gemini 1.5 Flash (002)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1253
169GPT-4 Turbo Preview (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1250
170Amazon Nova Pro 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1245
171Gemini 1.5 Flash (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1227
172Claude 3 Sonnet (20240229)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1227
173Reka Core (20240904)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1226
174GLM-4 (0520)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1218
175GPT-4 (0314)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1206
176Amazon Nova Lite 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1199
177Claude 3 Haiku (20240307)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1190
178Reka Flash (20240904)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1189
179Gemini 1.5 Flash-8B (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1185
180GPT-4 (0613)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1185
181Amazon Nova Micro 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1178
182Hunyuan Standard 256KClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1175
183Mistral Large (2402)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1172
184Reka Flash 21B (Online, 20240226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1151
185Mistral MediumClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1147
186Reka Flash 21B (20240226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1141
187Gemini ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1139
188Gemini Pro (Dev API)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1124
189GPT-3.5 Turbo (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1117
190GPT-3.5 Turbo (1106)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1078
191PaLM 2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.994
Show the top 20

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.