Model leaderboard

Measured on BenchClub test sets

5 models · 4 test sets · 14 runs

<50%50–75%75–90%≥90%* Some answers cut off or failed

Arena scores (LMArena)

183 models in expert ranked by LMArena score · updated Nov 11, 2026

#ModelScore
1Gemini 4 Carbon (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1582
2Gemini 4 Hydrogen (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1558
3Gemini 4 Argon (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1555
4Claude Opus 5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1555
5Claude Opus 5 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1552
6Claude Opus 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1552
7Claude Fable 5.1 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1546
8Claude Opus 4.6 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1543
9Claude Opus 4.6. Closed weights: ranked by its LMArena score, with no size or downloads to show.1537
10Claude Fable 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1534
11Gemini 3.8 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1527
12Claude Opus 4.7. Closed weights: ranked by its LMArena score, with no size or downloads to show.1520
13Claude Opus 4.7 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1520
14GPT-5.6 Sol (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1516
15Gemini 3.7 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1515
16Muse Wonder (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1514
17Qwen3.8-Max. Closed weights: ranked by its LMArena score, with no size or downloads to show.1510
18Muse Spark 1.3 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1509
19amazon-nova-experimental-chat (26-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1509
20Claude Sonnet 5.5 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1508
21GPT-5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1506
22GPT-5.4 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1506
23GPT-5.5. Closed weights: ranked by its LMArena score, with no size or downloads to show.1503
24Claude Opus 4.8 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1502
25Claude Sonnet 4.6. Closed weights: ranked by its LMArena score, with no size or downloads to show.1501
26GPT-6.1 Sol (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1498
27GPT-5.6 Terra (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1495
28Gemini 3.5 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1494
29GPT-6 Astra (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1493
30ERNIE 5.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1492
31Claude Opus 4.8. Closed weights: ranked by its LMArena score, with no size or downloads to show.1491
32Qwen3.7-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1490
33Gemini 3.6 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1489
34Qwen3.5-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1489
35Claude Sonnet 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1488
36Claude Opus 4.5 (20251101). Closed weights: ranked by its LMArena score, with no size or downloads to show.1488
37Muse Spark 1.2 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1486
38Gemini 3.5 Flash (Medium). Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
39Gemini 3.1 Pro Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
40Claude Sonnet 4.5 (High, 32K, 20250929). Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
41GPT-5.4. Closed weights: ranked by its LMArena score, with no size or downloads to show.1481
42Claude Opus 4.5 (High, 32K, 20251101). Closed weights: ranked by its LMArena score, with no size or downloads to show.1481
43Muse Spark 1.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1479
44Step 5 Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1478
45MiMo-V2-Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1478
46GPT-5.6 Luna (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1477
47Gemini 3 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1475
48Qwen3.6-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1475
49Claude Sonnet 4.5 (20250929). Closed weights: ranked by its LMArena score, with no size or downloads to show.1473
50GPT-5.1 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1469
51Grok 4.6 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1468
52Qwen3.7-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1467
53Grok 4.5. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
54Gemini 3 Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1463
55Muse Spark. Closed weights: ranked by its LMArena score, with no size or downloads to show.1457
56Qwen3-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1455
57Qwen3.6-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
58LongCat-Flash-Chat Exp (2602). Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
59Gemini 2.5 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1452
60MiMo-V2-Omni. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
61Grok 4.20 Multi-Agent Beta (0309). Closed weights: ranked by its LMArena score, with no size or downloads to show.1447
62GPT-5.2 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
63Claude Haiku 4.5 (20251001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
64Claude Haiku 5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
65amazon-nova-experimental-chat (26-01-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1441
66GPT-5.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1440
67Dola Seed 2.0 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1440
68Grok 4.20 Beta (Reasoning, 0309). Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
69Claude Opus 4.1 (Thinking 16K, 20250805). Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
70GPT-6 Sol (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
71GPT-6 Luna (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
72GPT-5.2 Chat (20260210). Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
73GPT-5.4 mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
74Gemini 3.5 Flash-Lite. Closed weights: ranked by its LMArena score, with no size or downloads to show.1433
75Grok 4.7 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1431
76amazon-nova-experimental-chat (11-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1430
77GPT-5.2. Closed weights: ranked by its LMArena score, with no size or downloads to show.1428
78Grok 4.20 Beta 1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1428
79Gemini 2.5 Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1427
80ERNIE 5.0 (0110). Closed weights: ranked by its LMArena score, with no size or downloads to show.1426
81Claude Opus 4.1 (20250805). Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
82Solar Pro 4. Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
83ERNIE-5.0-Preview (1203). Closed weights: ranked by its LMArena score, with no size or downloads to show.1422
84Grok 3 Preview (02-24). Closed weights: ranked by its LMArena score, with no size or downloads to show.1421
85Gemini 3 Flash (Minimal). Closed weights: ranked by its LMArena score, with no size or downloads to show.1421
86GPT-5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
87Gemini 2.5 Flash Preview (09-2025). Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
88ERNIE-5.0-Preview (1022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1418
89Grok 4.1 (Thinking). Closed weights: ranked by its LMArena score, with no size or downloads to show.1418
90Grok 4 (0709). Closed weights: ranked by its LMArena score, with no size or downloads to show.1415
91Grok 4 Fast (Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1413
92Grok 4.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
93Mistral Medium 3.1 (2508). Closed weights: ranked by its LMArena score, with no size or downloads to show.1409
94GPT-5.5 Instant. Closed weights: ranked by its LMArena score, with no size or downloads to show.1408
95Qwen3.5-Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1408
96amazon-nova-experimental-chat (12-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
97GPT-5 Chat. Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
98o3 (2025-04-16). Closed weights: ranked by its LMArena score, with no size or downloads to show.1402
99ChatGPT-4o Latest (20250326). Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
100Grok 4.1 Fast (Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1399
101Gemini 3.1 Flash-Lite Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
102Qwen3-Max (2025-09-23). Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
103Grok 4 Fast (Non-Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1397
104GPT-5.3 Chat. Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
105Grok 3 Mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
106Hunyuan T1 (20250711). Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
107GPT-5.4 nano (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
108GPT-4.5 Preview (2025-02-27). Closed weights: ranked by its LMArena score, with no size or downloads to show.1394
109amazon-nova-experimental-chat (10-20). Closed weights: ranked by its LMArena score, with no size or downloads to show.1386
110Grok 4.3. Closed weights: ranked by its LMArena score, with no size or downloads to show.1386
111Claude Opus 4 (Thinking 16K, 20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1385
112GPT-5 mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1379
113Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025). Closed weights: ranked by its LMArena score, with no size or downloads to show.1374
114Claude Sonnet 4 (Thinking 32K, 20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1372
115Claude Opus 4 (20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1369
116Grok 3 Mini Beta. Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
117Gemini 2.5 Flash-Lite Preview (Thinking, 06-17). Closed weights: ranked by its LMArena score, with no size or downloads to show.1366
118GPT-4.1 (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1365
119o3-mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
120o1 (2024-12-17). Closed weights: ranked by its LMArena score, with no size or downloads to show.1361
121Mercury 2. Closed weights: ranked by its LMArena score, with no size or downloads to show.1361
122Amazon Nova 2 Lite. Closed weights: ranked by its LMArena score, with no size or downloads to show.1359
123o4-mini (2025-04-16). Closed weights: ranked by its LMArena score, with no size or downloads to show.1342
124Mistral Medium 3 (2505). Closed weights: ranked by its LMArena score, with no size or downloads to show.1342
125Gemini 2.0 Flash (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1339
126Hunyuan TurboS (20250416). Closed weights: ranked by its LMArena score, with no size or downloads to show.1338
127GPT-4.1 mini (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1338
128o1-preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1337
129Qwen2.5-Max. Closed weights: ranked by its LMArena score, with no size or downloads to show.1336
130Claude Sonnet 4 (20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1335
131o3-mini. Closed weights: ranked by its LMArena score, with no size or downloads to show.1330
132Qwen-Plus (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1328
133GPT-5 nano (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1321
134Claude 3.7 Sonnet (Thinking 32K, 20250219). Closed weights: ranked by its LMArena score, with no size or downloads to show.1320
135o1-mini. Closed weights: ranked by its LMArena score, with no size or downloads to show.1316
136Step-1o Turbo (202506). Closed weights: ranked by its LMArena score, with no size or downloads to show.1307
137Gemini 2.0 Flash-Lite Preview (02-05). Closed weights: ranked by its LMArena score, with no size or downloads to show.1304
138Claude 3.7 Sonnet (20250219). Closed weights: ranked by its LMArena score, with no size or downloads to show.1301
139Qwen2.5-Plus (1127). Closed weights: ranked by its LMArena score, with no size or downloads to show.1289
140Yi Lightning. Closed weights: ranked by its LMArena score, with no size or downloads to show.1285
141GLM-4-Plus (0111). Closed weights: ranked by its LMArena score, with no size or downloads to show.1279
142Step-2 16K Exp (202412). Closed weights: ranked by its LMArena score, with no size or downloads to show.1278
143Gemini 1.5 Pro (002). Closed weights: ranked by its LMArena score, with no size or downloads to show.1278
144Hunyuan Large (2025-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1275
145GPT-4.1 nano (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1271
146Claude 3.5 Sonnet (20241022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1264
147Grok 2 (2024-08-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1253
148Hunyuan Large Vision. Closed weights: ranked by its LMArena score, with no size or downloads to show.1252
149GLM-4-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1252
150GPT-4o (2024-05-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1250
151Hunyuan Standard (2025-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1247
152Claude 3.5 Sonnet (20240620). Closed weights: ranked by its LMArena score, with no size or downloads to show.1247
153Gemini 1.5 Pro (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1245
154GPT-4o (2024-08-06). Closed weights: ranked by its LMArena score, with no size or downloads to show.1240
155Grok 2 mini (2024-08-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1238
156GPT-4o mini (2024-07-18). Closed weights: ranked by its LMArena score, with no size or downloads to show.1234
157Gemini 1.5 Flash (002). Closed weights: ranked by its LMArena score, with no size or downloads to show.1233
158GPT-4 Turbo (2024-04-09). Closed weights: ranked by its LMArena score, with no size or downloads to show.1223
159Magistral Medium (2506). Closed weights: ranked by its LMArena score, with no size or downloads to show.1223
160Claude 3 Opus (20240229). Closed weights: ranked by its LMArena score, with no size or downloads to show.1222
161Gemini Advanced (0514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1215
162Reka Core (20240904). Closed weights: ranked by its LMArena score, with no size or downloads to show.1213
163GPT-4 Turbo Preview (1106). Closed weights: ranked by its LMArena score, with no size or downloads to show.1211
164Amazon Nova Pro 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1210
165Claude 3.5 Haiku (20241022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1207
166GPT-4 Turbo Preview (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1205
167Amazon Nova Lite 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1201
168Gemini 1.5 Flash (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1199
169Gemini 1.5 Flash-8B (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1185
170Amazon Nova Micro 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1183
171Reka Flash (20240904). Closed weights: ranked by its LMArena score, with no size or downloads to show.1182
172GLM-4 (0520). Closed weights: ranked by its LMArena score, with no size or downloads to show.1179
173Claude 3 Sonnet (20240229). Closed weights: ranked by its LMArena score, with no size or downloads to show.1172
174GPT-4 (0314). Closed weights: ranked by its LMArena score, with no size or downloads to show.1149
175Claude 3 Haiku (20240307). Closed weights: ranked by its LMArena score, with no size or downloads to show.1148
176GPT-4 (0613). Closed weights: ranked by its LMArena score, with no size or downloads to show.1128
177Mistral Medium. Closed weights: ranked by its LMArena score, with no size or downloads to show.1125
178Mistral Large (2402). Closed weights: ranked by its LMArena score, with no size or downloads to show.1123
179Reka Flash 21B (Online, 20240226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1116
180Reka Flash 21B (20240226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1107
181GPT-3.5 Turbo (1106). Closed weights: ranked by its LMArena score, with no size or downloads to show.1069
182GPT-3.5 Turbo (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1065
183Gemini Pro (Dev API). Closed weights: ranked by its LMArena score, with no size or downloads to show.1059
Show the top 20

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.