Model leaderboard

Measured on BenchClub test sets

5 models · 4 test sets · 14 runs

<50%50–75%75–90%≥90%* Some answers cut off or failed

Arena scores (LMArena)

191 models in coding ranked by LMArena score · updated Nov 11, 2026

#ModelScore
1Gemini 4 Carbon (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1564
2Claude Opus 5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1543
3Gemini 4 Argon (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1540
4Claude Opus 4.6. Closed weights: ranked by its LMArena score, with no size or downloads to show.1534
5Claude Opus 5 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1532
6Claude Opus 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1531
7Claude Opus 4.6 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1531
8Claude Fable 5.1 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1527
9Claude Opus 4.7 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1519
10Claude Fable 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1519
11Gemini 4 Hydrogen (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1516
12Muse Wonder (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1516
13Claude Opus 4.7. Closed weights: ranked by its LMArena score, with no size or downloads to show.1515
14Gemini 3.8 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1510
15Muse Spark 1.3 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1509
16Muse Spark 1.2 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1506
17Claude Sonnet 4.6. Closed weights: ranked by its LMArena score, with no size or downloads to show.1503
18Claude Opus 4.5 (High, 32K, 20251101). Closed weights: ranked by its LMArena score, with no size or downloads to show.1503
19Qwen3.8-Max. Closed weights: ranked by its LMArena score, with no size or downloads to show.1502
20Claude Sonnet 5.5 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1501
21Gemini 3.7 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1500
22Claude Opus 4.5 (20251101). Closed weights: ranked by its LMArena score, with no size or downloads to show.1499
23Muse Spark 1.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1498
24Qwen3.7-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1498
25GPT-5.4 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1497
26GPT-5.6 Sol (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1495
27GPT-6 Astra (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1494
28GPT-5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1494
29Gemini 3.5 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1493
30Gemini 3.6 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1492
31Claude Opus 4.8 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1491
32Claude Sonnet 4.5 (High, 32K, 20250929). Closed weights: ranked by its LMArena score, with no size or downloads to show.1488
33ERNIE 5.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1488
34Gemini 3.5 Flash (Medium). Closed weights: ranked by its LMArena score, with no size or downloads to show.1487
35Qwen3.5-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1487
36Claude Opus 4.8. Closed weights: ranked by its LMArena score, with no size or downloads to show.1487
37GPT-6.1 Sol (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1486
38GPT-5.6 Terra (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
39Claude Sonnet 4.5 (20250929). Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
40Claude Sonnet 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
41amazon-nova-experimental-chat (26-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
42Gemini 3.1 Pro Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
43GPT-5.5. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
44Step 5 Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1482
45Muse Spark. Closed weights: ranked by its LMArena score, with no size or downloads to show.1482
46Gemini 3 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1481
47Claude Opus 4.1 (Thinking 16K, 20250805). Closed weights: ranked by its LMArena score, with no size or downloads to show.1479
48GPT-5.4. Closed weights: ranked by its LMArena score, with no size or downloads to show.1479
49MiMo-V2-Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1476
50Grok 4.5. Closed weights: ranked by its LMArena score, with no size or downloads to show.1474
51Qwen3.7-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1473
52Claude Opus 4.1 (20250805). Closed weights: ranked by its LMArena score, with no size or downloads to show.1473
53Dola Seed 2.0 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1472
54LongCat-Flash-Chat Exp (2602). Closed weights: ranked by its LMArena score, with no size or downloads to show.1470
55Qwen3.6-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1470
56Qwen3.6-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1467
57GPT-5.6 Luna (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1467
58MiMo-V2-Omni. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
59Grok 4.6 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1464
60Gemini 3 Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1459
61Grok 4.20 Beta (Reasoning, 0309). Closed weights: ranked by its LMArena score, with no size or downloads to show.1459
62Grok 4.20 Multi-Agent Beta (0309). Closed weights: ranked by its LMArena score, with no size or downloads to show.1458
63Qwen3-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1456
64ERNIE 5.0 (0110). Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
65Claude Haiku 5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
66Claude Haiku 4.5 (20251001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1453
67Gemini 3.5 Flash-Lite. Closed weights: ranked by its LMArena score, with no size or downloads to show.1453
68GPT-5.1 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1453
69Gemini 2.5 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1451
70GPT-6 Sol (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1449
71amazon-nova-experimental-chat (26-01-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1447
72Grok 4.20 Beta 1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1447
73GPT-5.2 Chat (20260210). Closed weights: ranked by its LMArena score, with no size or downloads to show.1447
74Grok 4.1 (Thinking). Closed weights: ranked by its LMArena score, with no size or downloads to show.1445
75Grok 4.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
76Claude Opus 4 (Thinking 16K, 20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
77GPT-5.2 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1441
78Qwen3-Max (2025-09-23). Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
79GPT-5.4 mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
80GPT-5.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
81Solar Pro 4. Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
82GPT-5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
83Gemini 3 Flash (Minimal). Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
84Mistral Medium 3.1 (2508). Closed weights: ranked by its LMArena score, with no size or downloads to show.1434
85GPT-5.5 Instant. Closed weights: ranked by its LMArena score, with no size or downloads to show.1433
86amazon-nova-experimental-chat (11-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1433
87Grok 3 Preview (02-24). Closed weights: ranked by its LMArena score, with no size or downloads to show.1432
88GPT-5.2. Closed weights: ranked by its LMArena score, with no size or downloads to show.1432
89amazon-nova-experimental-chat (12-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1431
90GPT-6 Luna (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1431
91Grok 4 Fast (Non-Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1429
92ERNIE-5.0-Preview (1203). Closed weights: ranked by its LMArena score, with no size or downloads to show.1426
93Grok 4.7 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
94Gemini 2.5 Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1424
95Grok 4 Fast (Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1420
96Hunyuan Vision 1.5 Thinking. Closed weights: ranked by its LMArena score, with no size or downloads to show.1420
97Claude Sonnet 4 (Thinking 32K, 20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1414
98Grok 4.3. Closed weights: ranked by its LMArena score, with no size or downloads to show.1414
99amazon-nova-experimental-chat (10-20). Closed weights: ranked by its LMArena score, with no size or downloads to show.1413
100ChatGPT-4o Latest (20250326). Closed weights: ranked by its LMArena score, with no size or downloads to show.1413
101Qwen3.5-Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
102Grok 4.1 Fast (Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
103ERNIE-5.0-Preview (1022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1411
104Grok 4 (0709). Closed weights: ranked by its LMArena score, with no size or downloads to show.1409
105o3 (2025-04-16). Closed weights: ranked by its LMArena score, with no size or downloads to show.1407
106GPT-5.3 Chat. Closed weights: ranked by its LMArena score, with no size or downloads to show.1407
107GPT-5 mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1406
108GPT-5.4 nano (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
109Claude Opus 4 (20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1402
110Gemini 2.5 Flash Preview (09-2025). Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
111Gemini 3.1 Flash-Lite Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
112GPT-5 Chat. Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
113GPT-4.5 Preview (2025-02-27). Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
114Mercury 2. Closed weights: ranked by its LMArena score, with no size or downloads to show.1391
115GPT-4.1 (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1391
116Hunyuan T1 (20250711). Closed weights: ranked by its LMArena score, with no size or downloads to show.1390
117Mistral Medium 3 (2505). Closed weights: ranked by its LMArena score, with no size or downloads to show.1386
118Amazon Nova 2 Lite. Closed weights: ranked by its LMArena score, with no size or downloads to show.1386
119Claude Sonnet 4 (20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1379
120Grok 3 Mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1379
121o3-mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1378
122Gemini 2.5 Flash-Lite Preview (Thinking, 06-17). Closed weights: ranked by its LMArena score, with no size or downloads to show.1373
123Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025). Closed weights: ranked by its LMArena score, with no size or downloads to show.1372
124amazon-nova-experimental-chat (10-09). Closed weights: ranked by its LMArena score, with no size or downloads to show.1370
125o4-mini (2025-04-16). Closed weights: ranked by its LMArena score, with no size or downloads to show.1368
126GPT-4.1 mini (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
127o1 (2024-12-17). Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
128Grok 3 Mini Beta. Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
129o1-preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
130o3-mini. Closed weights: ranked by its LMArena score, with no size or downloads to show.1363
131o1-mini. Closed weights: ranked by its LMArena score, with no size or downloads to show.1362
132Hunyuan TurboS (20250416). Closed weights: ranked by its LMArena score, with no size or downloads to show.1361
133Claude 3.7 Sonnet (Thinking 32K, 20250219). Closed weights: ranked by its LMArena score, with no size or downloads to show.1361
134Qwen2.5-Max. Closed weights: ranked by its LMArena score, with no size or downloads to show.1359
135GPT-5 nano (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1351
136Gemini 2.0 Flash (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1350
137Hunyuan TurboS (20250226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1342
138Claude 3.5 Sonnet (20241022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1342
139Step-1o Turbo (202506). Closed weights: ranked by its LMArena score, with no size or downloads to show.1339
140Claude 3.7 Sonnet (20250219). Closed weights: ranked by its LMArena score, with no size or downloads to show.1339
141Qwen-Plus (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1328
142Mercury. Closed weights: ranked by its LMArena score, with no size or downloads to show.1322
143Gemini 2.0 Flash-Lite Preview (02-05). Closed weights: ranked by its LMArena score, with no size or downloads to show.1322
144Hunyuan Turbo (0110). Closed weights: ranked by its LMArena score, with no size or downloads to show.1319
145Magistral Medium (2506). Closed weights: ranked by its LMArena score, with no size or downloads to show.1319
146Step-2 16K Exp (202412). Closed weights: ranked by its LMArena score, with no size or downloads to show.1316
147Qwen2.5-Plus (1127). Closed weights: ranked by its LMArena score, with no size or downloads to show.1314
148Yi Lightning. Closed weights: ranked by its LMArena score, with no size or downloads to show.1312
149Hunyuan Large Vision. Closed weights: ranked by its LMArena score, with no size or downloads to show.1308
150Hunyuan Large (2025-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1307
151Claude 3.5 Sonnet (20240620). Closed weights: ranked by its LMArena score, with no size or downloads to show.1306
152GPT-4.1 nano (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1306
153GPT-4o (2024-05-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1297
154Gemini 1.5 Pro (002). Closed weights: ranked by its LMArena score, with no size or downloads to show.1294
155GLM-4-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1290
156GPT-4o mini (2024-07-18). Closed weights: ranked by its LMArena score, with no size or downloads to show.1290
157Grok 2 (2024-08-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1287
158GLM-4-Plus (0111). Closed weights: ranked by its LMArena score, with no size or downloads to show.1287
159Claude 3.5 Haiku (20241022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1286
160GPT-4o (2024-08-06). Closed weights: ranked by its LMArena score, with no size or downloads to show.1283
161Amazon Nova Pro 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1270
162Hunyuan Standard (2025-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1270
163Grok 2 mini (2024-08-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1268
164GPT-4 Turbo (2024-04-09). Closed weights: ranked by its LMArena score, with no size or downloads to show.1268
165Gemini 1.5 Pro (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1266
166Claude 3 Opus (20240229). Closed weights: ranked by its LMArena score, with no size or downloads to show.1264
167Gemini 1.5 Flash (002). Closed weights: ranked by its LMArena score, with no size or downloads to show.1261
168Gemini Advanced (0514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1255
169GPT-4 Turbo Preview (1106). Closed weights: ranked by its LMArena score, with no size or downloads to show.1254
170GPT-4 Turbo Preview (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1249
171Amazon Nova Lite 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1239
172Gemini 1.5 Flash (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1236
173Hunyuan Standard 256K. Closed weights: ranked by its LMArena score, with no size or downloads to show.1231
174Reka Core (20240904). Closed weights: ranked by its LMArena score, with no size or downloads to show.1230
175GLM-4 (0520). Closed weights: ranked by its LMArena score, with no size or downloads to show.1228
176Claude 3 Sonnet (20240229). Closed weights: ranked by its LMArena score, with no size or downloads to show.1223
177Amazon Nova Micro 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1218
178Gemini 1.5 Flash-8B (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1218
179GPT-4 (0314). Closed weights: ranked by its LMArena score, with no size or downloads to show.1209
180Claude 3 Haiku (20240307). Closed weights: ranked by its LMArena score, with no size or downloads to show.1199
181Reka Flash (20240904). Closed weights: ranked by its LMArena score, with no size or downloads to show.1190
182GPT-4 (0613). Closed weights: ranked by its LMArena score, with no size or downloads to show.1187
183Mistral Large (2402). Closed weights: ranked by its LMArena score, with no size or downloads to show.1183
184Reka Flash 21B (Online, 20240226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1164
185Mistral Medium. Closed weights: ranked by its LMArena score, with no size or downloads to show.1162
186Reka Flash 21B (20240226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1154
187GPT-3.5 Turbo (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1136
188GPT-3.5 Turbo (1106). Closed weights: ranked by its LMArena score, with no size or downloads to show.1116
189Gemini Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1108
190Gemini Pro (Dev API). Closed weights: ranked by its LMArena score, with no size or downloads to show.1104
191PaLM 2. Closed weights: ranked by its LMArena score, with no size or downloads to show.994
Show the top 20

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.