Model leaderboard

Measured on BenchClub test sets

5 models · 4 test sets · 14 runs

<50%50–75%75–90%≥90%* Some answers cut off or failed

Arena scores (LMArena)

191 models in non-english ranked by LMArena score · updated Nov 11, 2026

#ModelScore
1Gemini 4 Carbon (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1534
2Gemini 4 Argon (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1523
3Claude Fable 5.1 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1507
4Claude Opus 5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1503
5Claude Opus 5 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1500
6Claude Opus 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1495
7Gemini 4 Hydrogen (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1495
8Gemini 3.8 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1492
9Muse Wonder (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1491
10Claude Opus 4.6 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1487
11Gemini 3.7 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1486
12Claude Opus 4.6. Closed weights: ranked by its LMArena score, with no size or downloads to show.1484
13Muse Spark 1.3 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
14Claude Fable 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1482
15Claude Opus 4.7 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1481
16Muse Spark 1.2 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1478
17Gemini 3.5 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1477
18Gemini 3.1 Pro Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1476
19Qwen3.8-Max. Closed weights: ranked by its LMArena score, with no size or downloads to show.1475
20Gemini 3 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1474
21Claude Opus 4.7. Closed weights: ranked by its LMArena score, with no size or downloads to show.1474
22Qwen3.7-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1473
23Gemini 3.5 Flash (Medium). Closed weights: ranked by its LMArena score, with no size or downloads to show.1472
24Muse Spark 1.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1472
25Gemini 3.6 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1470
26GPT-5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
27Qwen3.5-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
28GPT-5.4 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1465
29Muse Spark. Closed weights: ranked by its LMArena score, with no size or downloads to show.1464
30GPT-5.5. Closed weights: ranked by its LMArena score, with no size or downloads to show.1459
31Gemini 3 Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1459
32Claude Sonnet 5.5 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1455
33ERNIE 5.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
34Gemini 2.5 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1452
35Claude Opus 4.8 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1451
36GPT-5.6 Sol (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1450
37GPT-5.4. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
38Qwen3.7-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1445
39Claude Opus 4.8. Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
40GPT-5.6 Terra (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
41Dola Seed 2.0 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
42Grok 4.20 Multi-Agent Beta (0309). Closed weights: ranked by its LMArena score, with no size or downloads to show.1441
43Grok 4.20 Beta (Reasoning, 0309). Closed weights: ranked by its LMArena score, with no size or downloads to show.1441
44Grok 4.5. Closed weights: ranked by its LMArena score, with no size or downloads to show.1440
45Claude Sonnet 4.6. Closed weights: ranked by its LMArena score, with no size or downloads to show.1440
46Gemini 3 Flash (Minimal). Closed weights: ranked by its LMArena score, with no size or downloads to show.1438
47Claude Opus 4.5 (20251101). Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
48Qwen3.6-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
49Claude Opus 4.5 (High, 32K, 20251101). Closed weights: ranked by its LMArena score, with no size or downloads to show.1435
50GPT-6.1 Sol (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1435
51ERNIE-5.0-Preview (1203). Closed weights: ranked by its LMArena score, with no size or downloads to show.1435
52ERNIE 5.0 (0110). Closed weights: ranked by its LMArena score, with no size or downloads to show.1435
53amazon-nova-experimental-chat (26-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1434
54Grok 4.20 Beta 1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1433
55GPT-5.1 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1431
56Claude Sonnet 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1431
57GPT-6 Astra (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1430
58Step 5 Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1429
59Qwen3-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1429
60Gemini 3.5 Flash-Lite. Closed weights: ranked by its LMArena score, with no size or downloads to show.1427
61ERNIE-5.0-Preview (1022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1427
62Grok 4.1 (Thinking). Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
63Claude Sonnet 4.5 (20250929). Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
64GPT-5.2 Chat (20260210). Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
65Qwen3.6-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1424
66Grok 4.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1422
67Grok 4.6 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1421
68ChatGPT-4o Latest (20250326). Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
69Claude Sonnet 4.5 (High, 32K, 20250929). Closed weights: ranked by its LMArena score, with no size or downloads to show.1418
70GPT-5.5 Instant. Closed weights: ranked by its LMArena score, with no size or downloads to show.1417
71GPT-5.6 Luna (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1417
72MiMo-V2-Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1416
73GPT-4.5 Preview (2025-02-27). Closed weights: ranked by its LMArena score, with no size or downloads to show.1413
74GPT-5.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1413
75Gemini 3.1 Flash-Lite Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1411
76Grok 3 Preview (02-24). Closed weights: ranked by its LMArena score, with no size or downloads to show.1411
77Gemini 2.5 Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1409
78Mistral Medium 3.1 (2508). Closed weights: ranked by its LMArena score, with no size or downloads to show.1408
79Claude Opus 4.1 (20250805). Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
80GPT-5.2. Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
81GPT-5.4 mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
82GPT-5.2 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
83amazon-nova-experimental-chat (11-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
84Claude Opus 4.1 (Thinking 16K, 20250805). Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
85MiMo-V2-Omni. Closed weights: ranked by its LMArena score, with no size or downloads to show.1403
86Grok 4 (0709). Closed weights: ranked by its LMArena score, with no size or downloads to show.1403
87o3 (2025-04-16). Closed weights: ranked by its LMArena score, with no size or downloads to show.1401
88Qwen3-Max (2025-09-23). Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
89LongCat-Flash-Chat Exp (2602). Closed weights: ranked by its LMArena score, with no size or downloads to show.1399
90amazon-nova-experimental-chat (12-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
91GPT-5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1397
92Gemini 2.5 Flash Preview (09-2025). Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
93Grok 4 Fast (Non-Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
94GPT-5 Chat. Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
95Hunyuan T1 (20250711). Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
96Grok 4.1 Fast (Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1392
97Grok 4 Fast (Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1388
98GPT-6 Sol (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1387
99Grok 4.7 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1387
100Grok 4.3. Closed weights: ranked by its LMArena score, with no size or downloads to show.1386
101Qwen3.5-Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1385
102Claude Haiku 5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1385
103Hunyuan Vision 1.5 Thinking. Closed weights: ranked by its LMArena score, with no size or downloads to show.1384
104GPT-5.3 Chat. Closed weights: ranked by its LMArena score, with no size or downloads to show.1382
105amazon-nova-experimental-chat (26-01-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1380
106GPT-6 Luna (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1380
107Claude Haiku 4.5 (20251001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1376
108amazon-nova-experimental-chat (10-20). Closed weights: ranked by its LMArena score, with no size or downloads to show.1372
109GPT-4.1 (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1370
110Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025). Closed weights: ranked by its LMArena score, with no size or downloads to show.1369
111Hunyuan TurboS (20250416). Closed weights: ranked by its LMArena score, with no size or downloads to show.1363
112GPT-5 mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1363
113Solar Pro 4. Closed weights: ranked by its LMArena score, with no size or downloads to show.1362
114Claude Opus 4 (Thinking 16K, 20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1362
115Gemini 2.5 Flash-Lite Preview (Thinking, 06-17). Closed weights: ranked by its LMArena score, with no size or downloads to show.1360
116GPT-5.4 nano (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1359
117o1 (2024-12-17). Closed weights: ranked by its LMArena score, with no size or downloads to show.1358
118Mistral Medium 3 (2505). Closed weights: ranked by its LMArena score, with no size or downloads to show.1353
119Grok 3 Mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1352
120Qwen2.5-Max. Closed weights: ranked by its LMArena score, with no size or downloads to show.1352
121Claude Opus 4 (20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1352
122Grok 3 Mini Beta. Closed weights: ranked by its LMArena score, with no size or downloads to show.1348
123Gemini 2.0 Flash (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1342
124amazon-nova-experimental-chat (10-09). Closed weights: ranked by its LMArena score, with no size or downloads to show.1340
125Amazon Nova 2 Lite. Closed weights: ranked by its LMArena score, with no size or downloads to show.1337
126o4-mini (2025-04-16). Closed weights: ranked by its LMArena score, with no size or downloads to show.1336
127Claude Sonnet 4 (Thinking 32K, 20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1333
128Mercury 2. Closed weights: ranked by its LMArena score, with no size or downloads to show.1331
129Claude Sonnet 4 (20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1330
130Gemini 2.0 Flash-Lite Preview (02-05). Closed weights: ranked by its LMArena score, with no size or downloads to show.1323
131o3-mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1319
132GPT-4.1 mini (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1318
133o1-preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1315
134GLM-4-Plus (0111). Closed weights: ranked by its LMArena score, with no size or downloads to show.1314
135GPT-5 nano (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1313
136Step-1o Turbo (202506). Closed weights: ranked by its LMArena score, with no size or downloads to show.1313
137Gemini 1.5 Pro (002). Closed weights: ranked by its LMArena score, with no size or downloads to show.1312
138Qwen-Plus (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1310
139o3-mini. Closed weights: ranked by its LMArena score, with no size or downloads to show.1300
140Hunyuan TurboS (20250226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1298
141Claude 3.7 Sonnet (Thinking 32K, 20250219). Closed weights: ranked by its LMArena score, with no size or downloads to show.1296
142Step-2 16K Exp (202412). Closed weights: ranked by its LMArena score, with no size or downloads to show.1290
143o1-mini. Closed weights: ranked by its LMArena score, with no size or downloads to show.1289
144Claude 3.7 Sonnet (20250219). Closed weights: ranked by its LMArena score, with no size or downloads to show.1286
145Hunyuan Turbo (0110). Closed weights: ranked by its LMArena score, with no size or downloads to show.1285
146Claude 3.5 Sonnet (20241022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1283
147GPT-4o (2024-05-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1283
148Grok 2 (2024-08-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1282
149Gemini 1.5 Flash (002). Closed weights: ranked by its LMArena score, with no size or downloads to show.1278
150GLM-4-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1275
151Gemini Advanced (0514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1274
152Claude 3.5 Sonnet (20240620). Closed weights: ranked by its LMArena score, with no size or downloads to show.1270
153Yi Lightning. Closed weights: ranked by its LMArena score, with no size or downloads to show.1269
154GPT-4o mini (2024-07-18). Closed weights: ranked by its LMArena score, with no size or downloads to show.1266
155Hunyuan Large (2025-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1265
156Qwen2.5-Plus (1127). Closed weights: ranked by its LMArena score, with no size or downloads to show.1265
157Gemini 1.5 Pro (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1264
158GPT-4o (2024-08-06). Closed weights: ranked by its LMArena score, with no size or downloads to show.1262
159Hunyuan Standard (2025-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1261
160GPT-4.1 nano (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1260
161Mercury. Closed weights: ranked by its LMArena score, with no size or downloads to show.1259
162Claude 3 Opus (20240229). Closed weights: ranked by its LMArena score, with no size or downloads to show.1258
163Grok 2 mini (2024-08-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1257
164GPT-4 Turbo Preview (1106). Closed weights: ranked by its LMArena score, with no size or downloads to show.1246
165GPT-4 Turbo (2024-04-09). Closed weights: ranked by its LMArena score, with no size or downloads to show.1245
166GPT-4 Turbo Preview (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1241
167Claude 3.5 Haiku (20241022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1238
168Reka Core (20240904). Closed weights: ranked by its LMArena score, with no size or downloads to show.1237
169Hunyuan Large Vision. Closed weights: ranked by its LMArena score, with no size or downloads to show.1236
170Amazon Nova Pro 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1233
171Magistral Medium (2506). Closed weights: ranked by its LMArena score, with no size or downloads to show.1232
172Gemini 1.5 Flash (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1230
173Gemini 1.5 Flash-8B (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1215
174Amazon Nova Lite 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1208
175Reka Flash (20240904). Closed weights: ranked by its LMArena score, with no size or downloads to show.1207
176Claude 3 Sonnet (20240229). Closed weights: ranked by its LMArena score, with no size or downloads to show.1205
177GLM-4 (0520). Closed weights: ranked by its LMArena score, with no size or downloads to show.1200
178GPT-4 (0314). Closed weights: ranked by its LMArena score, with no size or downloads to show.1194
179Amazon Nova Micro 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1186
180Hunyuan Standard 256K. Closed weights: ranked by its LMArena score, with no size or downloads to show.1178
181Claude 3 Haiku (20240307). Closed weights: ranked by its LMArena score, with no size or downloads to show.1178
182GPT-4 (0613). Closed weights: ranked by its LMArena score, with no size or downloads to show.1160
183Reka Flash 21B (Online, 20240226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1155
184Reka Flash 21B (20240226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1146
185Mistral Large (2402). Closed weights: ranked by its LMArena score, with no size or downloads to show.1142
186Gemini Pro (Dev API). Closed weights: ranked by its LMArena score, with no size or downloads to show.1138
187Mistral Medium. Closed weights: ranked by its LMArena score, with no size or downloads to show.1129
188GPT-3.5 Turbo (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1108
189Gemini Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1094
190GPT-3.5 Turbo (1106). Closed weights: ranked by its LMArena score, with no size or downloads to show.1074
191PaLM 2. Closed weights: ranked by its LMArena score, with no size or downloads to show.916
Show the top 20

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.