Model leaderboard

Measured on BenchClub test sets

5 models · 4 test sets · 14 runs

<50%50–75%75–90%≥90%* Some answers cut off or failed

Arena scores (LMArena)

322 models in expert ranked by LMArena score · updated Nov 11, 2026

#ModelScore
1Gemini 4 Carbon (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1582
2Gemini 4 Hydrogen (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1558
3Gemini 4 Argon (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1555
4Claude Opus 5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1555
5Claude Opus 5 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1552
6Claude Opus 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1552
7Claude Fable 5.1 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1546
8Claude Opus 4.6 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1543
9Claude Opus 4.6. Closed weights: ranked by its LMArena score, with no size or downloads to show.1537
10Claude Fable 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1534
11Gemini 3.8 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1527
12Claude Opus 4.7. Closed weights: ranked by its LMArena score, with no size or downloads to show.1520
13Claude Opus 4.7 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1520
14GLM-5.3Z.ai1519
15GPT-5.6 Sol (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1516
16Kimi-K3Moonshot AI1515
17Gemini 3.7 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1515
18Muse Wonder (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1514
19GLM-5.3-FlashZ.ai1511
20Qwen3.8-Max. Closed weights: ranked by its LMArena score, with no size or downloads to show.1510
21Muse Spark 1.3 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1509
22amazon-nova-experimental-chat (26-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1509
23Claude Sonnet 5.5 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1508
24GPT-5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1506
25GPT-5.4 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1506
26GPT-5.5. Closed weights: ranked by its LMArena score, with no size or downloads to show.1503
27DeepSeek-V4.1-FlashDeepSeek1503
28Claude Opus 4.8 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1502
29MiMo-V2.5-ProXiaomi MiMo1502
30Claude Sonnet 4.6. Closed weights: ranked by its LMArena score, with no size or downloads to show.1501
31GPT-6.1 Sol (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1498
32GPT-5.6 Terra (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1495
33Gemini 3.5 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1494
34GPT-6 Astra (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1493
35ERNIE 5.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1492
36Kimi-K2.6Moonshot AI1492
37Claude Opus 4.8. Closed weights: ranked by its LMArena score, with no size or downloads to show.1491
38Qwen3.7-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1490
39Gemini 3.6 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1489
40Qwen3.5-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1489
41Kimi-K3.1-ProMoonshot AI1489
42GLM-5.2Z.ai1488
43Claude Sonnet 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1488
44Claude Opus 4.5 (20251101). Closed weights: ranked by its LMArena score, with no size or downloads to show.1488
45Muse Spark 1.2 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1486
46Gemini 3.5 Flash (Medium). Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
47Gemini 3.1 Pro Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
48Claude Sonnet 4.5 (High, 32K, 20250929). Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
49GPT-5.4. Closed weights: ranked by its LMArena score, with no size or downloads to show.1481
50Claude Opus 4.5 (High, 32K, 20251101). Closed weights: ranked by its LMArena score, with no size or downloads to show.1481
51Muse Spark 1.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1479
52Qwen3.8-27BQwen1479
53Step 5 Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1478
54MiMo-V2-Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1478
55Inkling-2-SmallThinking Machines1478
56GLM-5.1Z.ai1477
57GPT-5.6 Luna (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1477
58Gemini 3 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1475
59Qwen3.6-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1475
60NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16NVIDIA1473
61Claude Sonnet 4.5 (20250929). Closed weights: ranked by its LMArena score, with no size or downloads to show.1473
62GPT-5.1 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1469
63InklingThinking Machines1469
64Grok 4.6 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1468
65Qwen3.7-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1467
66Grok 4.5. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
67Kimi-K2.5Moonshot AI1465
68gemma-4-31B-itGoogle1465
69Beam-1.0-501B-A23Breflection1464
70DeepSeek-V4-ProDeepSeek1463
71Qwen3-235B-A22B-Thinking-2507Qwen1463
72Gemini 3 Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1463
73Qwen3.5-397B-A17BQwen1462
74MiniMax-M3MiniMax1460
75MiMo-V2.5Xiaomi MiMo1460
76Hy3Tencent1458
77Muse Spark. Closed weights: ranked by its LMArena score, with no size or downloads to show.1457
78GLM-5Z.ai1455
79Qwen3-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1455
80Qwen3.6-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
81LongCat-Flash-Chat Exp (2602). Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
82Gemini 2.5 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1452
83MiMo-V2-Omni. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
84gemma-4-26B-A4B-itGoogle1448
85Grok 4.20 Multi-Agent Beta (0309). Closed weights: ranked by its LMArena score, with no size or downloads to show.1447
86Mistral-Large-4-1T-A52BMistral AI1446
87GPT-5.2 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
88MiniMax-M2.7MiniMax1443
89Claude Haiku 4.5 (20251001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
90Claude Haiku 5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
91Qwen3-VL-235B-A22B-InstructQwen1442
92Qwen3-235B-A22B-Instruct-2507Qwen1442
93DeepSeek-V4-FlashDeepSeek1442
94LongCat-Flash-ChatMeituan LongCat1441
95amazon-nova-experimental-chat (26-01-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1441
96GPT-5.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1440
97Inkling-SmallThinking Machines1440
98Dola Seed 2.0 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1440
99Grok 4.20 Beta (Reasoning, 0309). Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
100Claude Opus 4.1 (Thinking 16K, 20250805). Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
101GPT-6 Sol (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
102GPT-6 Luna (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
103GPT-5.2 Chat (20260210). Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
104GPT-5.4 mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
105DeepSeek-V3.2DeepSeek1435
106GLM-4.5Z.ai1433
107Gemini 3.5 Flash-Lite. Closed weights: ranked by its LMArena score, with no size or downloads to show.1433
108GLM-4.6Z.ai1433
109Mistral-Medium-3.5-128BMistral AI1431
110Qwen3.5-122B-A10BQwen1431
111Grok 4.7 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1431
112amazon-nova-experimental-chat (11-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1430
113Qwen3-VL-235B-A22B-ThinkingQwen1429
114GPT-5.2. Closed weights: ranked by its LMArena score, with no size or downloads to show.1428
115Grok 4.20 Beta 1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1428
116Qwen3.5-27BQwen1428
117Gemini 2.5 Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1427
118ERNIE 5.0 (0110). Closed weights: ranked by its LMArena score, with no size or downloads to show.1426
119MiMo-V2-FlashXiaomi MiMo1426
120Claude Opus 4.1 (20250805). Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
121Solar Pro 4. Closed weights: ranked by its LMArena score, with no size or downloads to show.1425
122Hy3-previewTencent1424
123GLM-4.7Z.ai1424
124DeepSeek-V3.2-ExpDeepSeek1423
125ERNIE-5.0-Preview (1203). Closed weights: ranked by its LMArena score, with no size or downloads to show.1422
126Mistral-Large-3-675B-Instruct-2512Mistral AI1422
127NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16NVIDIA1422
128Grok 3 Preview (02-24). Closed weights: ranked by its LMArena score, with no size or downloads to show.1421
129Step-3.5-FlashStepFun1421
130Gemini 3 Flash (Minimal). Closed weights: ranked by its LMArena score, with no size or downloads to show.1421
131GPT-5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
132Gemini 2.5 Flash Preview (09-2025). Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
133ERNIE-5.0-Preview (1022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1418
134Grok 4.1 (Thinking). Closed weights: ranked by its LMArena score, with no size or downloads to show.1418
135Qwen3-Next-80B-A3B-InstructQwen1417
136Grok 4 (0709). Closed weights: ranked by its LMArena score, with no size or downloads to show.1415
137Grok 4 Fast (Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1413
138Grok 4.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
139Mistral Medium 3.1 (2508). Closed weights: ranked by its LMArena score, with no size or downloads to show.1409
140GPT-5.5 Instant. Closed weights: ranked by its LMArena score, with no size or downloads to show.1408
141granite-4.2-30bIBM Granite1408
142Qwen3.5-35B-A3BQwen1408
143Qwen3.5-Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1408
144DeepSeek-V3.1DeepSeek1405
145amazon-nova-experimental-chat (12-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
146GPT-5 Chat. Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
147o3 (2025-04-16). Closed weights: ranked by its LMArena score, with no size or downloads to show.1402
148ChatGPT-4o Latest (20250326). Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
149Grok 4.1 Fast (Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1399
150NVIDIA-Nemotron-3-Super-120B-A12B-BF16NVIDIA1399
151Gemini 3.1 Flash-Lite Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
152Qwen3-Max (2025-09-23). Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
153Grok 4 Fast (Non-Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1397
154Qwen3-30B-A3B-Instruct-2507Qwen1396
155GPT-5.3 Chat. Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
156Grok 3 Mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
157Hunyuan T1 (20250711). Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
158GPT-5.4 nano (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
159GPT-4.5 Preview (2025-02-27). Closed weights: ranked by its LMArena score, with no size or downloads to show.1394
160DeepSeek-R1-0528DeepSeek1393
161Muse-Glimmer-30Bmeta-models1388
162amazon-nova-experimental-chat (10-20). Closed weights: ranked by its LMArena score, with no size or downloads to show.1386
163Grok 4.3. Closed weights: ranked by its LMArena score, with no size or downloads to show.1386
164Claude Opus 4 (Thinking 16K, 20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1385
165granite-4.2-8bIBM Granite1381
166MiniMax-M2.5MiniMax1380
167GPT-5 mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1379
168Qwen3-Next-80B-A3B-ThinkingQwen1375
169Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025). Closed weights: ranked by its LMArena score, with no size or downloads to show.1374
170Claude Sonnet 4 (Thinking 32K, 20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1372
171GLM-4.6VZ.ai1372
172GLM-4.5-AirZ.ai1370
173Claude Opus 4 (20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1369
174Qwen3-235B-A22BQwen1369
175Grok 3 Mini Beta. Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
176Gemini 2.5 Flash-Lite Preview (Thinking, 06-17). Closed weights: ranked by its LMArena score, with no size or downloads to show.1366
177GPT-4.1 (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1365
178o3-mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
179Qwen3-32BQwen1362
180o1 (2024-12-17). Closed weights: ranked by its LMArena score, with no size or downloads to show.1361
181Mercury 2. Closed weights: ranked by its LMArena score, with no size or downloads to show.1361
182NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16NVIDIA1360
183Trinity-Large-ThinkingArcee AI1359
184Amazon Nova 2 Lite. Closed weights: ranked by its LMArena score, with no size or downloads to show.1359
185GLM-4.7-FlashZ.ai1358
186gpt-oss-120bOpenAI1355
187NVIDIA-Nemotron-3-Nano-30B-A3B-BF16NVIDIA1355
188Ling-flash-2.0inclusionAI1353
189Trinity-Large-PreviewArcee AI1352
190GLM-4.5VZ.ai1351
191DeepSeek-V3-0324DeepSeek1350
192Ring-flash-2.0inclusionAI1343
193o4-mini (2025-04-16). Closed weights: ranked by its LMArena score, with no size or downloads to show.1342
194Mistral Medium 3 (2505). Closed weights: ranked by its LMArena score, with no size or downloads to show.1342
195MiniMax-M2MiniMax1340
196Gemini 2.0 Flash (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1339
197Hunyuan TurboS (20250416). Closed weights: ranked by its LMArena score, with no size or downloads to show.1338
198GPT-4.1 mini (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1338
199Qwen3-Coder-480B-A35B-InstructQwen1338
200o1-preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1337
201DeepSeek-R1DeepSeek1337
202Qwen2.5-Max. Closed weights: ranked by its LMArena score, with no size or downloads to show.1336
203Claude Sonnet 4 (20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1335
204o3-mini. Closed weights: ranked by its LMArena score, with no size or downloads to show.1330
205Qwen-Plus (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1328
206QwQ-32BQwen1323
207INTELLECT-3Prime Intellect1323
208GPT-5 nano (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1321
209Claude 3.7 Sonnet (Thinking 32K, 20250219). Closed weights: ranked by its LMArena score, with no size or downloads to show.1320
210o1-mini. Closed weights: ranked by its LMArena score, with no size or downloads to show.1316
211Qwen3-30B-A3BQwen1314
212granite-4.1-8bIBM Granite1312
213Step-1o Turbo (202506). Closed weights: ranked by its LMArena score, with no size or downloads to show.1307
214Olmo-3.1-32B-InstructAi21306
215granite-4.2-3bIBM Granite1305
216DeepSeek-V3DeepSeek1305
217Gemini 2.0 Flash-Lite Preview (02-05). Closed weights: ranked by its LMArena score, with no size or downloads to show.1304
218gemma-3-27b-itGoogle1303
219Claude 3.7 Sonnet (20250219). Closed weights: ranked by its LMArena score, with no size or downloads to show.1301
220Olmo-3.1-32B-ThinkAi21294
221Mistral-Small-3.2-24B-Instruct-2506Mistral AI1291
222Qwen2.5-Plus (1127). Closed weights: ranked by its LMArena score, with no size or downloads to show.1289
223Yi Lightning. Closed weights: ranked by its LMArena score, with no size or downloads to show.1285
224GLM-4-Plus (0111). Closed weights: ranked by its LMArena score, with no size or downloads to show.1279
225Step-2 16K Exp (202412). Closed weights: ranked by its LMArena score, with no size or downloads to show.1278
226Gemini 1.5 Pro (002). Closed weights: ranked by its LMArena score, with no size or downloads to show.1278
227Hunyuan Large (2025-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1275
228Olmo-3-32B-ThinkAi21273
229GPT-4.1 nano (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1271
230DeepSeek-V2.5-1210DeepSeek1266
231Claude 3.5 Sonnet (20241022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1264
232gpt-oss-20bOpenAI1259
233Llama-4-Maverick-17B-128E-InstructMeta Llama1258
234Mistral-Small-3.1-24B-Instruct-2503Mistral AI1257
235Grok 2 (2024-08-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1253
236Hunyuan Large Vision. Closed weights: ranked by its LMArena score, with no size or downloads to show.1252
237GLM-4-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1252
238granite-4.0-h-smallIBM Granite1251
239GPT-4o (2024-05-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1250
240gemma-3-12b-itGoogle1247
241Hunyuan Standard (2025-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1247
242Claude 3.5 Sonnet (20240620). Closed weights: ranked by its LMArena score, with no size or downloads to show.1247
243gemma-3n-E4B-itGoogle1246
244Qwen2.5-72B-InstructQwen1245
245Gemini 1.5 Pro (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1245
246Llama-3.1-405B-InstructMeta Llama1243
247Llama-3.1-Nemotron-70B-InstructNVIDIA1242
248GPT-4o (2024-08-06). Closed weights: ranked by its LMArena score, with no size or downloads to show.1240
249DeepSeek-V2.5DeepSeek1239
250Grok 2 mini (2024-08-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1238
251Llama-4-Scout-17B-16E-InstructMeta Llama1235
252GPT-4o mini (2024-07-18). Closed weights: ranked by its LMArena score, with no size or downloads to show.1234
253Gemini 1.5 Flash (002). Closed weights: ranked by its LMArena score, with no size or downloads to show.1233
254Llama-3.3-70B-InstructMeta Llama1225
255GPT-4 Turbo (2024-04-09). Closed weights: ranked by its LMArena score, with no size or downloads to show.1223
256gemma-3-4b-itGoogle1223
257Magistral Medium (2506). Closed weights: ranked by its LMArena score, with no size or downloads to show.1223
258Claude 3 Opus (20240229). Closed weights: ranked by its LMArena score, with no size or downloads to show.1222
259Qwen2.5-Coder-32B-InstructQwen1220
260Gemini Advanced (0514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1215
261Reka Core (20240904). Closed weights: ranked by its LMArena score, with no size or downloads to show.1213
262GPT-4 Turbo Preview (1106). Closed weights: ranked by its LMArena score, with no size or downloads to show.1211
263Amazon Nova Pro 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1210
264Llama-3.1-70B-InstructMeta Llama1208
265Claude 3.5 Haiku (20241022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1207
266GPT-4 Turbo Preview (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1205
267phi-4Microsoft1203
268Mistral-Small-24B-Instruct-2501Mistral AI1202
269Amazon Nova Lite 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1201
270Gemini 1.5 Flash (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1199
271Gemini 1.5 Flash-8B (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1185
272Amazon Nova Micro 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1183
273aya-expanse-32bCohere Labs1182
274Reka Flash (20240904). Closed weights: ranked by its LMArena score, with no size or downloads to show.1182
275DeepSeek-Coder-V2-InstructDeepSeek1181
276GLM-4 (0520). Closed weights: ranked by its LMArena score, with no size or downloads to show.1179
277Claude 3 Sonnet (20240229). Closed weights: ranked by its LMArena score, with no size or downloads to show.1172
278gemma-2-27b-itGoogle1171
279Nemotron-4-340B-InstructNVIDIA1171
280Qwen2-72B-InstructQwen1171
281aya-expanse-8bCohere Labs1152
282Meta-Llama-3-70B-InstructMeta Llama1149
283GPT-4 (0314). Closed weights: ranked by its LMArena score, with no size or downloads to show.1149
284Claude 3 Haiku (20240307). Closed weights: ranked by its LMArena score, with no size or downloads to show.1148
285gemma-2-9b-itGoogle1147
286Qwen1.5-110B-ChatQwen1144
287Llama-3.1-8B-InstructMeta Llama1144
288granite-3.1-8b-instructIBM Granite1141
289Qwen1.5-72B-ChatQwen1136
290QwQ-32B-PreviewQwen1134
291granite-3.1-2b-instructIBM Granite1131
292GPT-4 (0613). Closed weights: ranked by its LMArena score, with no size or downloads to show.1128
293Qwen1.5-32B-ChatQwen1126
294Mistral Medium. Closed weights: ranked by its LMArena score, with no size or downloads to show.1125
295Mistral Large (2402). Closed weights: ranked by its LMArena score, with no size or downloads to show.1123
296Reka Flash 21B (Online, 20240226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1116
297Meta-Llama-3-8B-InstructMeta Llama1113
298Mixtral-8x22B-Instruct-v0.1Mistral AI1113
299Phi-3-medium-4k-instructMicrosoft1108
300Reka Flash 21B (20240226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1107
301gemma-2-2b-itGoogle1096
302Qwen1.5-14B-ChatQwen1094
303Llama-3.2-3B-InstructMeta Llama1090
304Mixtral-8x7B-Instruct-v0.1Mistral AI1087
305granite-3.0-8b-instructIBM Granite1087
306GPT-3.5 Turbo (1106). Closed weights: ranked by its LMArena score, with no size or downloads to show.1069
307Phi-3-small-8k-instructMicrosoft1067
308GPT-3.5 Turbo (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1065
309granite-3.0-2b-instructIBM Granite1064
310Gemini Pro (Dev API). Closed weights: ranked by its LMArena score, with no size or downloads to show.1059
311Qwen1.5-7B-ChatQwen1055
312Phi-3-mini-4k-instructMicrosoft1051
313gemma-1.1-7b-itGoogle1039
314Llama-2-70b-chat-hfMeta Llama1039
315Llama-2-7b-chat-hfMeta Llama1036
316Mistral-7B-Instruct-v0.2Mistral AI1036
317Llama-2-13b-chat-hfMeta Llama1030
318Llama-3.2-1B-InstructMeta Llama1007
319gemma-7b-itGoogle1001
320Phi-3-mini-128k-instructMicrosoft984
321Qwen1.5-4B-ChatQwen980
322gemma-1.1-2b-itGoogle970
Show the top 20

Score by size

Plot against
Best for its size

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.