Model leaderboard

Measured on BenchClub test sets

5 models · 4 test sets · 14 runs

<50%50–75%75–90%≥90%* Some answers cut off or failed

Arena scores (LMArena)

339 models in instructions ranked by LMArena score · updated Nov 11, 2026

#ModelScore
1Gemini 4 Carbon (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1539
2Gemini 4 Argon (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1536
3Claude Opus 5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1535
4Claude Opus 4.6 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1521
5Claude Fable 5.1 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1520
6Gemini 4 Hydrogen (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1519
7Claude Opus 5 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1518
8Claude Opus 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1515
9Claude Opus 4.6. Closed weights: ranked by its LMArena score, with no size or downloads to show.1510
10Claude Fable 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1503
11Claude Opus 4.7 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1498
12Muse Wonder (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1494
13Gemini 3.8 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1493
14Claude Opus 4.7. Closed weights: ranked by its LMArena score, with no size or downloads to show.1489
15Claude Sonnet 5.5 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1487
16Gemini 3.7 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
17Kimi-K3Moonshot AI1484
18Qwen3.8-Max. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
19GLM-5.3Z.ai1483
20GPT-5.6 Sol (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
21GLM-5.3-FlashZ.ai1480
22Muse Spark 1.3 (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1479
23GPT-5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1478
24Claude Opus 4.5 (High, 32K, 20251101). Closed weights: ranked by its LMArena score, with no size or downloads to show.1478
25Claude Opus 4.8 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1477
26Claude Sonnet 4.6. Closed weights: ranked by its LMArena score, with no size or downloads to show.1476
27MiMo-V2.5-ProXiaomi MiMo1476
28GPT-5.5. Closed weights: ranked by its LMArena score, with no size or downloads to show.1475
29DeepSeek-V4.1-FlashDeepSeek1473
30Claude Opus 4.5 (20251101). Closed weights: ranked by its LMArena score, with no size or downloads to show.1473
31Kimi-K3.1-ProMoonshot AI1472
32GPT-5.4 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1469
33Muse Spark 1.2 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1469
34Qwen3.5-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1467
35Gemini 3.5 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1467
36Gemini 3.6 Flash (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1467
37GLM-5.2Z.ai1467
38Gemini 3.1 Pro Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1465
39Gemini 3.5 Flash (Medium). Closed weights: ranked by its LMArena score, with no size or downloads to show.1465
40GPT-6.1 Sol (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1463
41Claude Opus 4.8. Closed weights: ranked by its LMArena score, with no size or downloads to show.1463
42ERNIE 5.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1462
43Qwen3.7-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1460
44Claude Sonnet 4.5 (20250929). Closed weights: ranked by its LMArena score, with no size or downloads to show.1459
45Gemini 3 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1458
46Claude Sonnet 4.5 (High, 32K, 20250929). Closed weights: ranked by its LMArena score, with no size or downloads to show.1458
47Muse Spark 1.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1457
48GPT-6 Astra (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1456
49GPT-5.6 Terra (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1455
50GPT-5.4. Closed weights: ranked by its LMArena score, with no size or downloads to show.1455
51Claude Sonnet 5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1453
52GLM-5.1Z.ai1452
53Kimi-K2.6Moonshot AI1451
54DeepSeek-V4-ProDeepSeek1448
55Grok 4.5. Closed weights: ranked by its LMArena score, with no size or downloads to show.1446
56MiMo-V2-Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1446
57Step 5 Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1445
58Muse Spark. Closed weights: ranked by its LMArena score, with no size or downloads to show.1443
59GPT-5.1 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
60Qwen3.7-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
61Qwen3.6-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1438
62GPT-5.6 Luna (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
63Gemini 2.5 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
64Gemini 3 Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
65Claude Opus 4.1 (Thinking 16K, 20250805). Closed weights: ranked by its LMArena score, with no size or downloads to show.1435
66MiMo-V2.5Xiaomi MiMo1434
67Claude Opus 4.1 (20250805). Closed weights: ranked by its LMArena score, with no size or downloads to show.1433
68gemma-4-31B-itGoogle1433
69Qwen3.8-27BQwen1431
70Grok 4.6 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1431
71Kimi-K2.5Moonshot AI1431
72MiMo-V2-Omni. Closed weights: ranked by its LMArena score, with no size or downloads to show.1428
73GLM-5Z.ai1428
74MiniMax-M3MiniMax1428
75amazon-nova-experimental-chat (26-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1427
76InklingThinking Machines1427
77Hy3Tencent1426
78Beam-1.0-501B-A23Breflection1424
79Qwen3.5-397B-A17BQwen1424
80Qwen3.6-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1424
81Grok 4.20 Beta (Reasoning, 0309). Closed weights: ranked by its LMArena score, with no size or downloads to show.1421
82DeepSeek-V4-FlashDeepSeek1421
83gemma-4-26B-A4B-itGoogle1421
84Grok 4.20 Multi-Agent Beta (0309). Closed weights: ranked by its LMArena score, with no size or downloads to show.1420
85Qwen3-Max-Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1420
86Gemini 3.5 Flash-Lite. Closed weights: ranked by its LMArena score, with no size or downloads to show.1419
87NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16NVIDIA1418
88GPT-5.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1418
89GPT-5.2 Chat (20260210). Closed weights: ranked by its LMArena score, with no size or downloads to show.1417
90Mistral-Medium-3.5-128BMistral AI1416
91Grok 4.20 Beta 1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1415
92Gemini 3 Flash (Minimal). Closed weights: ranked by its LMArena score, with no size or downloads to show.1415
93Dola Seed 2.0 Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1414
94Claude Haiku 4.5 (20251001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1414
95DeepSeek-V3.2DeepSeek1413
96ERNIE 5.0 (0110). Closed weights: ranked by its LMArena score, with no size or downloads to show.1413
97GLM-4.7Z.ai1412
98Claude Haiku 5.5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1411
99LongCat-Flash-Chat Exp (2602). Closed weights: ranked by its LMArena score, with no size or downloads to show.1411
100GLM-4.6Z.ai1410
101GPT-6 Sol (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1410
102GPT-5.2 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1409
103Mistral-Large-4-1T-A52BMistral AI1409
104Grok 3 Preview (02-24). Closed weights: ranked by its LMArena score, with no size or downloads to show.1409
105Qwen3-235B-A22B-Instruct-2507Qwen1408
106Inkling-2-SmallThinking Machines1408
107GPT-5.5 Instant. Closed weights: ranked by its LMArena score, with no size or downloads to show.1407
108Claude Opus 4 (Thinking 16K, 20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1406
109Qwen3-VL-235B-A22B-InstructQwen1406
110GPT-5.4 mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
111Gemini 2.5 Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
112MiniMax-M2.7MiniMax1405
113Mistral-Large-3-675B-Instruct-2512Mistral AI1405
114DeepSeek-V3.1-TerminusDeepSeek1404
115GLM-4.5Z.ai1404
116GPT-4.5 Preview (2025-02-27). Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
117Grok 4.7 (xHigh). Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
118GPT-6 Luna (Max). Closed weights: ranked by its LMArena score, with no size or downloads to show.1403
119ChatGPT-4o Latest (20250326). Closed weights: ranked by its LMArena score, with no size or downloads to show.1403
120GPT-5.2. Closed weights: ranked by its LMArena score, with no size or downloads to show.1403
121Inkling-SmallThinking Machines1402
122ERNIE-5.0-Preview (1203). Closed weights: ranked by its LMArena score, with no size or downloads to show.1401
123DeepSeek-V3.2-ExpDeepSeek1401
124DeepSeek-V3.1DeepSeek1400
125NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16NVIDIA1400
126Grok 4.1. Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
127Qwen3.5-122B-A10BQwen1399
128Hunyuan Vision 1.5 Thinking. Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
129Mistral Medium 3.1 (2508). Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
130Qwen3-Max (2025-09-23). Closed weights: ranked by its LMArena score, with no size or downloads to show.1398
131LongCat-Flash-ChatMeituan LongCat1397
132Grok 4.1 (Thinking). Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
133Gemini 2.5 Flash Preview (09-2025). Closed weights: ranked by its LMArena score, with no size or downloads to show.1394
134MiMo-V2-FlashXiaomi MiMo1393
135ERNIE-5.0-Preview (1022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1393
136Qwen3.5-27BQwen1392
137Qwen3-Next-80B-A3B-InstructQwen1389
138GPT-5 (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1388
139Grok 4 (0709). Closed weights: ranked by its LMArena score, with no size or downloads to show.1387
140Grok 4 Fast (Non-Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1387
141amazon-nova-experimental-chat (11-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1386
142Qwen3-235B-A22B-Thinking-2507Qwen1386
143amazon-nova-experimental-chat (12-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1386
144Step-3.5-FlashStepFun1385
145Hy3-previewTencent1384
146Grok 4 Fast (Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1382
147DeepSeek-R1-0528DeepSeek1381
148GPT-5 Chat. Closed weights: ranked by its LMArena score, with no size or downloads to show.1381
149amazon-nova-experimental-chat (26-01-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1380
150Qwen3.5-35B-A3BQwen1380
151Gemini 3.1 Flash-Lite Preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1378
152GPT-5.3 Chat. Closed weights: ranked by its LMArena score, with no size or downloads to show.1378
153Grok 4.1 Fast (Reasoning). Closed weights: ranked by its LMArena score, with no size or downloads to show.1376
154Claude Sonnet 4 (Thinking 32K, 20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1376
155Hunyuan T1 (20250711). Closed weights: ranked by its LMArena score, with no size or downloads to show.1375
156Qwen3.5-Flash. Closed weights: ranked by its LMArena score, with no size or downloads to show.1375
157Solar Pro 4. Closed weights: ranked by its LMArena score, with no size or downloads to show.1375
158Qwen3-VL-235B-A22B-ThinkingQwen1374
159Claude Opus 4 (20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1373
160Muse-Glimmer-30Bmeta-models1373
161o3 (2025-04-16). Closed weights: ranked by its LMArena score, with no size or downloads to show.1368
162o1 (2024-12-17). Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
163GPT-4.1 (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
164Gemini 2.5 Flash-Lite Preview (Thinking, 06-17). Closed weights: ranked by its LMArena score, with no size or downloads to show.1366
165Grok 4.3. Closed weights: ranked by its LMArena score, with no size or downloads to show.1366
166amazon-nova-experimental-chat (10-20). Closed weights: ranked by its LMArena score, with no size or downloads to show.1365
167Qwen3-30B-A3B-Instruct-2507Qwen1363
168Qwen3-235B-A22BQwen1362
169GPT-5.4 nano (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1362
170DeepSeek-R1DeepSeek1357
171GPT-5 mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1357
172Grok 3 Mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1357
173Qwen3-Coder-480B-A35B-InstructQwen1355
174Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025). Closed weights: ranked by its LMArena score, with no size or downloads to show.1355
175GLM-4.5-AirZ.ai1353
176MiniMax-M2.5MiniMax1353
177Claude Sonnet 4 (20250514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1352
178Claude 3.7 Sonnet (Thinking 32K, 20250219). Closed weights: ranked by its LMArena score, with no size or downloads to show.1352
179GLM-4.6VZ.ai1351
180granite-4.2-30bIBM Granite1350
181NVIDIA-Nemotron-3-Super-120B-A12B-BF16NVIDIA1347
182Grok 3 Mini Beta. Closed weights: ranked by its LMArena score, with no size or downloads to show.1346
183DeepSeek-V3-0324DeepSeek1345
184Hunyuan TurboS (20250416). Closed weights: ranked by its LMArena score, with no size or downloads to show.1344
185Qwen3-Next-80B-A3B-ThinkingQwen1344
186o1-preview. Closed weights: ranked by its LMArena score, with no size or downloads to show.1342
187Mistral Medium 3 (2505). Closed weights: ranked by its LMArena score, with no size or downloads to show.1339
188o3-mini (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1337
189Gemini 2.0 Flash (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1336
190Amazon Nova 2 Lite. Closed weights: ranked by its LMArena score, with no size or downloads to show.1335
191Qwen2.5-Max. Closed weights: ranked by its LMArena score, with no size or downloads to show.1335
192Trinity-Large-PreviewArcee AI1334
193GPT-4.1 mini (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1333
194Mercury 2. Closed weights: ranked by its LMArena score, with no size or downloads to show.1330
195MiniMax-M2MiniMax1329
196Trinity-Large-ThinkingArcee AI1326
197GLM-4.7-FlashZ.ai1326
198Claude 3.7 Sonnet (20250219). Closed weights: ranked by its LMArena score, with no size or downloads to show.1324
199gemma-3-27b-itGoogle1321
200o4-mini (2025-04-16). Closed weights: ranked by its LMArena score, with no size or downloads to show.1320
201NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16NVIDIA1318
202Ling-flash-2.0inclusionAI1318
203gpt-oss-120bOpenAI1318
204INTELLECT-3Prime Intellect1316
205Hunyuan TurboS (20250226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1316
206o3-mini. Closed weights: ranked by its LMArena score, with no size or downloads to show.1315
207DeepSeek-V3DeepSeek1315
208amazon-nova-experimental-chat (10-09). Closed weights: ranked by its LMArena score, with no size or downloads to show.1314
209Ring-flash-2.0inclusionAI1313
210GLM-4.5VZ.ai1310
211Step-1o Turbo (202506). Closed weights: ranked by its LMArena score, with no size or downloads to show.1310
212Mistral-Small-3.2-24B-Instruct-2506Mistral AI1309
213GPT-5 nano (High). Closed weights: ranked by its LMArena score, with no size or downloads to show.1306
214Qwen3-32BQwen1305
215Gemini 2.0 Flash-Lite Preview (02-05). Closed weights: ranked by its LMArena score, with no size or downloads to show.1305
216o1-mini. Closed weights: ranked by its LMArena score, with no size or downloads to show.1304
217NVIDIA-Nemotron-3-Nano-30B-A3B-BF16NVIDIA1304
218Qwen-Plus (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1303
219gemma-3-12b-itGoogle1299
220Olmo-3.1-32B-InstructAi21299
221granite-4.2-8bIBM Granite1299
222Claude 3.5 Sonnet (20241022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1297
223QwQ-32BQwen1297
224Gemini 1.5 Pro (002). Closed weights: ranked by its LMArena score, with no size or downloads to show.1297
225GLM-4-Plus (0111). Closed weights: ranked by its LMArena score, with no size or downloads to show.1292
226Step-2 16K Exp (202412). Closed weights: ranked by its LMArena score, with no size or downloads to show.1287
227Qwen3-30B-A3BQwen1283
228DeepSeek-V2.5-1210DeepSeek1279
229Hunyuan Turbo (0110). Closed weights: ranked by its LMArena score, with no size or downloads to show.1278
230Yi Lightning. Closed weights: ranked by its LMArena score, with no size or downloads to show.1278
231GPT-4o (2024-05-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1278
232Hunyuan Large (2025-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1277
233Qwen2.5-Plus (1127). Closed weights: ranked by its LMArena score, with no size or downloads to show.1274
234Olmo-3-32B-ThinkAi21274
235granite-4.2-3bIBM Granite1272
236Molmo2-8BAi21270
237Grok 2 (2024-08-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1270
238Claude 3.5 Sonnet (20240620). Closed weights: ranked by its LMArena score, with no size or downloads to show.1269
239granite-4.1-8bIBM Granite1269
240Llama-4-Maverick-17B-128E-InstructMeta Llama1267
241GPT-4o (2024-08-06). Closed weights: ranked by its LMArena score, with no size or downloads to show.1267
242GPT-4.1 nano (2025-04-14). Closed weights: ranked by its LMArena score, with no size or downloads to show.1266
243GLM-4-Plus. Closed weights: ranked by its LMArena score, with no size or downloads to show.1264
244Mistral-Small-3.1-24B-Instruct-2503Mistral AI1263
245Llama-3.1-405B-InstructMeta Llama1258
246GPT-4o mini (2024-07-18). Closed weights: ranked by its LMArena score, with no size or downloads to show.1258
247Gemini 1.5 Flash (002). Closed weights: ranked by its LMArena score, with no size or downloads to show.1257
248gemma-3n-E4B-itGoogle1255
249Qwen2.5-72B-InstructQwen1254
250Gemini 1.5 Pro (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1253
251Magistral Medium (2506). Closed weights: ranked by its LMArena score, with no size or downloads to show.1253
252Gemini Advanced (0514). Closed weights: ranked by its LMArena score, with no size or downloads to show.1253
253Llama-3.1-Nemotron-70B-InstructNVIDIA1252
254Hunyuan Large Vision. Closed weights: ranked by its LMArena score, with no size or downloads to show.1250
255GPT-4 Turbo (2024-04-09). Closed weights: ranked by its LMArena score, with no size or downloads to show.1249
256DeepSeek-V2.5DeepSeek1249
257Claude 3 Opus (20240229). Closed weights: ranked by its LMArena score, with no size or downloads to show.1248
258Llama-4-Scout-17B-16E-InstructMeta Llama1248
259Olmo-3.1-32B-ThinkAi21246
260Hunyuan Standard (2025-02-10). Closed weights: ranked by its LMArena score, with no size or downloads to show.1245
261Grok 2 mini (2024-08-13). Closed weights: ranked by its LMArena score, with no size or downloads to show.1245
262Llama-3.3-70B-InstructMeta Llama1242
263Claude 3.5 Haiku (20241022). Closed weights: ranked by its LMArena score, with no size or downloads to show.1240
264GPT-4 Turbo Preview (1106). Closed weights: ranked by its LMArena score, with no size or downloads to show.1240
265gemma-3-4b-itGoogle1239
266Mercury. Closed weights: ranked by its LMArena score, with no size or downloads to show.1239
267gpt-oss-20bOpenAI1236
268Amazon Nova Pro 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1235
269GPT-4 Turbo Preview (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1235
270Llama-3.1-Tulu-3-70BAi21232
271Llama-3.1-70B-InstructMeta Llama1231
272Qwen2.5-Coder-32B-InstructQwen1223
273granite-4.0-h-smallIBM Granite1222
274Mistral-Small-24B-Instruct-2501Mistral AI1214
275Gemini 1.5 Flash (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1212
276Reka Core (20240904). Closed weights: ranked by its LMArena score, with no size or downloads to show.1212
277gemma-2-27b-itGoogle1206
278Amazon Nova Lite 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1205
279Nemotron-4-340B-InstructNVIDIA1203
280GLM-4 (0520). Closed weights: ranked by its LMArena score, with no size or downloads to show.1203
281Hunyuan Standard 256K. Closed weights: ranked by its LMArena score, with no size or downloads to show.1202
282phi-4Microsoft1201
283GPT-4 (0314). Closed weights: ranked by its LMArena score, with no size or downloads to show.1201
284Claude 3 Sonnet (20240229). Closed weights: ranked by its LMArena score, with no size or downloads to show.1199
285Gemini 1.5 Flash-8B (001). Closed weights: ranked by its LMArena score, with no size or downloads to show.1199
286aya-expanse-32bCohere Labs1196
287Meta-Llama-3-70B-InstructMeta Llama1194
288GPT-4 (0613). Closed weights: ranked by its LMArena score, with no size or downloads to show.1188
289Reka Flash (20240904). Closed weights: ranked by its LMArena score, with no size or downloads to show.1185
290Qwen2-72B-InstructQwen1181
291DeepSeek-Coder-V2-InstructDeepSeek1180
292gemma-2-9b-itGoogle1178
293Llama-3.1-Tulu-3-8BAi21174
294Amazon Nova Micro 1.0. Closed weights: ranked by its LMArena score, with no size or downloads to show.1174
295Claude 3 Haiku (20240307). Closed weights: ranked by its LMArena score, with no size or downloads to show.1173
296Mistral Large (2402). Closed weights: ranked by its LMArena score, with no size or downloads to show.1169
297Llama-3.1-8B-InstructMeta Llama1159
298Qwen1.5-110B-ChatQwen1158
299QwQ-32B-PreviewQwen1156
300aya-expanse-8bCohere Labs1155
301Mistral Medium. Closed weights: ranked by its LMArena score, with no size or downloads to show.1152
302Mixtral-8x22B-Instruct-v0.1Mistral AI1147
303Qwen1.5-72B-ChatQwen1141
304granite-3.1-8b-instructIBM Granite1131
305Reka Flash 21B (Online, 20240226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1129
306Meta-Llama-3-8B-InstructMeta Llama1127
307Reka Flash 21B (20240226). Closed weights: ranked by its LMArena score, with no size or downloads to show.1121
308GPT-3.5 Turbo (0125). Closed weights: ranked by its LMArena score, with no size or downloads to show.1118
309gemma-2-2b-itGoogle1117
310granite-3.1-2b-instructIBM Granite1116
311Qwen1.5-32B-ChatQwen1115
312Gemini Pro (Dev API). Closed weights: ranked by its LMArena score, with no size or downloads to show.1114
313Phi-3-medium-4k-instructMicrosoft1113
314Gemini Pro. Closed weights: ranked by its LMArena score, with no size or downloads to show.1110
315Mixtral-8x7B-Instruct-v0.1Mistral AI1109
316Qwen1.5-14B-ChatQwen1102
317GPT-3.5 Turbo (1106). Closed weights: ranked by its LMArena score, with no size or downloads to show.1092
318Llama-3.2-3B-InstructMeta Llama1089
319granite-3.0-8b-instructIBM Granite1088
320Phi-3-small-8k-instructMicrosoft1086
321deepseek-llm-67b-chatDeepSeek1079
322Llama-2-70b-chat-hfMeta Llama1071
323Mistral-7B-Instruct-v0.2Mistral AI1060
324Qwen1.5-7B-ChatQwen1058
325Phi-3-mini-4k-instructMicrosoft1058
326gemma-1.1-7b-itGoogle1057
327granite-3.0-2b-instructIBM Granite1055
328SOLAR-10.7B-Instruct-v1.0Upstage1046
329Llama-2-13b-chat-hfMeta Llama1045
330Qwen-14B-ChatQwen1031
331Llama-3.2-1B-InstructMeta Llama1031
332Phi-3-mini-128k-instructMicrosoft1023
333gemma-7b-itGoogle1017
334PaLM 2. Closed weights: ranked by its LMArena score, with no size or downloads to show.1010
335Llama-2-7b-chat-hfMeta Llama1006
336gemma-1.1-2b-itGoogle992
337Qwen1.5-4B-ChatQwen978
338OLMo-7B-InstructAi2978
339gemma-2b-itGoogle970
Show the top 20

Score by size

Plot against
Best for its size

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.