Through an API

Open and closed models answer the same suite-standard 1.0 through their APIs, ranked together. 1 ranked model.

#ModelPass rate
1DeepSeek V4.1 Flash 1017Open weights100%

Model leaderboard

338 models in creative writing ranked by LMArena score · updated Nov 11, 2026

#ModelScore
1Gemini 4 Argon (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1533
2Gemini 4 Carbon (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1533
3Claude Opus 5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1532
4Claude Fable 5.1 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1514
5Gemini 4 Hydrogen (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1509
6Claude Opus 4.6 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1504
7Claude Fable 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1494
8Claude Opus 5 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1494
9Gemini 3.8 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1493
10Muse Wonder (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1493
11Claude Opus 4.7 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1486
12Claude Opus 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1486
13Gemini 3.7 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1485
14Claude Opus 4.6Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1484
15Gemini 3.1 Pro PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1483
16Qwen3.8-MaxClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1482
17Gemini 3 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1482
18Claude Opus 4.7Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1479
19Gemini 3.5 Flash (Medium)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1471
20Gemini 3.5 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1469
21Muse Spark 1.3 (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1467
22Gemini 3.6 Flash (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
23Claude Sonnet 5.5 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1466
24Qwen3.5-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1465
25GLM-5.2Z.ai1459
26GLM-5.3Z.ai1459
27Muse SparkClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1459
28Gemini 3 FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1456
29Claude Opus 4.8 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1455
30GPT-5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
31Gemini 2.5 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1454
32GLM-5.1Z.ai1453
33Kimi-K3Moonshot AI1453
34GPT-5.5Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1452
35GPT-5.6 Sol (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1451
36Claude Opus 4.8Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1448
37Qwen3.7-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1447
38DeepSeek-V4-ProDeepSeek1446
39Claude Opus 4.5 (High, 32K, 20251101)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1444
40Claude Opus 4.5 (20251101)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
41Claude Sonnet 4.5 (20250929)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
42Grok 4.5Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1442
43GLM-5.3-FlashZ.ai1442
44ERNIE 5.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1441
45Muse Spark 1.2 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
46Grok 4.20 Beta 1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1439
47Kimi-K3.1-ProMoonshot AI1439
48Qwen3.7-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1438
49DeepSeek-V4.1-FlashDeepSeek1438
50GPT-5.4 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
51MiMo-V2.5-ProXiaomi MiMo1437
52GLM-5Z.ai1437
53Grok 4.20 Multi-Agent Beta (0309)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1437
54Qwen3.6-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1436
55Gemini 3 Flash (Minimal)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1435
56Muse Spark 1.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1435
57Claude Sonnet 4.6Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1435
58Kimi-K2.6Moonshot AI1433
59Grok 4.20 Beta (Reasoning, 0309)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1432
60Grok 4.6 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1428
61GPT-5.1 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1427
62GPT-5.4Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1427
63ERNIE 5.0 (0110)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1426
64Claude Sonnet 4.5 (High, 32K, 20250929)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1424
65Kimi-K2.5Moonshot AI1422
66ERNIE-5.0-Preview (1203)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1422
67GPT-6 Astra (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1421
68Gemini 3.5 Flash-LiteClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1420
69GPT-6.1 Sol (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1420
70GPT-5.5 InstantClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1418
71ERNIE-5.0-Preview (1022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1417
72MiMo-V2-ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1415
73gemma-4-31B-itGoogle1415
74Step 5 PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1415
75Claude Sonnet 5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1414
76Grok 3 Preview (02-24)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1414
77GPT-5.6 Terra (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1414
78GLM-4.6Z.ai1412
79Claude Opus 4.1 (Thinking 16K, 20250805)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1412
80Grok 4.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1411
81Claude Opus 4.1 (20250805)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1411
82Dola Seed 2.0 ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1407
83DeepSeek-R1-0528DeepSeek1405
84Hy3Tencent1405
85ChatGPT-4o Latest (20250326)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1405
86Grok 4.1 (Thinking)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
87Qwen3.6-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1404
88DeepSeek-V3.1-TerminusDeepSeek1403
89GPT-5.1Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1403
90DeepSeek-V3.2-ExpDeepSeek1403
91DeepSeek-V4-FlashDeepSeek1403
92GLM-4.7Z.ai1402
93Qwen3.5-397B-A17BQwen1402
94Gemini 3.1 Flash-Lite PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1402
95Qwen3-Max-PreviewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1402
96gemma-4-26B-A4B-itGoogle1402
97DeepSeek-V3.1DeepSeek1401
98Gemini 2.5 FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
99GPT-5.2 Chat (20260210)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1400
100DeepSeek-V3.2DeepSeek1400
101NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16NVIDIA1399
102GPT-5.6 Luna (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
103Grok 4 (0709)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1396
104InklingThinking Machines1395
105Grok 4.1 Fast (Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1395
106MiniMax-M3MiniMax1395
107GLM-4.5Z.ai1395
108GPT-4.5 Preview (2025-02-27)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1394
109Hunyuan T1 (20250711)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1392
110MiMo-V2-OmniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1392
111MiMo-V2.5Xiaomi MiMo1391
112Mistral Medium 3.1 (2508)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1391
113Hunyuan Vision 1.5 ThinkingClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1389
114Beam-1.0-501B-A23Breflection1388
115LongCat-Flash-Chat Exp (2602)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1388
116Gemini 2.5 Flash Preview (09-2025)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1387
117Claude Opus 4 (Thinking 16K, 20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1387
118Grok 4 Fast (Non-Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1386
119Mistral-Large-3-675B-Instruct-2512Mistral AI1386
120Grok 4.7 (xHigh)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1384
121Qwen3-235B-A22B-Thinking-2507Qwen1384
122Qwen3-Max (2025-09-23)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1380
123Grok 4.3Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1380
124Grok 4 Fast (Reasoning)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1377
125NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16NVIDIA1377
126Qwen3.8-27BQwen1377
127MiMo-V2-FlashXiaomi MiMo1376
128GPT-5.2 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1376
129GPT-5.2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1375
130Qwen3-235B-A22B-Instruct-2507Qwen1375
131Claude Opus 4 (20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1374
132Mistral-Medium-3.5-128BMistral AI1374
133Claude Haiku 4.5 (20251001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1371
134GPT-6 Sol (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1370
135GPT-5.4 mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1369
136Qwen3.5-122B-A10BQwen1368
137Gemini 2.5 Flash-Lite Preview (Thinking, 06-17)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
138amazon-nova-experimental-chat (26-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1367
139Qwen3-VL-235B-A22B-InstructQwen1365
140GPT-5 ChatClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1365
141GPT-5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1365
142DeepSeek-V3-0324DeepSeek1364
143GPT-4.1 (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1364
144Qwen3.5-27BQwen1362
145GPT-6 Luna (Max)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1359
146Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1359
147o3 (2025-04-16)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1359
148Hunyuan TurboS (20250416)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1359
149Qwen3-235B-A22BQwen1357
150Step-3.5-FlashStepFun1357
151GPT-5.3 ChatClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1356
152DeepSeek-R1DeepSeek1354
153MiniMax-M2.7MiniMax1354
154amazon-nova-experimental-chat (11-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1350
155amazon-nova-experimental-chat (12-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1350
156Inkling-2-SmallThinking Machines1348
157o1 (2024-12-17)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1347
158Qwen3.5-35B-A3BQwen1347
159GLM-4.6VZ.ai1346
160LongCat-Flash-ChatMeituan LongCat1345
161gemma-3-27b-itGoogle1345
162Claude Sonnet 4 (Thinking 32K, 20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1345
163Qwen3-VL-235B-A22B-ThinkingQwen1344
164Mistral Medium 3 (2505)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1344
165GLM-4.5-AirZ.ai1343
166Qwen3.5-FlashClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1343
167Mistral-Large-4-1T-A52BMistral AI1343
168Claude Sonnet 4 (20250514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1342
169Grok 3 Mini BetaClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1342
170Muse-Glimmer-30Bmeta-models1341
171Hy3-previewTencent1340
172Gemini 2.0 Flash (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1339
173Qwen2.5-MaxClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1339
174Inkling-SmallThinking Machines1337
175Claude Haiku 5.5 (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1337
176Grok 3 Mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1335
177Qwen3-Next-80B-A3B-InstructQwen1333
178Qwen3-Coder-480B-A35B-InstructQwen1333
179Gemini 1.5 Pro (002)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1333
180Claude 3.7 Sonnet (Thinking 32K, 20250219)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1332
181gemma-3-12b-itGoogle1331
182MiniMax-M2.5MiniMax1330
183DeepSeek-V3DeepSeek1329
184amazon-nova-experimental-chat (26-01-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1329
185Step-2 16K Exp (202412)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1327
186GPT-5 mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1325
187Trinity-Large-PreviewArcee AI1319
188Gemini 2.0 Flash-Lite Preview (02-05)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1319
189o1-previewClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1318
190Qwen3-30B-A3B-Instruct-2507Qwen1317
191INTELLECT-3Prime Intellect1317
192amazon-nova-experimental-chat (10-20)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1317
193Solar Pro 4Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1317
194Claude 3.7 Sonnet (20250219)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1317
195NVIDIA-Nemotron-3-Super-120B-A12B-BF16NVIDIA1315
196Qwen3-Next-80B-A3B-ThinkingQwen1315
197GPT-5.4 nano (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1314
198GLM-4-Plus (0111)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1311
199Trinity-Large-ThinkingArcee AI1308
200Step-1o Turbo (202506)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1307
201amazon-nova-experimental-chat (10-09)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1306
202Mistral-Small-3.2-24B-Instruct-2506Mistral AI1304
203GPT-4.1 mini (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1299
204Qwen3-32BQwen1297
205GLM-4.7-FlashZ.ai1296
206GLM-4.5VZ.ai1295
207o4-mini (2025-04-16)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1294
208Qwen-Plus (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1292
209Claude 3.5 Sonnet (20241022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1292
210Amazon Nova 2 LiteClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1291
211GPT-4o (2024-05-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1291
212Mercury 2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1288
213Ling-flash-2.0inclusionAI1287
214QwQ-32BQwen1287
215MiniMax-M2MiniMax1287
216gemma-3n-E4B-itGoogle1287
217o3-mini (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1286
218Gemini 1.5 Flash (002)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1285
219DeepSeek-V2.5-1210DeepSeek1285
220granite-4.2-30bIBM Granite1285
221Grok 2 (2024-08-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1284
222Gemini Advanced (0514)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1284
223Yi LightningClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1280
224GPT-4o (2024-08-06)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1274
225gpt-oss-120bOpenAI1274
226o3-miniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1273
227Gemini 1.5 Pro (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1272
228Qwen3-30B-A3BQwen1271
229gemma-3-4b-itGoogle1270
230Hunyuan TurboS (20250226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1270
231Ring-flash-2.0inclusionAI1270
232NVIDIA-Nemotron-3-Nano-30B-A3B-BF16NVIDIA1270
233Hunyuan Turbo (0110)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1269
234Llama-3.1-Nemotron-70B-InstructNVIDIA1268
235GPT-4 Turbo (2024-04-09)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1268
236GPT-4o mini (2024-07-18)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1268
237Llama-4-Maverick-17B-128E-InstructMeta Llama1266
238Olmo-3.1-32B-InstructAi21266
239Hunyuan Large (2025-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1264
240GLM-4-PlusClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1263
241Llama-3.1-405B-InstructMeta Llama1262
242Qwen2.5-Plus (1127)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1262
243GPT-4.1 nano (2025-04-14)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1260
244NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16NVIDIA1259
245Olmo-3-32B-ThinkAi21254
246Mistral-Small-3.1-24B-Instruct-2503Mistral AI1253
247granite-4.1-8bIBM Granite1251
248Llama-3.3-70B-InstructMeta Llama1250
249GPT-5 nano (High)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1249
250Llama-4-Scout-17B-16E-InstructMeta Llama1249
251Hunyuan Large VisionClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1248
252Magistral Medium (2506)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1245
253GPT-4 Turbo Preview (1106)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1244
254o1-miniClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1244
255Hunyuan Standard (2025-02-10)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1242
256Grok 2 mini (2024-08-13)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1241
257gemma-2-27b-itGoogle1240
258Claude 3.5 Sonnet (20240620)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1238
259DeepSeek-V2.5DeepSeek1237
260Reka Core (20240904)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1236
261Claude 3 Opus (20240229)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1235
262granite-4.2-8bIBM Granite1235
263Claude 3.5 Haiku (20241022)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1232
264GPT-4 Turbo Preview (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1232
265Llama-3.1-70B-InstructMeta Llama1232
266Llama-3.1-Tulu-3-70BAi21231
267Olmo-3.1-32B-ThinkAi21227
268Gemini 1.5 Flash (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1222
269Qwen2.5-72B-InstructQwen1221
270Gemini 1.5 Flash-8B (001)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1217
271Amazon Nova Pro 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1212
272granite-4.0-h-smallIBM Granite1210
273Meta-Llama-3-70B-InstructMeta Llama1210
274gemma-2-9b-itGoogle1205
275granite-4.2-3bIBM Granite1204
276Nemotron-4-340B-InstructNVIDIA1202
277Reka Flash (20240904)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1202
278gpt-oss-20bOpenAI1202
279aya-expanse-32bCohere Labs1200
280GLM-4 (0520)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1198
281Amazon Nova Lite 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1197
282Mistral-Small-24B-Instruct-2501Mistral AI1195
283GPT-4 (0613)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1191
284GPT-4 (0314)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1190
285MercuryClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1187
286Claude 3 Sonnet (20240229)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1186
287phi-4Microsoft1181
288Llama-3.1-Tulu-3-8BAi21181
289Qwen2-72B-InstructQwen1181
290Qwen2.5-Coder-32B-InstructQwen1174
291Amazon Nova Micro 1.0Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1172
292aya-expanse-8bCohere Labs1168
293Hunyuan Standard 256KClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1165
294Mistral Large (2402)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1161
295Mistral MediumClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1158
296Claude 3 Haiku (20240307)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1157
297Llama-3.1-8B-InstructMeta Llama1154
298Meta-Llama-3-8B-InstructMeta Llama1150
299Qwen1.5-110B-ChatQwen1148
300gemma-2-2b-itGoogle1147
301Mixtral-8x22B-Instruct-v0.1Mistral AI1141
302Qwen1.5-72B-ChatQwen1137
303QwQ-32B-PreviewQwen1134
304Reka Flash 21B (Online, 20240226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1130
305Gemini Pro (Dev API)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1130
306granite-3.1-8b-instructIBM Granite1129
307Reka Flash 21B (20240226)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1124
308DeepSeek-Coder-V2-InstructDeepSeek1120
309granite-3.1-2b-instructIBM Granite1116
310Mixtral-8x7B-Instruct-v0.1Mistral AI1109
311Phi-3-medium-4k-instructMicrosoft1106
312Gemini ProClosed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1104
313Llama-3.2-3B-InstructMeta Llama1094
314GPT-3.5 Turbo (0125)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1092
315Qwen1.5-14B-ChatQwen1090
316SOLAR-10.7B-Instruct-v1.0Upstage1089
317Qwen1.5-32B-ChatQwen1083
318Phi-3-small-8k-instructMicrosoft1083
319Llama-2-70b-chat-hfMeta Llama1075
320granite-3.0-8b-instructIBM Granite1071
321Mistral-7B-Instruct-v0.2Mistral AI1068
322deepseek-llm-67b-chatDeepSeek1067
323gemma-1.1-7b-itGoogle1059
324Llama-2-13b-chat-hfMeta Llama1047
325granite-3.0-2b-instructIBM Granite1046
326Phi-3-mini-4k-instructMicrosoft1044
327GPT-3.5 Turbo (1106)Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.1035
328Qwen1.5-7B-ChatQwen1034
329Llama-2-7b-chat-hfMeta Llama1033
330Llama-3.2-1B-InstructMeta Llama1033
331Qwen-14B-ChatQwen1028
332Phi-3-mini-128k-instructMicrosoft1024
333gemma-7b-itGoogle1023
334gemma-1.1-2b-itGoogle998
335PaLM 2Closed. Closed weights: ranked by its LMArena score, with no size or downloads to show.991
336OLMo-7B-InstructAi2990
337gemma-2b-itGoogle986
338Qwen1.5-4B-ChatQwen969
Show the top 20

Score by size

Plot against
Best for its size

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.