Through an API

Open and closed models answer the same suite-standard 1.0 through their APIs, ranked together. 1 ranked model.

#ModelPass rate
1DeepSeek V4.1 Flash 1017Open weights100%

Model leaderboard

68 models in multi-turn ranked by LMArena score · updated Nov 11, 2026

#ModelScore
1MiMo-V2.5-ProXiaomi MiMo1476
2GLM-5.3Z.ai1474
3GLM-5.1Z.ai1472
4GLM-5.3-FlashZ.ai1471
5GLM-5.2Z.ai1469
6DeepSeek-V4.1-FlashDeepSeek1462
7GLM-5Z.ai1456
8Kimi-K2.6Moonshot AI1454
9gemma-4-31B-itGoogle1452
10GLM-4.7Z.ai1446
11MiMo-V2.5Xiaomi MiMo1445
12Qwen3.5-397B-A17BQwen1445
13Kimi-K2.5Moonshot AI1444
14InklingThinking Machines1442
15gemma-4-26B-A4B-itGoogle1442
16MiniMax-M3MiniMax1439
17Hy3Tencent1438
18Qwen3.8-27BQwen1436
19Mistral-Large-3-675B-Instruct-2512Mistral AI1429
20GLM-4.6Z.ai1427
21Mistral-Medium-3.5-128BMistral AI1424
22DeepSeek-V3.2-ExpDeepSeek1421
23Beam-1.0-501B-A23Breflection1421
24Mistral-Large-4-1T-A52BMistral AI1421
25Inkling-SmallThinking Machines1417
26Qwen3.5-122B-A10BQwen1416
27NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16NVIDIA1415
28GLM-4.5Z.ai1415
29MiniMax-M2.7MiniMax1412
30DeepSeek-V3.1-TerminusDeepSeek1410
31Hy3-previewTencent1410
32Qwen3.5-27BQwen1410
33NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16NVIDIA1410
34Inkling-2-SmallThinking Machines1408
35DeepSeek-V3.1DeepSeek1407
36Qwen3-235B-A22B-Thinking-2507Qwen1407
37DeepSeek-R1-0528DeepSeek1405
38Step-3.5-FlashStepFun1404
39MiMo-V2-FlashXiaomi MiMo1404
40LongCat-Flash-ChatMeituan LongCat1403
41Qwen3-235B-A22BQwen1398
42Muse-Glimmer-30Bmeta-models1397
43DeepSeek-R1DeepSeek1390
44Qwen3.5-35B-A3BQwen1390
45Qwen3-VL-235B-A22B-ThinkingQwen1388
46GLM-4.5-AirZ.ai1371
47NVIDIA-Nemotron-3-Super-120B-A12B-BF16NVIDIA1368
48MiniMax-M2.5MiniMax1364
49MiniMax-M2MiniMax1361
50GLM-4.6VZ.ai1358
51INTELLECT-3Prime Intellect1350
52Qwen3-Next-80B-A3B-ThinkingQwen1346
53GLM-4.7-FlashZ.ai1341
54granite-4.2-30bIBM Granite1340
55gpt-oss-120bOpenAI1340
56GLM-4.5VZ.ai1333
57Qwen3-32BQwen1331
58NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16NVIDIA1324
59Ling-flash-2.0inclusionAI1323
60Trinity-Large-ThinkingArcee AI1321
61NVIDIA-Nemotron-3-Nano-30B-A3B-BF16NVIDIA1319
62QwQ-32BQwen1313
63Qwen3-30B-A3BQwen1307
64granite-4.2-8bIBM Granite1298
65Olmo-3-32B-ThinkAi21290
66granite-4.2-3bIBM Granite1288
67gpt-oss-20bOpenAI1268
68Olmo-3.1-32B-ThinkAi21252
Show the top 20

Score by size

Plot against
Best for its size

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.