Through an API

Open and closed models answer the same suite-standard 1.0 through their APIs, ranked together. 1 ranked model.

#ModelPass rate
1DeepSeek V4.1 Flash 1017Open weights100%

Model leaderboard

32 models in hard prompts ranked by LMArena score · updated Nov 11, 2026

#ModelScore
1Kimi-K3Moonshot AI1494
2GLM-5.3-FlashZ.ai1490
3DeepSeek-V4.1-FlashDeepSeek1483
4Kimi-K3.1-ProMoonshot AI1471
5Kimi-K2.6Moonshot AI1470
6Qwen3.8-27BQwen1456
7Kimi-K2.5Moonshot AI1453
8InklingThinking Machines1453
9MiMo-V2.5Xiaomi MiMo1450
10Qwen3.5-397B-A17BQwen1448
11gemma-4-31B-itGoogle1447
12MiniMax-M3MiniMax1442
13gemma-4-26B-A4B-itGoogle1439
14Mistral-Large-4-1T-A52BMistral AI1434
15Qwen3-VL-235B-A22B-InstructQwen1428
16Inkling-SmallThinking Machines1425
17Qwen3.5-122B-A10BQwen1421
18Inkling-2-SmallThinking Machines1421
19Qwen3.5-27BQwen1414
20NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16NVIDIA1414
Show all 32 models

Score by size

Plot against
Best for its size

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.