Through an API

Open and closed models answer the same suite-standard 1.0 through their APIs, ranked together. 1 ranked model.

#ModelPass rate
1DeepSeek V4.1 Flash 1017Open weights100%

Model leaderboard

32 models in non-english ranked by LMArena score · updated Nov 11, 2026

#ModelScore
32Llama-4-Scout-17B-16E-InstructMeta Llama1252
31Llama-4-Maverick-17B-128E-InstructMeta Llama1269
30gemma-3-4b-itGoogle1273
29Molmo2-8BAi21274
28gemma-3n-E4B-itGoogle1285
27GLM-4.5VZ.ai1303
26gemma-3-12b-itGoogle1318
25gemma-3-27b-itGoogle1334
24GLM-4.6VZ.ai1359
23Qwen3-VL-235B-A22B-ThinkingQwen1377
22Qwen3.5-35B-A3BQwen1378
21Muse-Glimmer-30Bmeta-models1385
20NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16NVIDIA1386
19Qwen3.5-27BQwen1389
18Inkling-2-SmallThinking Machines1390
17Mistral-Large-4-1T-A52BMistral AI1397
16Qwen3.5-122B-A10BQwen1400
15Inkling-SmallThinking Machines1402
14MiMo-V2.5Xiaomi MiMo1404
13Qwen3-VL-235B-A22B-InstructQwen1405
Show all 32 models

Score by size

Plot against
Best for its size

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.