Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for 3 235B A22B non-thinking-2507, Kimi K2 0711 Preview, Qwen3-4B (Thinking) Thinking, GPT-5.1
Benchmark
Qwen
Moonshot
Qwen
OpenAI
Arena ELOHuman preference1,4221,418Not in our dataset1,456
LiveBench 1.0General reasoningNot in our dataset76.4%63.6%Not in our dataset
GPQA DiamondScientific knowledgeNot in our dataset75.1%55.9%Not in our dataset
HLEAcademic reasoningNot in our datasetNot in our datasetNot in our dataset6.8%
MMLU ProMulti-task understandingNot in our dataset81.1%74.0%Not in our dataset
SimpleBenchCommonsense reasoningNot in our dataset26.3%Not in our dataset53.2%
AIME 2025MathematicsNot in our dataset49.5%65.6%Not in our dataset
GSOGraduate scienceNot in our dataset4.9%Not in our dataset13.7%
AiderCode editingNot in our dataset60.0%Not in our datasetNot in our dataset
SWE-Bench VerifiedAgentic codingNot in our dataset65.8%Not in our datasetNot in our dataset
LiveCodeBenchCompetitive codingNot in our datasetNot in our dataset54.2%Not in our dataset
Tau-BenchAgentic tool useNot in our dataset70.6%Not in our datasetNot in our dataset
Terminal-BenchAgentic terminalNot in our datasetNot in our datasetNot in our dataset47.6%
ARC-AGI-2Visual reasoning1.3%Not in our datasetNot in our dataset0.4%
Pricing & context Published USD rates per 1M tokens
Specification3 235B A22B non-thinking-2507Kimi K2 0711 PreviewQwen3-4B (Thinking) ThinkingGPT-5.1
Input$0.14$0.57$0$1.25
Output$0.8$2.3$0$10
Context window262K131K41K400K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.