Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Claude Sonnet 4 4.0 Non-thinking, M1 Reasoning 80K, Kimi K2 0711 Preview, 3 235B A22B non-thinking-2507
Benchmark
Anthropic
MiniMax
Moonshot
Qwen
Arena ELOHuman preference1,391Not in our dataset1,4181,422
LiveBench 1.0General reasoning74.8%Not in our dataset76.4%Not in our dataset
GPQA DiamondScientific knowledge70.0%70.0%75.1%Not in our dataset
HLEAcademic reasoning5.5%8.4%Not in our datasetNot in our dataset
MMLU ProMulti-task understanding83.7%81.1%81.1%Not in our dataset
SimpleBenchCommonsense reasoningNot in our datasetNot in our dataset26.3%Not in our dataset
AIME 2025Mathematics33.1%76.9%49.5%Not in our dataset
GSOGraduate science4.9%Not in our dataset4.9%Not in our dataset
AiderCode editing56.4%Not in our dataset60.0%Not in our dataset
SWE-Bench VerifiedAgentic coding72.7%56.0%65.8%Not in our dataset
LiveCodeBenchCompetitive coding47.1%Not in our datasetNot in our datasetNot in our dataset
Tau-BenchAgentic tool use75.0%63.5%70.6%Not in our dataset
ARC-AGI-2Visual reasoning1.3%Not in our datasetNot in our dataset1.3%
Pricing & context Published USD rates per 1M tokens
SpecificationClaude Sonnet 4 4.0 Non-thinkingM1 Reasoning 80KKimi K2 0711 Preview3 235B A22B non-thinking-2507
Input$3$0.55$0.57$0.14
Output$15$2.2$2.3$0.8
Context window200K1.0M131K262K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.