Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

1 benchmarks in common.

4 models selected. 1 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Claude Sonnet 4 4.0 Thinking, Grok 4.3, 3 235B A22B thinking-2507, Kimi K2 0905 Preview
Benchmark
Anthropic
xAI
Qwen
Moonshot
Arena ELOHuman preference1,4021,4421,4001,418
LiveBench 1.0General reasoningNot in our dataset62.3%Not in our datasetNot in our dataset
GPQA DiamondScientific knowledge76.1%Not in our datasetNot in our dataset74.2%
HLEAcademic reasoning7.8%Not in our dataset15.8%Not in our dataset
MMLU ProMulti-task understandingNot in our datasetNot in our dataset84.5%81.9%
SimpleBenchCommonsense reasoning45.5%Not in our datasetNot in our datasetNot in our dataset
AIME 2025Mathematics70.5%Not in our datasetNot in our dataset51.0%
AiderCode editing61.3%Not in our datasetNot in our datasetNot in our dataset
SWE-Bench VerifiedAgentic coding72.7%Not in our datasetNot in our dataset69.2%
LiveCodeBenchCompetitive coding55.9%Not in our datasetNot in our datasetNot in our dataset
Tau-BenchAgentic tool use83.8%Not in our dataset71.9%Not in our dataset
ARC-AGI-2Visual reasoning5.9%Not in our datasetNot in our datasetNot in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationClaude Sonnet 4 4.0 ThinkingGrok 4.33 235B A22B thinking-2507Kimi K2 0905 Preview
Input$3$1.25$0.45$0.6
Output$15$2.5$3.5$2.5
Context window200K1.0M128K262K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.