Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

1 benchmarks in common.

4 models selected. 1 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for M2 M2.7, Claude Haiku 5.5 Thinking, 3.8 27B Thinking, Grok 4
Benchmark
MiniMax
Anthropic
Qwen
xAI
Arena ELOHuman preference1,4151,4251,4361,411
LiveBench 1.0General reasoningNot in our dataset72.1%75.3%Not in our dataset
GPQA DiamondScientific knowledge87.0%Not in our datasetNot in our dataset87.5%
HLEAcademic reasoning28.0%30.1%Not in our dataset25.4%
MMLU ProMulti-task understanding81.9%Not in our datasetNot in our dataset86.6%
SimpleBenchCommonsense reasoningNot in our datasetNot in our dataset60.2%60.5%
AIME 2025MathematicsNot in our datasetNot in our datasetNot in our dataset91.7%
AiderCode editingNot in our datasetNot in our datasetNot in our dataset79.6%
SWE-Bench VerifiedAgentic coding72.2%Not in our datasetNot in our datasetNot in our dataset
Tau-BenchAgentic tool use84.9%Not in our datasetNot in our dataset76.5%
Terminal-BenchAgentic terminalNot in our datasetNot in our datasetNot in our dataset23.1%
ARC-AGI-2Visual reasoningNot in our dataset61.3%42.4%16.0%
Pricing & context Published USD rates per 1M tokens
SpecificationM2 M2.7Claude Haiku 5.5 Thinking3.8 27B ThinkingGrok 4
Input$0.255$0.1$0.15$3
Output$1.02$0.5$1.875$15
Context window205K1.0M1.0M256K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.