Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for GPT-5.1 Thinking, Claude Opus 4 4.1 Thinking, Grok 4 Fast Non-Thinking, Inkling Thinking
Benchmark
OpenAI
Anthropic
xAI
Thinking Machines
Arena ELOHuman preferenceNot in our dataset1,4501,4181,442
LiveBench 1.0General reasoningNot in our datasetNot in our datasetNot in our dataset71.9%
GPQA DiamondScientific knowledge88.1%81.0%84.3%Not in our dataset
HLEAcademic reasoning26.5%11.7%17.6%Not in our dataset
MMLU ProMulti-task understandingNot in our dataset87.3%Not in our datasetNot in our dataset
SimpleBenchCommonsense reasoningNot in our dataset60.0%56.0%50.0%
AIME 2025MathematicsNot in our dataset78.0%92.0%Not in our dataset
SWE-Bench VerifiedAgentic coding76.3%74.5%50.6%Not in our dataset
Tau-BenchAgentic tool useNot in our dataset86.8%Not in our datasetNot in our dataset
Terminal-BenchAgentic terminalNot in our dataset38.0%Not in our datasetNot in our dataset
ARC-AGI-2Visual reasoning17.6%Not in our datasetNot in our dataset36.5%
Pricing & context Published USD rates per 1M tokens
SpecificationGPT-5.1 ThinkingClaude Opus 4 4.1 ThinkingGrok 4 Fast Non-ThinkingInkling Thinking
Input$1.25$15$0.2$1
Output$10$75$0.5$4.05
Context window400K200K2.0M524K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.