Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for V4 Pro Thinking, V4.1 Flash Thinking, Claude Opus 4 4.6 Thinking, 3.8 2.4T A95B Thinking
Benchmark
DeepSeek
DeepSeek
Anthropic
Qwen
Arena ELOHuman preference1,4651,4761,503Not in our dataset
LiveBench 1.0General reasoningNot in our dataset81.1%74.5%Not in our dataset
GPQA DiamondScientific knowledge90.1%Not in our dataset91.3%Not in our dataset
HLEAcademic reasoning37.7%Not in our dataset40.0%Not in our dataset
MMLU ProMulti-task understanding87.5%Not in our datasetNot in our datasetNot in our dataset
SimpleBenchCommonsense reasoningNot in our dataset66.7%67.6%62.5%
AIME 2025MathematicsNot in our datasetNot in our dataset95.6%Not in our dataset
GSOGraduate scienceNot in our datasetNot in our dataset41.2%Not in our dataset
SWE-Bench VerifiedAgentic coding80.6%Not in our dataset80.8%Not in our dataset
LiveCodeBenchCompetitive coding89.8%Not in our datasetNot in our datasetNot in our dataset
Tau-BenchAgentic tool use88.9%Not in our dataset91.9%Not in our dataset
Terminal-BenchAgentic terminalNot in our datasetNot in our dataset65.4%Not in our dataset
ARC-AGI-2Visual reasoning61.3%67.5%68.8%Not in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationV4 Pro ThinkingV4.1 Flash ThinkingClaude Opus 4 4.6 Thinking3.8 2.4T A95B Thinking
Input$1.6$0.045$5$2
Output$3.2$0.5$25$6
Context window1.0M1.0M1.0M1.0M
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.