Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for V4.1 Flash Thinking, V4 Pro Thinking, 3.8 2.4T A95B Thinking, Claude Opus 4 4.6 Thinking
Benchmark
DeepSeek
DeepSeek
Qwen
Anthropic
Arena ELOHuman preference1,4761,465Not in our dataset1,503
LiveBench 1.0General reasoning81.1%Not in our datasetNot in our dataset74.5%
GPQA DiamondScientific knowledgeNot in our dataset90.1%Not in our dataset91.3%
HLEAcademic reasoningNot in our dataset37.7%Not in our dataset40.0%
MMLU ProMulti-task understandingNot in our dataset87.5%Not in our datasetNot in our dataset
SimpleBenchCommonsense reasoning66.7%Not in our dataset62.5%67.6%
AIME 2025MathematicsNot in our datasetNot in our datasetNot in our dataset95.6%
GSOGraduate scienceNot in our datasetNot in our datasetNot in our dataset41.2%
SWE-Bench VerifiedAgentic codingNot in our dataset80.6%Not in our dataset80.8%
LiveCodeBenchCompetitive codingNot in our dataset89.8%Not in our datasetNot in our dataset
Tau-BenchAgentic tool useNot in our dataset88.9%Not in our dataset91.9%
Terminal-BenchAgentic terminalNot in our datasetNot in our datasetNot in our dataset65.4%
ARC-AGI-2Visual reasoning67.5%61.3%Not in our dataset68.8%
Pricing & context Published USD rates per 1M tokens
SpecificationV4.1 Flash ThinkingV4 Pro Thinking3.8 2.4T A95B ThinkingClaude Opus 4 4.6 Thinking
Input$0.045$1.6$2$5
Output$0.5$3.2$6$25
Context window1.0M1.0M1.0M1.0M
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.