Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

5 benchmarks in common.

4 models selected. 5 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for V4 Pro, GPT-5 Mini Thinking (5.0), o4 Mini o4-mini, R1 DeepSeek-R1-0528
Benchmark
DeepSeek
OpenAI
OpenAI
DeepSeek
Arena ELOHuman preference1,4581,3901,3911,421
LiveBench 1.0General reasoning77.4%Not in our datasetNot in our datasetNot in our dataset
GPQA DiamondScientific knowledge72.9%82.3%81.4%81.0%
HLEAcademic reasoning7.7%16.7%18.1%Not in our dataset
MMLU ProMulti-task understanding82.9%83.7%Not in our dataset85.0%
SimpleBenchCommonsense reasoning50.9%Not in our dataset38.7%40.8%
AIME 2025MathematicsNot in our dataset91.1%92.7%87.5%
GSOGraduate scienceNot in our datasetNot in our dataset3.6%Not in our dataset
AiderCode editingNot in our datasetNot in our dataset72.0%71.6%
SWE-Bench VerifiedAgentic coding73.6%72.0%68.1%57.6%
LiveCodeBenchCompetitive coding56.8%80.4%80.2%73.1%
Tau-BenchAgentic tool useNot in our datasetNot in our dataset65.6%63.9%
Terminal-BenchAgentic terminalNot in our dataset24.0%Not in our datasetNot in our dataset
ARC-AGI-2Visual reasoning0.8%4.4%6.1%1.1%
Pricing & context Published USD rates per 1M tokens
SpecificationV4 ProGPT-5 Mini Thinking (5.0)o4 Mini o4-miniR1 DeepSeek-R1-0528
Input$1.6$0.25$1.1$0.5
Output$3.2$2$4.4$2.15
Context window1.0M400K200K164K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.