Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for GPT-5 Codex Non-thinking, Nemotron 3 Ultra 550B-A55B, Claude Sonnet 4 4.5 Thinking, Gemma 4 26B A4B IT Thinking
Benchmark
OpenAI
NVIDIA
Anthropic
Google
Arena ELOHuman preferenceNot in our dataset1,4271,4561,438
LiveBench 1.0General reasoningNot in our dataset67.4%Not in our datasetNot in our dataset
GPQA DiamondScientific knowledgeNot in our datasetNot in our dataset83.4%82.3%
HLEAcademic reasoningNot in our dataset26.7%17.7%8.7%
MMLU ProMulti-task understandingNot in our dataset86.8%87.5%82.6%
SimpleBenchCommonsense reasoningNot in our dataset41.7%54.3%Not in our dataset
AIME 2025MathematicsNot in our datasetNot in our dataset87.0%Not in our dataset
GSOGraduate scienceNot in our datasetNot in our dataset14.7%Not in our dataset
SWE-Bench VerifiedAgentic coding74.5%71.9%77.2%Not in our dataset
LiveCodeBenchCompetitive codingNot in our datasetNot in our datasetNot in our dataset77.1%
Tau-BenchAgentic tool useNot in our dataset86.4%86.2%Not in our dataset
Terminal-BenchAgentic terminal43.4%Not in our dataset42.8%Not in our dataset
ARC-AGI-2Visual reasoningNot in our datasetNot in our dataset13.6%Not in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationGPT-5 Codex Non-thinkingNemotron 3 Ultra 550B-A55BClaude Sonnet 4 4.5 ThinkingGemma 4 26B A4B IT Thinking
Input$0.625$0.6$3$0.095
Output$5$2.4$15$0.284
Context window400K262K1.0M262K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.