Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Claude Haiku 4.5 Non-thinking, Gemini 2.5 Flash-Lite Latest, Claude 3 Sonnet 3.7, v3 v3-0324 (Non-thinking)
Benchmark
Anthropic
Google
Anthropic
DeepSeek
Arena ELOHuman preference1,415Not in our dataset1,3721,395
LiveBench 1.0General reasoningNot in our datasetNot in our datasetNot in our dataset72.4%
GPQA DiamondScientific knowledgeNot in our dataset66.7%68.0%68.4%
HLEAcademic reasoningNot in our dataset6.9%Not in our datasetNot in our dataset
MMLU ProMulti-task understandingNot in our datasetNot in our datasetNot in our dataset81.2%
SimpleBenchCommonsense reasoningNot in our datasetNot in our dataset44.9%27.2%
AIME 2025MathematicsNot in our datasetNot in our datasetNot in our dataset46.7%
GSOGraduate scienceNot in our datasetNot in our dataset3.8%Not in our dataset
AiderCode editingNot in our datasetNot in our dataset60.4%55.1%
SWE-Bench VerifiedAgentic codingNot in our datasetNot in our datasetNot in our dataset38.8%
LiveCodeBenchCompetitive codingNot in our dataset34.3%Not in our dataset27.2%
Tau-BenchAgentic tool useNot in our datasetNot in our datasetNot in our dataset69.1%
Terminal-BenchAgentic terminal28.3%Not in our datasetNot in our datasetNot in our dataset
ARC-AGI-2Visual reasoning1.3%Not in our dataset0.0%Not in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationClaude Haiku 4.5 Non-thinkingGemini 2.5 Flash-Lite LatestClaude 3 Sonnet 3.7v3 v3-0324 (Non-thinking)
Input$1$0.1$3$0.29
Output$5$0.4$15$1.14
Context window200KNot available200K164K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.