Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Gemini 2.0 Flash Reasoning, Llama 4 Scout Non-thinking, GPT-4.1 Mini Non-thinking, o1 Mini Thinking
Benchmark
Google
Meta
OpenAI
OpenAI
Arena ELOHuman preferenceNot in our dataset1,3211,3831,337
LiveBench 1.0General reasoningNot in our dataset47.6%Not in our datasetNot in our dataset
GPQA DiamondScientific knowledgeNot in our dataset57.2%Not in our dataset60.0%
MMLU ProMulti-task understandingNot in our dataset74.3%Not in our datasetNot in our dataset
SimpleBenchCommonsense reasoning30.7%Not in our datasetNot in our dataset18.1%
AIME 2025MathematicsNot in our dataset10.0%Not in our datasetNot in our dataset
AiderCode editing18.2%Not in our dataset32.4%32.9%
LiveCodeBenchCompetitive codingNot in our dataset29.8%Not in our datasetNot in our dataset
ARC-AGI-2Visual reasoningNot in our dataset0.0%0.0%0.8%
Pricing & context Published USD rates per 1M tokens
SpecificationGemini 2.0 Flash ReasoningLlama 4 Scout Non-thinkingGPT-4.1 Mini Non-thinkingo1 Mini Thinking
Input$0.1$0.1$0.8$1.1
Output$0.4$0.3$3.2$4.4
Context window1.0M1.3MNot available128K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.