Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Gemma 4 E2B IT Thinking, Phi-4 Mini Reasoning, MistralAI Mistral Large 3, Gemini 2.0 Flash-Lite Non-thinking
Benchmark
Google
Microsoft
Mistral AI
Google
Arena ELOHuman preferenceNot in our datasetNot in our dataset1,4141,354
GPQA DiamondScientific knowledge43.4%44.5%Not in our dataset51.5%
MMLU ProMulti-task understanding60.0%Not in our datasetNot in our dataset71.6%
SimpleBenchCommonsense reasoningNot in our datasetNot in our dataset20.4%Not in our dataset
AIME 2025MathematicsNot in our dataset31.8%Not in our datasetNot in our dataset
LiveCodeBenchCompetitive coding44.0%Not in our datasetNot in our datasetNot in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationGemma 4 E2B IT ThinkingPhi-4 Mini ReasoningMistralAI Mistral Large 3Gemini 2.0 Flash-Lite Non-thinking
InputNot available$0.08$0.5$0.075
OutputNot available$0.35$1.5$0.3
Context windowNot available128K262K1.0M
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.