Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Qwen3-0.6B (Thinking) Thinking, Gemma 3n 4B Non-thinking, GPT-4.1 Nano Non-thinking, Gemma 3 4B IT Non-thinking
Benchmark
Qwen
Google
OpenAI
Google
Arena ELOHuman preferenceNot in our dataset1,3181,3221,303
LiveBench 1.0General reasoning30.3%Not in our datasetNot in our datasetNot in our dataset
GPQA DiamondScientific knowledge27.9%23.7%Not in our dataset30.8%
MMLU ProMulti-task understandingNot in our dataset50.6%Not in our dataset43.6%
AIME 2025Mathematics15.1%11.6%Not in our datasetNot in our dataset
AiderCode editingNot in our datasetNot in our dataset8.9%Not in our dataset
LiveCodeBenchCompetitive coding12.3%13.2%Not in our dataset12.6%
ARC-AGI-2Visual reasoningNot in our datasetNot in our dataset0.0%Not in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationQwen3-0.6B (Thinking) ThinkingGemma 3n 4B Non-thinkingGPT-4.1 Nano Non-thinkingGemma 3 4B IT Non-thinking
InputNot available$0.06$0.1$0.05
OutputNot available$0.12$0.4$0.1
Context windowNot available33K1.0M131K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.