Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Phi-4 Non-Thinking, GPT-5 Nano Thinking (5.0), Llama 3 70B 3.3, Llama 3 405B 3.1
Benchmark
Microsoft
OpenAI
Meta
Meta
Arena ELOHuman preference1,2561,3381,318Not in our dataset
LiveBench 1.0General reasoning41.6%Not in our datasetNot in our datasetNot in our dataset
GPQA DiamondScientific knowledge56.1%Not in our dataset50.5%49.0%
MMLU ProMulti-task understandingNot in our datasetNot in our dataset68.9%73.4%
SimpleBenchCommonsense reasoningNot in our datasetNot in our dataset19.9%23.0%
AIME 2025Mathematics17.3%Not in our datasetNot in our datasetNot in our dataset
LiveCodeBenchCompetitive coding25.2%Not in our datasetNot in our datasetNot in our dataset
Terminal-BenchAgentic terminalNot in our dataset7.9%Not in our datasetNot in our dataset
ARC-AGI-2Visual reasoningNot in our dataset2.6%Not in our datasetNot in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationPhi-4 Non-ThinkingGPT-5 Nano Thinking (5.0)Llama 3 70B 3.3Llama 3 405B 3.1
Input$0.07$0.05$0.1$4
Output$0.14$0.4$0.32$4
Context window16K400K131K131K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.