Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Llama 3 405B 3.1, Llama 3 70B 3.3, Command A Non-thinking, Phi-4 Non-Thinking
Benchmark
Meta
Meta
Cohere
Microsoft
Arena ELOHuman preferenceNot in our dataset1,3181,3541,256
LiveBench 1.0General reasoningNot in our datasetNot in our datasetNot in our dataset41.6%
GPQA DiamondScientific knowledge49.0%50.5%Not in our dataset56.1%
MMLU ProMulti-task understanding73.4%68.9%Not in our datasetNot in our dataset
SimpleBenchCommonsense reasoning23.0%19.9%Not in our datasetNot in our dataset
AIME 2025MathematicsNot in our datasetNot in our datasetNot in our dataset17.3%
AiderCode editingNot in our datasetNot in our dataset12.0%Not in our dataset
LiveCodeBenchCompetitive codingNot in our datasetNot in our datasetNot in our dataset25.2%
Pricing & context Published USD rates per 1M tokens
SpecificationLlama 3 405B 3.1Llama 3 70B 3.3Command A Non-thinkingPhi-4 Non-Thinking
Input$4$0.1$2.5$0.07
Output$4$0.32$10$0.14
Context window131K131K256K16K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.