Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Qwen3-0.6B (Thinking) Non-thinking, Command R Non-thinking, Llama 3 8B 3.1 (Non-thinking), Phi-4 Mini Non-Thinking
Benchmark
Qwen
Cohere
Meta
Microsoft
Arena ELOHuman preferenceNot in our dataset1,2271,211Not in our dataset
LiveBench 1.0General reasoning21.8%Not in our dataset26.0%25.3%
GPQA DiamondScientific knowledge22.9%Not in our dataset32.8%25.2%
MMLU ProMulti-task understandingNot in our datasetNot in our datasetNot in our dataset52.8%
SimpleBenchCommonsense reasoningNot in our dataset17.4%Not in our datasetNot in our dataset
AIME 2025Mathematics2.6%Not in our dataset2.7%5.3%
LiveCodeBenchCompetitive coding3.6%Not in our dataset10.8%10.4%
Pricing & context Published USD rates per 1M tokens
SpecificationQwen3-0.6B (Thinking) Non-thinkingCommand R Non-thinkingLlama 3 8B 3.1 (Non-thinking)Phi-4 Mini Non-Thinking
InputNot available$0.5$0.05$0.08
OutputNot available$1.5$0.08$0.35
Context windowNot available128K131K128K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.