Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

4 benchmarks in common.

4 models selected. 4 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for 3.6 27B Thinking, v3 3.2 Thinking, GPT-5.0, 3.5 122B A10B Thinking
Benchmark
Qwen
DeepSeek
OpenAI
Qwen
Arena ELOHuman preferenceNot in our dataset1,4221,4351,416
LiveBench 1.0General reasoning64.0%Not in our datasetNot in our datasetNot in our dataset
GPQA DiamondScientific knowledge87.8%82.4%85.7%86.6%
HLEAcademic reasoning24.0%25.1%24.8%25.3%
MMLU ProMulti-task understanding86.2%85.0%87.1%86.7%
SimpleBenchCommonsense reasoningNot in our datasetNot in our dataset56.7%Not in our dataset
AIME 2025MathematicsNot in our dataset93.1%94.6%Not in our dataset
GSOGraduate scienceNot in our datasetNot in our dataset6.9%Not in our dataset
AiderCode editingNot in our datasetNot in our dataset88.0%Not in our dataset
SWE-Bench VerifiedAgentic coding77.2%73.1%72.8%72.0%
Tau-BenchAgentic tool useNot in our datasetNot in our dataset81.1%Not in our dataset
Terminal-BenchAgentic terminalNot in our dataset39.3%35.2%Not in our dataset
ARC-AGI-2Visual reasoningNot in our datasetNot in our dataset9.9%Not in our dataset
Pricing & context Published USD rates per 1M tokens
Specification3.6 27B Thinkingv3 3.2 ThinkingGPT-5.03.5 122B A10B Thinking
Input$0.45$0.26$1.25$0.26
Output$2.7$0.38$10$2.08
Context window262K164K400K262K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.