Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for GPT-OSS 20B Thinking, QwQ 32B Thinking, Claude 3 Sonnet 3.7 Thinking, Claude Sonnet 4 4.5 Non-thinking
Benchmark
OpenAI
Qwen
Anthropic
Anthropic
Arena ELOHuman preferenceNot in our dataset1,3361,3881,455
LiveBench 1.0General reasoningNot in our dataset72.0%Not in our datasetNot in our dataset
GPQA DiamondScientific knowledge71.5%65.6%78.2%Not in our dataset
HLEAcademic reasoningNot in our datasetNot in our dataset8.0%7.5%
MMLU ProMulti-task understanding74.8%Not in our datasetNot in our datasetNot in our dataset
SimpleBenchCommonsense reasoningNot in our datasetNot in our dataset46.4%Not in our dataset
AIME 2025MathematicsNot in our dataset69.5%Not in our datasetNot in our dataset
AiderCode editingNot in our dataset20.9%64.9%Not in our dataset
SWE-Bench VerifiedAgentic codingNot in our datasetNot in our dataset62.3%Not in our dataset
LiveCodeBenchCompetitive codingNot in our dataset62.7%Not in our datasetNot in our dataset
Tau-BenchAgentic tool useNot in our datasetNot in our dataset81.2%Not in our dataset
Terminal-BenchAgentic terminalNot in our datasetNot in our datasetNot in our dataset42.8%
ARC-AGI-2Visual reasoningNot in our datasetNot in our dataset0.7%3.8%
Pricing & context Published USD rates per 1M tokens
SpecificationGPT-OSS 20B ThinkingQwQ 32B ThinkingClaude 3 Sonnet 3.7 ThinkingClaude Sonnet 4 4.5 Non-thinking
Input$0.024$0.2$3$3
Output$0.112$0.2$15$15
Context window131K33K200K1.0M
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.