Compare models. Find the differences.
Add, remove, or change models in the table.
Benchmark snapshot
1 benchmarks in common.
4 models selected. 1 benchmarks in common.
Reported scores; test settings may differ.
| Benchmark | Qwen | Anthropic | Anthropic | OpenAI |
|---|---|---|---|---|
| Arena ELOHuman preference | 1,400 | Not in our dataset | 1,402 | 1,401 |
| LiveBench 1.0General reasoning | Not in our dataset | Not in our dataset | Not in our dataset | 69.6% |
| GPQA DiamondScientific knowledge | Not in our dataset | 73.0% | 76.1% | 82.8% |
| HLEAcademic reasoning | 15.8% | 9.7% | 7.8% | 24.3% |
| MMLU ProMulti-task understanding | 84.5% | Not in our dataset | Not in our dataset | Not in our dataset |
| SimpleBenchCommonsense reasoning | Not in our dataset | Not in our dataset | 45.5% | Not in our dataset |
| AIME 2025Mathematics | Not in our dataset | 80.7% | 70.5% | Not in our dataset |
| AiderCode editing | Not in our dataset | Not in our dataset | 61.3% | Not in our dataset |
| SWE-Bench VerifiedAgentic coding | Not in our dataset | 73.3% | 72.7% | Not in our dataset |
| LiveCodeBenchCompetitive coding | Not in our dataset | 53.2% | 55.9% | Not in our dataset |
| Tau-BenchAgentic tool use | 71.9% | 83.2% | 83.8% | Not in our dataset |
| ARC-AGI-2Visual reasoning | Not in our dataset | 4.0% | 5.9% | 5.7% |
Pricing & context Published USD rates per 1M tokens
| Specification | 3 235B A22B thinking-2507 | Claude Haiku 4.5 Thinking | Claude Sonnet 4 4.0 Thinking | GPT-5 Nano Thinking (5.4) |
|---|---|---|---|---|
| Input | $0.45 | $1 | $3 | $0.05 |
| Output | $3.5 | $5 | $15 | $0.4 |
| Context window | 128K | 200K | 200K | 400K |
| Pricing details | Explore pricing → | Explore pricing → | Explore pricing → | Explore pricing → |
How to read this comparison
Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.
These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.
Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.