Compare models. Find the differences.
Add, remove, or change models in the table.
Benchmark snapshot
0 benchmarks in common.
4 models selected. 0 benchmarks in common.
Reported scores; test settings may differ.
| Benchmark | xAI | Qwen | Anthropic | Qwen |
|---|---|---|---|---|
| Arena ELOHuman preference | 1,472 | Not in our dataset | 1,472 | 1,441 |
| LiveBench 1.0General reasoning | Not in our dataset | Not in our dataset | 73.0% | Not in our dataset |
| GPQA DiamondScientific knowledge | Not in our dataset | Not in our dataset | 89.9% | Not in our dataset |
| HLEAcademic reasoning | Not in our dataset | 25.3% | 33.2% | 28.5% |
| MMLU ProMulti-task understanding | Not in our dataset | 86.7% | Not in our dataset | 88.3% |
| AIME 2025Mathematics | Not in our dataset | Not in our dataset | 86.9% | 83.1% |
| SWE-Bench VerifiedAgentic coding | Not in our dataset | Not in our dataset | 79.6% | 69.9% |
| Tau-BenchAgentic tool use | Not in our dataset | Not in our dataset | 91.7% | 88.5% |
| Terminal-BenchAgentic terminal | Not in our dataset | Not in our dataset | 59.1% | Not in our dataset |
| ARC-AGI-2Visual reasoning | 65.1% | Not in our dataset | 58.3% | Not in our dataset |
Pricing & context Published USD rates per 1M tokens
| Specification | Grok 4 4.20 Beta1 (Reasoning) | 3.5 122B A10B Non-Thinking | Claude Sonnet 4 4.6 Thinking | 3.5 397B A17B Thinking |
|---|---|---|---|---|
| Input | $1.25 | $0.26 | $3 | $0.5 |
| Output | $2.5 | $2.08 | $15 | $3.6 |
| Context window | 1.0M | 262K | 200K | 262K |
| Pricing details | Explore pricing → | Explore pricing → | Explore pricing → | Explore pricing → |
How to read this comparison
Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.
These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.
Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.