Compare models. Find the differences.
Add, remove, or change models in the table.
Benchmark snapshot
0 benchmarks in common.
4 models selected. 0 benchmarks in common.
Reported scores; test settings may differ.
| Benchmark | Anthropic | OpenAI | xAI | Thinking Machines |
|---|---|---|---|---|
| Arena ELOHuman preference | 1,450 | Not in our dataset | 1,418 | 1,442 |
| LiveBench 1.0General reasoning | Not in our dataset | Not in our dataset | Not in our dataset | 71.9% |
| GPQA DiamondScientific knowledge | 81.0% | 88.1% | 84.3% | Not in our dataset |
| HLEAcademic reasoning | 11.7% | 26.5% | 17.6% | Not in our dataset |
| MMLU ProMulti-task understanding | 87.3% | Not in our dataset | Not in our dataset | Not in our dataset |
| SimpleBenchCommonsense reasoning | 60.0% | Not in our dataset | 56.0% | 50.0% |
| AIME 2025Mathematics | 78.0% | Not in our dataset | 92.0% | Not in our dataset |
| SWE-Bench VerifiedAgentic coding | 74.5% | 76.3% | 50.6% | Not in our dataset |
| Tau-BenchAgentic tool use | 86.8% | Not in our dataset | Not in our dataset | Not in our dataset |
| Terminal-BenchAgentic terminal | 38.0% | Not in our dataset | Not in our dataset | Not in our dataset |
| ARC-AGI-2Visual reasoning | Not in our dataset | 17.6% | Not in our dataset | 36.5% |
Pricing & context Published USD rates per 1M tokens
| Specification | Claude Opus 4 4.1 Thinking | GPT-5.1 Thinking | Grok 4 Fast Non-Thinking | Inkling Thinking |
|---|---|---|---|---|
| Input | $15 | $1.25 | $0.2 | $1 |
| Output | $75 | $10 | $0.5 | $4.05 |
| Context window | 200K | 400K | 2.0M | 524K |
| Pricing details | Explore pricing → | Explore pricing → | Explore pricing → | Explore pricing → |
How to read this comparison
Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.
These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.
Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.