Compare models. Find the differences.
Add, remove, or change models in the table.
Benchmark snapshot
1 benchmarks in common.
4 models selected. 1 benchmarks in common.
Reported scores; test settings may differ.
| Benchmark | xAI | DeepSeek | DeepSeek | OpenAI |
|---|---|---|---|---|
| Arena ELOHuman preference | Not in our dataset | 1,417 | 1,398 | Not in our dataset |
| LiveBench 1.0General reasoning | Not in our dataset | Not in our dataset | 71.6% | Not in our dataset |
| GPQA DiamondScientific knowledge | 79.0% | 68.4% | 71.5% | 80.1% |
| HLEAcademic reasoning | 11.0% | Not in our dataset | Not in our dataset | 14.9% |
| MMLU ProMulti-task understanding | Not in our dataset | 81.2% | 84.0% | 80.8% |
| SimpleBenchCommonsense reasoning | Not in our dataset | 40.0% | 30.9% | Not in our dataset |
| AIME 2025Mathematics | 83.0% | Not in our dataset | 70.0% | Not in our dataset |
| AiderCode editing | Not in our dataset | Not in our dataset | 53.3% | 41.8% |
| SWE-Bench VerifiedAgentic coding | Not in our dataset | Not in our dataset | 49.2% | 62.0% |
| LiveCodeBenchCompetitive coding | Not in our dataset | Not in our dataset | 65.9% | Not in our dataset |
| ARC-AGI-2Visual reasoning | 0.4% | Not in our dataset | 1.3% | Not in our dataset |
Pricing & context Published USD rates per 1M tokens
| Specification | Grok 3 Mini | v3 3.1 | R1 Thinking | GPT-OSS 120B Thinking |
|---|---|---|---|---|
| Input | $0.3 | $0.25 | $0.7 | $0.03 |
| Output | $0.5 | $0.95 | $2.5 | $0.136 |
| Context window | 131K | 164K | 64K | 131K |
| Pricing details | Explore pricing → | Explore pricing → | Explore pricing → | Explore pricing → |
How to read this comparison
Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.
These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.
Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.