Compare models. Find the differences.
Add, remove, or change models in the table.
Benchmark snapshot
1 benchmarks in common.
4 models selected. 1 benchmarks in common.
Reported scores; test settings may differ.
| Benchmark | Google | DeepSeek | Anthropic | Qwen |
|---|---|---|---|---|
| Arena ELOHuman preference | Not in our dataset | 1,395 | 1,372 | Not in our dataset |
| LiveBench 1.0General reasoning | 67.8% | 72.4% | Not in our dataset | 59.6% |
| GPQA DiamondScientific knowledge | 68.2% | 68.4% | 68.0% | 54.8% |
| MMLU ProMulti-task understanding | 79.4% | 81.2% | Not in our dataset | Not in our dataset |
| SimpleBenchCommonsense reasoning | Not in our dataset | 27.2% | 44.9% | Not in our dataset |
| AIME 2025Mathematics | 46.6% | 46.7% | Not in our dataset | 23.3% |
| GSOGraduate science | Not in our dataset | Not in our dataset | 3.8% | Not in our dataset |
| AiderCode editing | 44.0% | 55.1% | 60.4% | Not in our dataset |
| SWE-Bench VerifiedAgentic coding | Not in our dataset | 38.8% | Not in our dataset | Not in our dataset |
| LiveCodeBenchCompetitive coding | Not in our dataset | 27.2% | Not in our dataset | 29.0% |
| Tau-BenchAgentic tool use | 64.3% | 69.1% | Not in our dataset | Not in our dataset |
| ARC-AGI-2Visual reasoning | Not in our dataset | Not in our dataset | 0.0% | Not in our dataset |
Pricing & context Published USD rates per 1M tokens
| Specification | Gemini 2.5 Flash Non-Thinking | v3 v3-0324 (Non-thinking) | Claude 3 Sonnet 3.7 | 3 14B Non-thinking |
|---|---|---|---|---|
| Input | $0.3 | $0.29 | $3 | $0.12 |
| Output | $2.5 | $1.14 | $15 | $0.24 |
| Context window | 1.0M | 164K | 200K | 41K |
| Pricing details | Explore pricing → | Explore pricing → | Explore pricing → | Explore pricing → |
How to read this comparison
Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.
These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.
Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.