Compare models. Find the differences.
Add, remove, or change models in the table.
Benchmark snapshot
2 benchmarks in common.
4 models selected. 2 benchmarks in common.
Reported scores; test settings may differ.
| Benchmark | Google | Anthropic | MiniMax | Mistral AI |
|---|---|---|---|---|
| Arena ELOHuman preference | 1,360 | 1,374 | 1,344 | 1,414 |
| GPQA DiamondScientific knowledge | 60.1% | 65.0% | Not in our dataset | Not in our dataset |
| HLEAcademic reasoning | Not in our dataset | 4.1% | Not in our dataset | Not in our dataset |
| MMLU ProMulti-task understanding | 77.6% | Not in our dataset | Not in our dataset | Not in our dataset |
| SimpleBenchCommonsense reasoning | 18.9% | 41.4% | 25.0% | 20.4% |
| GSOGraduate science | Not in our dataset | 4.6% | Not in our dataset | Not in our dataset |
| AiderCode editing | 22.2% | 51.6% | Not in our dataset | Not in our dataset |
| LiveCodeBenchCompetitive coding | Not in our dataset | 36.4% | Not in our dataset | Not in our dataset |
| Terminal-BenchAgentic terminal | Not in our dataset | Not in our dataset | 30.0% | Not in our dataset |
| ARC-AGI-2Visual reasoning | 1.3% | Not in our dataset | Not in our dataset | Not in our dataset |
Pricing & context Published USD rates per 1M tokens
| Specification | Gemini 2.0 Flash | Claude 3 Sonnet 3.5 (October 2024) | M2 Reasoning | MistralAI Mistral Large 3 |
|---|---|---|---|---|
| Input | $0.1 | $3 | $0.255 | $0.5 |
| Output | $0.4 | $15 | $1.02 | $1.5 |
| Context window | 1.0M | 200K | 205K | 262K |
| Pricing details | Explore pricing → | Explore pricing → | Explore pricing → | Explore pricing → |
How to read this comparison
Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.
These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.
Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.