Compare models. Find the differences.
Add, remove, or change models in the table.
Benchmark snapshot
0 benchmarks in common.
4 models selected. 0 benchmarks in common.
Reported scores; test settings may differ.
| Benchmark | Google | Mistral AI | OpenAI | Google |
|---|---|---|---|---|
| Arena ELOHuman preference | Not in our dataset | Not in our dataset | 1,389 | 1,409 |
| GPQA DiamondScientific knowledge | 58.6% | 68.2% | Not in our dataset | 82.8% |
| HLEAcademic reasoning | Not in our dataset | Not in our dataset | Not in our dataset | 11.0% |
| MMLU ProMulti-task understanding | 69.4% | Not in our dataset | Not in our dataset | Not in our dataset |
| SimpleBenchCommonsense reasoning | Not in our dataset | Not in our dataset | 41.7% | 41.2% |
| AIME 2025Mathematics | Not in our dataset | 62.8% | Not in our dataset | 72.0% |
| AiderCode editing | Not in our dataset | Not in our dataset | Not in our dataset | 55.1% |
| SWE-Bench VerifiedAgentic coding | Not in our dataset | Not in our dataset | Not in our dataset | 60.4% |
| LiveCodeBenchCompetitive coding | 52.0% | 55.4% | Not in our dataset | 62.6% |
| Terminal-BenchAgentic terminal | Not in our dataset | Not in our dataset | Not in our dataset | 16.9% |
| ARC-AGI-2Visual reasoning | Not in our dataset | 0.0% | Not in our dataset | 2.5% |
Pricing & context Published USD rates per 1M tokens
| Specification | Gemma 4 E4B IT Thinking | MistralAI Magistral Small Thinking | o1 Preview | Gemini 2.5 Flash Thinking |
|---|---|---|---|---|
| Input | Not available | $0.5 | $15 | $0.3 |
| Output | Not available | $1.5 | $60 | $2.5 |
| Context window | Not available | 40K | 200K | 1.0M |
| Pricing details | Explore pricing → | Explore pricing → | Explore pricing → | Explore pricing → |
How to read this comparison
Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.
These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.
Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.