Compare models. Find the differences.
Add, remove, or change models in the table.
Benchmark snapshot
1 benchmarks in common.
4 models selected. 1 benchmarks in common.
Reported scores; test settings may differ.
| Benchmark | OpenAI | Mistral AI | Google | Cohere |
|---|---|---|---|---|
| Arena ELOHuman preference | 1,443 | 1,223 | 1,318 | 1,354 |
| LiveBench 1.0General reasoning | 52.2% | Not in our dataset | Not in our dataset | Not in our dataset |
| GPQA DiamondScientific knowledge | 49.9% | 59.6% | 23.7% | Not in our dataset |
| HLEAcademic reasoning | 2.7% | 4.5% | Not in our dataset | Not in our dataset |
| MMLU ProMulti-task understanding | Not in our dataset | Not in our dataset | 50.6% | Not in our dataset |
| SimpleBenchCommonsense reasoning | 17.8% | Not in our dataset | Not in our dataset | Not in our dataset |
| AIME 2025Mathematics | 7.6% | 21.2% | 11.6% | Not in our dataset |
| GSOGraduate science | 0.0% | Not in our dataset | Not in our dataset | Not in our dataset |
| AiderCode editing | 45.3% | 28.9% | Not in our dataset | 12.0% |
| LiveCodeBenchCompetitive coding | 32.7% | 29.1% | 13.2% | Not in our dataset |
| ARC-AGI-2Visual reasoning | 0.0% | Not in our dataset | Not in our dataset | Not in our dataset |
Pricing & context Published USD rates per 1M tokens
| Specification | GPT-4o Non-thinking | MistralAI Mistral Medium 3 | Gemma 3n 4B Non-thinking | Command A Non-thinking |
|---|---|---|---|---|
| Input | $1.25 | $0.4 | $0.06 | $2.5 |
| Output | $5 | $2 | $0.12 | $10 |
| Context window | 128K | 131K | 33K | 256K |
| Pricing details | Explore pricing → | Explore pricing → | Explore pricing → | Explore pricing → |
How to read this comparison
Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.
These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.
Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.