Compare models. Find the differences.
Add, remove, or change models in the table.
Benchmark snapshot
1 benchmarks in common.
4 models selected. 1 benchmarks in common.
Reported scores; test settings may differ.
| Benchmark | DeepSeek | Qwen | Qwen | Mistral AI |
|---|---|---|---|---|
| LiveBench 1.0General reasoning | Not in our dataset | 48.4% | 53.5% | Not in our dataset |
| GPQA DiamondScientific knowledge | 50.5% | 41.7% | 39.3% | 46.0% |
| MMLU ProMulti-task understanding | 60.6% | 69.6% | Not in our dataset | 66.8% |
| AIME 2025Mathematics | Not in our dataset | 19.1% | 20.9% | Not in our dataset |
| LiveCodeBenchCompetitive coding | Not in our dataset | 21.3% | 22.8% | Not in our dataset |
Pricing & context Published USD rates per 1M tokens
| Specification | v3 Base | Qwen3-4B (Thinking) Non-thinking | 3 8B Non-thinking | MistralAI Small 3 |
|---|---|---|---|---|
| Input | $0.257 | $0 | $0.117 | $0.075 |
| Output | $1.029 | $0 | $0.455 | $0.2 |
| Context window | 164K | 41K | 131K | 256K |
| Pricing details | Explore pricing → | Explore pricing → | Explore pricing → | Explore pricing → |
How to read this comparison
Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.
These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.
Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.