Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

2 benchmarks in common.

4 models selected. 2 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Gemma 4 12B IT Thinking, GPT-OSS 120B Thinking, Grok 3 Mini, M2 M2.1
Benchmark
Google
OpenAI
xAI
MiniMax
Arena ELOHuman preferenceNot in our datasetNot in our datasetNot in our dataset1,385
GPQA DiamondScientific knowledge78.8%80.1%79.0%83.0%
HLEAcademic reasoning5.2%14.9%11.0%22.2%
MMLU ProMulti-task understanding77.2%80.8%Not in our datasetNot in our dataset
SimpleBenchCommonsense reasoningNot in our datasetNot in our datasetNot in our dataset34.7%
AIME 2025MathematicsNot in our datasetNot in our dataset83.0%83.0%
AiderCode editingNot in our dataset41.8%Not in our datasetNot in our dataset
SWE-Bench VerifiedAgentic codingNot in our dataset62.0%Not in our datasetNot in our dataset
LiveCodeBenchCompetitive coding72.0%Not in our datasetNot in our datasetNot in our dataset
Terminal-BenchAgentic terminalNot in our datasetNot in our datasetNot in our dataset29.2%
ARC-AGI-2Visual reasoningNot in our datasetNot in our dataset0.4%Not in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationGemma 4 12B IT ThinkingGPT-OSS 120B ThinkingGrok 3 MiniM2 M2.1
InputNot available$0.03$0.3$0.3
OutputNot available$0.136$0.5$1.2
Context windowNot available131K131K205K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.