Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

1 benchmarks in common.

4 models selected. 1 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for R1 Thinking, v3 3.1, Grok 3 Mini, GPT-OSS 120B Thinking
Benchmark
DeepSeek
DeepSeek
xAI
OpenAI
Arena ELOHuman preference1,3981,417Not in our datasetNot in our dataset
LiveBench 1.0General reasoning71.6%Not in our datasetNot in our datasetNot in our dataset
GPQA DiamondScientific knowledge71.5%68.4%79.0%80.1%
HLEAcademic reasoningNot in our datasetNot in our dataset11.0%14.9%
MMLU ProMulti-task understanding84.0%81.2%Not in our dataset80.8%
SimpleBenchCommonsense reasoning30.9%40.0%Not in our datasetNot in our dataset
AIME 2025Mathematics70.0%Not in our dataset83.0%Not in our dataset
AiderCode editing53.3%Not in our datasetNot in our dataset41.8%
SWE-Bench VerifiedAgentic coding49.2%Not in our datasetNot in our dataset62.0%
LiveCodeBenchCompetitive coding65.9%Not in our datasetNot in our datasetNot in our dataset
ARC-AGI-2Visual reasoning1.3%Not in our dataset0.4%Not in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationR1 Thinkingv3 3.1Grok 3 MiniGPT-OSS 120B Thinking
Input$0.7$0.25$0.3$0.03
Output$2.5$0.95$0.5$0.136
Context window64K164K131K131K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.