Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Gemini 2.5 Flash Thinking, MistralAI Magistral Small Thinking, o1 Preview, Nemotron 3 Super 120B-A12B
Benchmark
Google
Mistral AI
OpenAI
NVIDIA
Arena ELOHuman preference1,409Not in our dataset1,3891,360
GPQA DiamondScientific knowledge82.8%68.2%Not in our datasetNot in our dataset
HLEAcademic reasoning11.0%Not in our datasetNot in our dataset18.3%
MMLU ProMulti-task understandingNot in our datasetNot in our datasetNot in our dataset83.7%
SimpleBenchCommonsense reasoning41.2%Not in our dataset41.7%Not in our dataset
AIME 2025Mathematics72.0%62.8%Not in our datasetNot in our dataset
AiderCode editing55.1%Not in our datasetNot in our datasetNot in our dataset
SWE-Bench VerifiedAgentic coding60.4%Not in our datasetNot in our datasetNot in our dataset
LiveCodeBenchCompetitive coding62.6%55.4%Not in our datasetNot in our dataset
Tau-BenchAgentic tool useNot in our datasetNot in our datasetNot in our dataset62.8%
Terminal-BenchAgentic terminal16.9%Not in our datasetNot in our datasetNot in our dataset
ARC-AGI-2Visual reasoning2.5%0.0%Not in our datasetNot in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationGemini 2.5 Flash ThinkingMistralAI Magistral Small Thinkingo1 PreviewNemotron 3 Super 120B-A12B
Input$0.3$0.5$15$0.3
Output$2.5$1.5$60$2.4
Context window1.0M40K200K1.0M
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.