Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Gemini 2.5 Pro, o3 Pro (Extended Reasoning), M2 M2.5, GLM-4 4.7
Benchmark
Google
OpenAI
MiniMax
Zhipu AI
Arena ELOHuman preference1,445Not in our dataset1,3911,441
LiveBench 1.0General reasoning82.4%Not in our datasetNot in our datasetNot in our dataset
GPQA DiamondScientific knowledge86.4%Not in our dataset85.2%85.7%
HLEAcademic reasoning21.6%Not in our dataset19.4%24.8%
MMLU ProMulti-task understanding86.0%Not in our datasetNot in our datasetNot in our dataset
SimpleBenchCommonsense reasoning62.4%Not in our datasetNot in our dataset47.7%
AIME 2025Mathematics88.0%Not in our dataset86.3%Not in our dataset
GSOGraduate science3.9%Not in our datasetNot in our datasetNot in our dataset
AiderCode editing83.1%84.9%Not in our datasetNot in our dataset
SWE-Bench VerifiedAgentic coding59.6%Not in our datasetNot in our dataset73.8%
LiveCodeBenchCompetitive coding70.4%Not in our datasetNot in our datasetNot in our dataset
Tau-BenchAgentic tool use67.0%Not in our datasetNot in our datasetNot in our dataset
Terminal-BenchAgentic terminal32.6%Not in our dataset42.2%41.0%
ARC-AGI-2Visual reasoning4.9%4.9%4.9%Not in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationGemini 2.5 Proo3 Pro (Extended Reasoning)M2 M2.5GLM-4 4.7
Input$1.25$20$0.255$0.6
Output$10$80$1.02$2.2
Context windowNot available200K205K205K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.