Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

2 benchmarks in common.

4 models selected. 2 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for 3 235B A22B Thinking, 3 32B Thinking, o1, M2 M2.1
Benchmark
Qwen
Qwen
OpenAI
MiniMax
Arena ELOHuman preference1,375Not in our dataset1,4021,385
LiveBench 1.0General reasoning77.1%74.9%75.7%Not in our dataset
GPQA DiamondScientific knowledge71.1%68.4%78.0%83.0%
HLEAcademic reasoning7.6%Not in our dataset8.1%22.2%
MMLU ProMulti-task understanding83.0%Not in our datasetNot in our datasetNot in our dataset
SimpleBenchCommonsense reasoningNot in our datasetNot in our dataset40.1%34.7%
AIME 2025Mathematics81.5%72.9%79.2%83.0%
AiderCode editing61.8%50.2%61.7%Not in our dataset
SWE-Bench VerifiedAgentic coding34.4%Not in our dataset48.9%Not in our dataset
LiveCodeBenchCompetitive coding70.7%65.7%63.9%Not in our dataset
Tau-BenchAgentic tool use58.6%Not in our dataset70.8%Not in our dataset
Terminal-BenchAgentic terminalNot in our datasetNot in our datasetNot in our dataset29.2%
Pricing & context Published USD rates per 1M tokens
Specification3 235B A22B Thinking3 32B Thinkingo1M2 M2.1
Input$0.455$0.08$15$0.3
Output$1.82$0.28$60$1.2
Context window131K131K200K205K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.