Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

1 benchmarks in common.

4 models selected. 1 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for 3 235B A22B Non-Thinking, 3 30B A3B Non-thinking, 3 Coder 480B A35B Instruct Non-thinking, v3 (Non-thinking)
Benchmark
Qwen
Qwen
Qwen
DeepSeek
Arena ELOHuman preference1,4021,3271,3881,358
LiveBench 1.0General reasoning67.6%59.4%Not in our dataset60.5%
GPQA DiamondScientific knowledge62.9%54.8%Not in our dataset59.1%
MMLU ProMulti-task understanding77.3%Not in our datasetNot in our datasetNot in our dataset
SimpleBenchCommonsense reasoningNot in our datasetNot in our datasetNot in our dataset18.9%
AIME 2025Mathematics24.7%21.6%Not in our dataset28.8%
GSOGraduate scienceNot in our datasetNot in our dataset4.9%Not in our dataset
AiderCode editing61.8%Not in our datasetNot in our dataset49.6%
SWE-Bench VerifiedAgentic coding34.4%Not in our datasetNot in our datasetNot in our dataset
LiveCodeBenchCompetitive coding35.3%29.8%Not in our dataset36.2%
Tau-BenchAgentic tool use57.0%Not in our datasetNot in our datasetNot in our dataset
Terminal-BenchAgentic terminalNot in our datasetNot in our dataset23.9%Not in our dataset
Pricing & context Published USD rates per 1M tokens
Specification3 235B A22B Non-Thinking3 30B A3B Non-thinking3 Coder 480B A35B Instruct Non-thinkingv3 (Non-thinking)
Input$0.455$0.12$0.3$0.257
Output$1.82$0.5$1$1.029
Context window131K41K262K164K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.