Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Qwen3-1.7B (Thinking) Thinking, Claude 3 Sonnet 3.5 (October 2024), Gemini 2.0 Flash, M2 Reasoning
Benchmark
Qwen
Anthropic
Google
MiniMax
Arena ELOHuman preferenceNot in our dataset1,3741,3601,344
LiveBench 1.0General reasoning51.1%Not in our datasetNot in our datasetNot in our dataset
GPQA DiamondScientific knowledge40.1%65.0%60.1%Not in our dataset
HLEAcademic reasoningNot in our dataset4.1%Not in our datasetNot in our dataset
MMLU ProMulti-task understanding56.5%Not in our dataset77.6%Not in our dataset
SimpleBenchCommonsense reasoningNot in our dataset41.4%18.9%25.0%
AIME 2025Mathematics36.8%Not in our datasetNot in our datasetNot in our dataset
GSOGraduate scienceNot in our dataset4.6%Not in our datasetNot in our dataset
AiderCode editingNot in our dataset51.6%22.2%Not in our dataset
LiveCodeBenchCompetitive coding33.2%36.4%Not in our datasetNot in our dataset
Terminal-BenchAgentic terminalNot in our datasetNot in our datasetNot in our dataset30.0%
ARC-AGI-2Visual reasoningNot in our datasetNot in our dataset1.3%Not in our dataset
Pricing & context Published USD rates per 1M tokens
SpecificationQwen3-1.7B (Thinking) ThinkingClaude 3 Sonnet 3.5 (October 2024)Gemini 2.0 FlashM2 Reasoning
InputNot available$3$0.1$0.255
OutputNot available$15$0.4$1.02
Context windowNot available200K1.0M205K
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.