Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

1 benchmarks in common.

4 models selected. 1 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for Claude Opus 4 4.1 Non-thinking, GLM-4 4.5, 3 30B A3B Thinking (2507), M1 Reasoning 40K
Benchmark
Anthropic
Zhipu AI
Qwen
MiniMax
Arena ELOHuman preference1,4481,411Not in our datasetNot in our dataset
GPQA DiamondScientific knowledgeNot in our datasetNot in our dataset73.4%69.2%
HLEAcademic reasoning7.9%8.3%9.8%7.2%
MMLU ProMulti-task understandingNot in our datasetNot in our dataset80.9%80.6%
AIME 2025MathematicsNot in our datasetNot in our dataset85.0%74.6%
SWE-Bench VerifiedAgentic codingNot in our datasetNot in our dataset22.0%55.6%
Tau-BenchAgentic tool useNot in our datasetNot in our datasetNot in our dataset67.8%
Pricing & context Published USD rates per 1M tokens
SpecificationClaude Opus 4 4.1 Non-thinkingGLM-4 4.53 30B A3B Thinking (2507)M1 Reasoning 40K
Input$15$0.6$0.12$0.55
Output$75$2.2$0.5$2.2
Context window200K131K41K1.0M
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.