Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

1 benchmarks in common.

4 models selected. 1 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for GLM-4 4.5, 3 30B A3B Thinking (2507), Claude Opus 4 4.1 Non-thinking, M1 Reasoning 40K
Benchmark
Zhipu AI
Qwen
Anthropic
MiniMax
Arena ELOHuman preference1,411Not in our dataset1,448Not in our dataset
GPQA DiamondScientific knowledgeNot in our dataset73.4%Not in our dataset69.2%
HLEAcademic reasoning8.3%9.8%7.9%7.2%
MMLU ProMulti-task understandingNot in our dataset80.9%Not in our dataset80.6%
AIME 2025MathematicsNot in our dataset85.0%Not in our dataset74.6%
SWE-Bench VerifiedAgentic codingNot in our dataset22.0%Not in our dataset55.6%
Tau-BenchAgentic tool useNot in our datasetNot in our datasetNot in our dataset67.8%
Pricing & context Published USD rates per 1M tokens
SpecificationGLM-4 4.53 30B A3B Thinking (2507)Claude Opus 4 4.1 Non-thinkingM1 Reasoning 40K
Input$0.6$0.12$15$0.55
Output$2.2$0.5$75$2.2
Context window131K41K200K1.0M
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.