Compare models. Find the differences.

Add, remove, or change models in the table.

Benchmark snapshot

0 benchmarks in common.

4 models selected. 0 benchmarks in common.

Reported scores; test settings may differ.

Reported benchmark results for 3.5 27B Thinking, v3 V3.2 Exp Chat, 3.6 27B Thinking, Claude Haiku 5.5 Thinking
Benchmark
Qwen
DeepSeek
Qwen
Anthropic
Arena ELOHuman preference1,4091,422Not in our dataset1,425
LiveBench 1.0General reasoningNot in our datasetNot in our dataset64.0%72.1%
GPQA DiamondScientific knowledge85.5%Not in our dataset87.8%Not in our dataset
HLEAcademic reasoning24.3%Not in our dataset24.0%30.1%
MMLU ProMulti-task understanding86.1%Not in our dataset86.2%Not in our dataset
AiderCode editingNot in our dataset70.2%Not in our datasetNot in our dataset
SWE-Bench VerifiedAgentic coding75.0%Not in our dataset77.2%Not in our dataset
ARC-AGI-2Visual reasoningNot in our datasetNot in our datasetNot in our dataset61.3%
Pricing & context Published USD rates per 1M tokens
Specification3.5 27B Thinkingv3 V3.2 Exp Chat3.6 27B ThinkingClaude Haiku 5.5 Thinking
Input$0.26$0.27$0.45$0.1
Output$2.6$0.41$2.7$0.5
Context window262K164K262K1.0M
Pricing detailsExplore pricing →Explore pricing →Explore pricing →Explore pricing →
How to read this comparison

Each column keeps the exact model version you selected. Shared benchmarks are the intersection of their reported results; “all coverage” also shows where evidence is missing. Missing results never count as zero.

These are published benchmark scores, not a controlled head-to-head test. The available evidence does not establish matching evaluation settings, so we show no cross-model winner highlights or deltas. Composite quality scores are omitted because they can summarize different benchmark sets.

Scores and statistics are computed upstream. This page reads a fixed data snapshot; its date describes the snapshot, not the date of every measurement.