Claude 4 Sonnet: benchmark scores, price and ranking

Claude 4 Sonnet from Anthropic ranks #20 of 743 LLMs on the LLMs Tiger aggregate benchmark score (54.5), based on 3 benchmark results captured up to 2026-10-13.

Organisation: Anthropic
Type: Frontier model
Open weights: No
Released: 2025-05-22 (source: curated)
Cheapest API price: $3.00 in / $15.00 out per million tokens (via replicate, observed 2026-10-13T20:47Z)
Aggregate rank: #20 of 743 (score 54.5)

Across the 2 benchmarks where at least ten models are scored, Claude 4 Sonnet is in the top 10% on 1 and in the top half on 2.

Its cheapest listed input price, $3.00 per million tokens, is lower than that of 11% of the 427 models with a listed price.

Claude 4 Sonnet benchmark results

Claude 4 Sonnet benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
SWE-bench Lite	56.7%	#1 of 20	SWE-bench Lite leaderboard	2026-10-13
SWE-bench Multimodal	35.6%	#1 of 5	SWE-bench Multimodal leaderboard	2026-10-13
SWE-bench Verified	70.8%	#16 of 73	SWE-bench Verified leaderboard	2026-10-13

About Claude 4 Sonnet

Claude 4 Sonnet is a frontier model from Anthropic. It was released on 2025-05-22, according to the developer's announcement. The cheapest API listing we track charges $3.00 per million input tokens and $15.00 per million output tokens, through replicate. We hold 3 benchmark results for it across 2 areas, and 1 is in the top tenth of its board.

Where Claude 4 Sonnet stands

On our aggregate score, Claude 4 Sonnet is #20 of 743 ranked models, in the top fifty. Its score is 54.5; the scale is centred on 50, so it sits 4.5 points above the typical model. That beats 97% of the ranked field. Among the 70 ranked Anthropic models it is #7. The next one up is claude-opus-4-8-xhigh-effort at 56.6. The next one down is Claude 4.5 Opus at 54.5.

Claude 4 Sonnet, benchmark by benchmark

SWE-bench Lite is where Claude 4 Sonnet does best: 56.7%, first of 20. The next result is Qwen3-Coder-30B-A3B-Instruct at 49.7%, 7.0 points behind. It covers real GitHub issues resolved. The board median is 24.7%, so Claude 4 Sonnet is 32.0 points above it. Source: SWE-bench Lite leaderboard, captured 2026-10-13.

On SWE-bench Verified, Claude 4 Sonnet reaches 70.8%. It ranks #16 of 73, ahead of 78% of the field, and 12.7 points behind Claude Opus 4.7 (max) at 83.5%. The results either side are GPT-5.2 Codex (72.8%) and Kimi K2.5 (70.8%). It covers real GitHub issues resolved. The board median is 56.4%, so Claude 4 Sonnet is 14.4 points above it. Source: SWE-bench Verified leaderboard, captured 2026-10-13.

The full table above also lists the other 1 result, including boards with fewer than ten models, where a rank says little.

Strengths and weaknesses

Software engineering: strong, ahead of 87% of the field on average across 2 benchmarks. Its best board here is SWE-bench Lite (#1 of 20) and its weakest is SWE-bench Verified (#16 of 73).

Price and value

The median input price across the 427 priced models is $0.500 per million tokens, so Claude 4 Sonnet costs more than the typical listing. Models that score within 1.5 points or better and cost less: DeepSeek V4 Flash 0731 (max) ($0.016, 53.1), GLM-5.3 (max) ($0.079, 53.8), GPT-6 Luna (max) ($0.100, 53.7). Similar scores cost more on Claude Opus 4.7 (max) ($5.00) and Claude Mythos Preview (Early) ($10.00).

Release history

The Anthropic model released before it was Claude 4 Opus on 2025-05-22, which scores 51.0. The next one was Claude Opus 4 on 2025-05-22, at 48.9.

Reading these numbers

The 3 scores on this page come from 3 sources: SWE-bench Lite leaderboard (1), SWE-bench Multimodal leaderboard (1), SWE-bench Verified leaderboard (1). 2 of them come from an official leaderboard and 1 from datasets or third-party runs. With 3 results the aggregate rank can move a lot when one new score arrives.