claude-sonnet-4-20250514_12K: benchmark scores, price and ranking

claude-sonnet-4-20250514_12K from Anthropic ranks #229 of 743 LLMs on the LLMs Tiger aggregate benchmark score (49.9), based on 1 benchmark results captured up to 2026-10-13.

Organisation
Anthropic
Type
Frontier model
Open weights
No
Released
2025-05-14 (source: name)
Aggregate rank
#229 of 743 (score 49.9)

Across the 1 benchmark where at least ten models are scored, claude-sonnet-4-20250514_12K is in the top 10% on 0 and in the top half on 1.

claude-sonnet-4-20250514_12K benchmark results

claude-sonnet-4-20250514_12K benchmark scores, ranked against all models measured on each benchmark
BenchmarkScoreRankSourceCaptured
SimpleBench45.5%#28 of 61Epoch AI Benchmarking Hub2026-10-13

About claude-sonnet-4-20250514_12K

claude-sonnet-4-20250514_12K is a frontier model from Anthropic. It was released on 2025-05-14, according to the model's own name. No API price is listed for it yet. We hold 1 benchmark result for it across 1 area, and none is in the top tenth of its board.

Where claude-sonnet-4-20250514_12K stands

On our aggregate score, claude-sonnet-4-20250514_12K is #229 of 743 ranked models, around the middle of the table. Its score is 49.9; the scale is centred on 50, so it sits 0.1 points below the typical model. That beats 69% of the ranked field. Among the 70 ranked Anthropic models it is #39. The next one up is claude-sonnet-4-20250514_32K at 49.9. The next one down is Claude Opus 4.5 (128k thinking) at 49.9.

claude-sonnet-4-20250514_12K, benchmark by benchmark

SimpleBench puts claude-sonnet-4-20250514_12K at 45.5%, #28 of 61. That beats 54% of the models tested, but 36.4 points short of Claude Fable 5 (max) (81.9%). The results either side are Claude Sonnet 4 (unknown thinking) (45.5%) and claude-3-7-sonnet-20250219 (44.9%). It covers trick questions that test common sense. The board median is 41.4%, so claude-sonnet-4-20250514_12K is 4.1 points above it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.

Release history

The Anthropic model released before it was Claude 3.7 Sonnet (64k thinking) on 2025-02-24, which scores 50.4. The next one was claude-sonnet-4-20250514_16K on 2025-05-14, at 49.7.

Reading these numbers

The 1 score on this page comes from 1 source: Epoch AI Benchmarking Hub (1). No official leaderboard supplied any of them, so treat them as third-party measurements. With 1 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

More from Anthropic

Compare it on the live leaderboard → · How the aggregate score works