claude-sonnet-4-20250514_16K: benchmark scores, price and ranking
claude-sonnet-4-20250514_16K from Anthropic ranks #242 of 743 LLMs on the LLMs Tiger aggregate benchmark score (49.7), based on 4 benchmark results captured up to 2026-10-13.
- Organisation
- Anthropic
- Type
- Frontier model
- Open weights
- No
- Released
- 2025-05-14 (source: name)
- Aggregate rank
- #242 of 743 (score 49.7)
Relative to other models, claude-sonnet-4-20250514_16K is strongest on WeirdML (#35 of 109) and weakest on OTIS Mock AIME (#102 of 189).
Across the 4 benchmarks where at least ten models are scored, claude-sonnet-4-20250514_16K is in the top 10% on 0 and in the top half on 3.
claude-sonnet-4-20250514_16K benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| WeirdML | 46.1% | #35 of 109 | Epoch AI Benchmarking Hub | 2026-10-13 |
| METR time horizon | 75 min | #10 of 31 | Epoch AI Benchmarking Hub | 2026-10-13 |
| GPQA Diamond | 75.8% | #123 of 275 | Epoch AI Benchmarking Hub | 2026-10-13 |
| OTIS Mock AIME | 53.3% | #102 of 189 | Epoch AI Benchmarking Hub | 2026-10-13 |
About claude-sonnet-4-20250514_16K
claude-sonnet-4-20250514_16K is a frontier model from Anthropic. It was released on 2025-05-14, according to the model's own name. No API price is listed for it yet. We hold 4 benchmark results for it across 2 areas, and none is in the top tenth of its board.
Where claude-sonnet-4-20250514_16K stands
On our aggregate score, claude-sonnet-4-20250514_16K is #242 of 743 ranked models, around the middle of the table. Its score is 49.7; the scale is centred on 50, so it sits 0.3 points below the typical model. That beats 67% of the ranked field. Among the 70 ranked Anthropic models it is #43. The next one up is claude-opus-4-1-20250805 at 49.7. The next one down is claude-haiku-4-5-20251001_16K at 49.5.
claude-sonnet-4-20250514_16K, benchmark by benchmark
WeirdML puts claude-sonnet-4-20250514_16K at 46.1%, #35 of 109. That beats 68% of the models tested, but 47.2 points short of GPT-6 Astra (max) (93.3%). The results either side are DeepSeek-V3.2-Speciale (46.7%) and o1 (high) (46.1%). It covers unusual machine-learning tasks. The board median is 41.2%, so claude-sonnet-4-20250514_16K is 4.9 points above it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
On METR time horizon, claude-sonnet-4-20250514_16K reaches 75 min. It ranks #10 of 31, ahead of 68% of the field, and 970 minutes behind Claude Mythos Preview (Early) at 1,045 min. The results either side are Claude Opus 4 (100 min) and claude-3-7-sonnet-20250219 (60 min). It covers length of task (minutes) done at 50% success. The board median is 23 min, so claude-sonnet-4-20250514_16K is 52 minutes above it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
claude-sonnet-4-20250514_16K manages 75.8% on GPQA Diamond, good for #123 of 275. GPT-6 Astra (max) leads at 95.8%, 20.0 points further up, and 55% of models sit below. The results either side are Nemotron-Cascade-2-30B-A3B (76.1%) and Gemma 4 31B IT (75.8%). It covers expert-level science questions. The board median is 71.7%, so claude-sonnet-4-20250514_16K is 4.0 points above it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
claude-sonnet-4-20250514_16K lands below the middle on OTIS Mock AIME: 53.3%, #102 of 189, with 53% of the field scoring higher. Claude Fable 5.1 (max) leads at 100.0%; the closest result above is qwen3.5-35b-a3b at 54.4%. It covers competition maths (AIME 2024-25 style). The board median is 57.8%, so claude-sonnet-4-20250514_16K is 4.4 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
Strengths and weaknesses
Reasoning, maths and science: solid, ahead of 51% of the field on average across 2 benchmarks. Its best board here is GPQA Diamond (#123 of 275) and its weakest is OTIS Mock AIME (#102 of 189). General knowledge and chat: solid, ahead of 68% of the field on average across 2 benchmarks. Its best board here is WeirdML (#35 of 109) and its weakest is METR time horizon (#10 of 31).
Release history
The Anthropic model released before it was claude-sonnet-4-20250514_12K on 2025-05-14, which scores 49.9. The next one was claude-sonnet-4-20250514_2K on 2025-05-14, at 50.0.
Reading these numbers
The 4 scores on this page come from 1 source: Epoch AI Benchmarking Hub (4). No official leaderboard supplied any of them, so treat them as third-party measurements. With 4 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #239 claude-opus-4-1-20250805 (49.7)
- #240 Kimi K2 Thinking (Together) (49.7)
- #241 Frogboss 32B 2510 (49.7)
- #243 Qwen3-235B-A22B-Thinking-2507 (49.7)
- #244 Inkling Small (xhigh) (49.7)
- #245 GLM-4.5-FP8 (49.6)
More from Anthropic
- Claude Opus 5.5 (max) (#1, 64.3)
- Claude Fable 5.1 (max) (#3, 61.9)
- Claude Sonnet 5.5 (max) (#4, 60.8)
- Claude Opus 5 (max) (#8, 60.0)
- Claude Fable 5 (max) (#9, 59.9)
- claude-opus-4-8-xhigh-effort (#14, 56.6)
Compare it on the live leaderboard → · How the aggregate score works