claude-3-sonnet-20240229: benchmark scores, price and ranking
claude-3-sonnet-20240229 from Anthropic ranks #720 of 743 LLMs on the LLMs Tiger aggregate benchmark score (41.9), based on 5 benchmark results captured up to 2026-10-13.
- Organisation
- Anthropic
- Type
- Frontier model
- Open weights
- No
- Released
- 2024-03-04 (source: curated)
- Cheapest API price
- $3.00 in / $15.00 out per million tokens (via vertex_ai, observed 2026-10-13T20:47Z)
- Aggregate rank
- #720 of 743 (score 41.9)
Relative to other models, claude-3-sonnet-20240229 is strongest on Aider Code Editing (#48 of 92) and weakest on WeirdML (#103 of 109).
Across the 5 benchmarks where at least ten models are scored, claude-3-sonnet-20240229 is in the top 10% on 0 and in the top half on 0.
Its cheapest listed input price, $3.00 per million tokens, is lower than that of 11% of the 427 models with a listed price.
claude-3-sonnet-20240229 benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| Aider Code Editing | 54.9% | #48 of 92 | Aider Aider Code Editing leaderboard | 2026-10-13 |
| GPQA Diamond | 40.6% | #220 of 275 | Epoch AI Benchmarking Hub | 2026-10-13 |
| DTBench | 53.6% | #118 of 146 | Epoch AI Benchmarking Hub | 2026-10-13 |
| OTIS Mock AIME | 2.5% | #169 of 189 | Epoch AI Benchmarking Hub | 2026-10-13 |
| WeirdML | 10.2% | #103 of 109 | Epoch AI Benchmarking Hub | 2026-10-13 |
About claude-3-sonnet-20240229
claude-3-sonnet-20240229 is a frontier model from Anthropic. It was released on 2024-03-04, according to the developer's announcement. The cheapest API listing we track charges $3.00 per million input tokens and $15.00 per million output tokens, through vertex_ai. We hold 5 benchmark results for it across 4 areas, and none is in the top tenth of its board.
Where claude-3-sonnet-20240229 stands
On our aggregate score, claude-3-sonnet-20240229 is #720 of 743 ranked models, in the lower half. Its score is 41.9; the scale is centred on 50, so it sits 8.1 points below the typical model. That beats 3% of the ranked field. Among the 70 ranked Anthropic models it is #67. The next one up is claude-2.0 at 42.2. The next one down is Claude 3.5 Haiku (Oct 2024) at 41.3.
claude-3-sonnet-20240229, benchmark by benchmark
claude-3-sonnet-20240229 lands below the middle on Aider Code Editing: 54.9%, #48 of 92, with 51% of the field scoring higher. Claude 3.5-Sonnet-20241022 leads at 84.2%; the closest result above is qwen2-72b-instruct at 55.6%. It covers Aider official benchmark. The board median is 55.6%, so claude-3-sonnet-20240229 is 0.7 points below it. Source: Aider Aider Code Editing leaderboard, captured 2026-10-13.
claude-3-sonnet-20240229 lands below the middle on GPQA Diamond: 40.6%, #220 of 275, with 80% of the field scoring higher. GPT-6 Astra (max) leads at 95.8%; the closest result above is qwen2-72b-instruct at 40.8%. It covers expert-level science questions. The board median is 71.7%, so claude-3-sonnet-20240229 is 31.1 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
DTBench is a weak spot. claude-3-sonnet-20240229 scores 53.6%, #118 of 146, behind 80% of the models measured. The leader, Claude Opus 5.5 (max), reaches 98.9%. It covers dynamic tool-use benchmark. The board median is 68.8%, so claude-3-sonnet-20240229 is 15.2 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
OTIS Mock AIME is a weak spot. claude-3-sonnet-20240229 scores 2.5%, #169 of 189, behind 89% of the models measured. The leader, Claude Fable 5.1 (max), reaches 100.0%. It covers competition maths (AIME 2024-25 style). The board median is 57.8%, so claude-3-sonnet-20240229 is 55.3 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
WeirdML is a weak spot. claude-3-sonnet-20240229 scores 10.2%, #103 of 109, behind 94% of the models measured. The leader, GPT-6 Astra (max), reaches 93.3%. It covers unusual machine-learning tasks. The board median is 41.2%, so claude-3-sonnet-20240229 is 31.0 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
Strengths and weaknesses
Reasoning, maths and science: weak, ahead of 15% of the field on average across 2 benchmarks. Its best board here is GPQA Diamond (#220 of 275) and its weakest is OTIS Mock AIME (#169 of 189).
Price and value
The median input price across the 427 priced models is $0.500 per million tokens, so claude-3-sonnet-20240229 costs more than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4.1 Flash (high) ($0.010, 48.9), Qwen2.5-Coder-3B-Instruct ($0.010, 46.5). Similar scores cost more on mistral-large-2402 ($8.00) and gpt-4-turbo-2024-04-09 ($10.00).
Release history
The Anthropic model released before it was claude-3-opus-20240229 on 2024-03-04, which scores 43.2. The next one was claude-3-haiku-20240307 on 2024-03-13, at 39.9.
Reading these numbers
The 5 scores on this page come from 2 sources: Epoch AI Benchmarking Hub (4), Aider Aider Code Editing leaderboard (1). 1 of them come from an official leaderboard and 4 from datasets or third-party runs. With 5 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #717 Llama 4 Maverick (42.0)
- #718 Mistral-7B-Instruct-v0.3 (41.9)
- #719 mistral-small-2503 (41.9)
- #721 Phi-4-mini-instruct (41.8)
- #722 granite-4.0-350m (41.6)
- #723 gemini-1.0-pro-001 (41.5)
More from Anthropic
- Claude Opus 5.5 (max) (#1, 64.3)
- Claude Fable 5.1 (max) (#3, 61.9)
- Claude Sonnet 5.5 (max) (#4, 60.8)
- Claude Opus 5 (max) (#8, 60.0)
- Claude Fable 5 (max) (#9, 59.9)
- claude-opus-4-8-xhigh-effort (#14, 56.6)
Compare it on the live leaderboard → · How the aggregate score works