claude-3-5-haiku-20241022: benchmark scores, price and ranking
claude-3-5-haiku-20241022 from Anthropic ranks #168 of 743 LLMs on the LLMs Tiger aggregate benchmark score (50.8), based on 2 benchmark results captured up to 2026-10-13.
- Organisation
- Anthropic
- Type
- Fast / low-cost (flash) model
- Open weights
- No
- Released
- 2024-10-22 (source: name)
- Cheapest API price
- $1.00 in / $5.00 out per million tokens (via vertex_ai, observed 2026-10-13T20:47Z)
- Aggregate rank
- #168 of 743 (score 50.8)
Across the 2 benchmarks where at least ten models are scored, claude-3-5-haiku-20241022 is in the top 10% on 1 and in the top half on 1.
Its cheapest listed input price, $1.00 per million tokens, is lower than that of 35% of the 427 models with a listed price.
claude-3-5-haiku-20241022 benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| Aider Code Editing | 75.2% | #5 of 92 | Aider Aider Code Editing leaderboard | 2026-10-13 |
| Aider Polyglot | 28.0% | #31 of 49 | Aider polyglot leaderboard | 2026-10-13 |
About claude-3-5-haiku-20241022
claude-3-5-haiku-20241022 is a smaller, lower-cost model from Anthropic. It was released on 2024-10-22, according to the model's own name. The cheapest API listing we track charges $1.00 per million input tokens and $5.00 per million output tokens, through vertex_ai. We hold 2 benchmark results for it across 1 area, and 1 is in the top tenth of its board.
Where claude-3-5-haiku-20241022 stands
On our aggregate score, claude-3-5-haiku-20241022 is #168 of 743 ranked models, in the top quarter. Its score is 50.8; the scale is centred on 50, so it sits 0.8 points above the typical model. That beats 77% of the ranked field. Among the 70 ranked Anthropic models it is #27. The next one up is claude-sonnet-4-20250514_59K at 50.9. The next one down is claude-opus-4-1-20250805_27K at 50.7.
claude-3-5-haiku-20241022, benchmark by benchmark
On Aider Code Editing, claude-3-5-haiku-20241022 scores 75.2% and ranks #5 of 92. Only 4 models score higher, led by Claude 3.5-Sonnet-20241022 at 84.2%, which is 9.0 points ahead. It covers Aider official benchmark. The board median is 55.6%, so claude-3-5-haiku-20241022 is 19.6 points above it. Source: Aider Aider Code Editing leaderboard, captured 2026-10-13.
claude-3-5-haiku-20241022 lands below the middle on Aider Polyglot: 28.0%, #31 of 49, with 61% of the field scoring higher. gemini-2.5-pro-preview-06-05 leads at 83.1%; the closest result above is GPT-4.1 mini at 32.4%. It covers edits across 6 languages (225 exercises). The board median is 44.9%, so claude-3-5-haiku-20241022 is 16.9 points below it. Source: Aider polyglot leaderboard, captured 2026-10-13.
Strengths and weaknesses
Software engineering: solid, ahead of 66% of the field on average across 2 benchmarks. Its best board here is Aider Code Editing (#5 of 92) and its weakest is Aider Polyglot (#31 of 49).
Price and value
The median input price across the 427 priced models is $0.500 per million tokens, so claude-3-5-haiku-20241022 costs more than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4 Flash 0731 (max) ($0.016, 53.1), GLM-5.3-Flash (max) ($0.026, 49.6). Similar scores cost more on DeepSeek v4 Pro (max) ($1.15) and Muse Spark 1.2 (xhigh) ($1.25).
Release history
The Anthropic model released before it was Claude 3.5 Haiku on 2024-10-22, which scores 48.5. The next one was Claude 3.5 Haiku (Oct 2024) on 2024-10-22, at 41.3.
Reading these numbers
The 2 scores on this page come from 2 sources: Aider Aider Code Editing leaderboard (1), Aider polyglot leaderboard (1). 2 of them come from an official leaderboard and 0 from datasets or third-party runs. With 2 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #165 Claude Code + GLM-5.3 (50.8)
- #166 gpt-4-0314 (50.8)
- #167 SWE-1.7 (50.8)
- #169 DeepSeek V3 0324 (50.8)
- #170 o3-mini_1.0 (50.7)
- #171 claude-opus-4-1-20250805_27K (50.7)
More from Anthropic
- Claude Opus 5.5 (max) (#1, 64.3)
- Claude Fable 5.1 (max) (#3, 61.9)
- Claude Sonnet 5.5 (max) (#4, 60.8)
- Claude Opus 5 (max) (#8, 60.0)
- Claude Fable 5 (max) (#9, 59.9)
- claude-opus-4-8-xhigh-effort (#14, 56.6)
Compare it on the live leaderboard → · How the aggregate score works