claude-3-5-haiku-20241022: benchmark scores, price and ranking

claude-3-5-haiku-20241022 from Anthropic ranks #168 of 743 LLMs on the LLMs Tiger aggregate benchmark score (50.8), based on 2 benchmark results captured up to 2026-10-13.

Organisation
Anthropic
Type
Fast / low-cost (flash) model
Open weights
No
Released
2024-10-22 (source: name)
Cheapest API price
$1.00 in / $5.00 out per million tokens (via vertex_ai, observed 2026-10-13T20:47Z)
Aggregate rank
#168 of 743 (score 50.8)

Across the 2 benchmarks where at least ten models are scored, claude-3-5-haiku-20241022 is in the top 10% on 1 and in the top half on 1.

Its cheapest listed input price, $1.00 per million tokens, is lower than that of 35% of the 427 models with a listed price.

claude-3-5-haiku-20241022 benchmark results

claude-3-5-haiku-20241022 benchmark scores, ranked against all models measured on each benchmark
BenchmarkScoreRankSourceCaptured
Aider Code Editing75.2%#5 of 92Aider Aider Code Editing leaderboard2026-10-13
Aider Polyglot28.0%#31 of 49Aider polyglot leaderboard2026-10-13

About claude-3-5-haiku-20241022

claude-3-5-haiku-20241022 is a smaller, lower-cost model from Anthropic. It was released on 2024-10-22, according to the model's own name. The cheapest API listing we track charges $1.00 per million input tokens and $5.00 per million output tokens, through vertex_ai. We hold 2 benchmark results for it across 1 area, and 1 is in the top tenth of its board.

Where claude-3-5-haiku-20241022 stands

On our aggregate score, claude-3-5-haiku-20241022 is #168 of 743 ranked models, in the top quarter. Its score is 50.8; the scale is centred on 50, so it sits 0.8 points above the typical model. That beats 77% of the ranked field. Among the 70 ranked Anthropic models it is #27. The next one up is claude-sonnet-4-20250514_59K at 50.9. The next one down is claude-opus-4-1-20250805_27K at 50.7.

claude-3-5-haiku-20241022, benchmark by benchmark

On Aider Code Editing, claude-3-5-haiku-20241022 scores 75.2% and ranks #5 of 92. Only 4 models score higher, led by Claude 3.5-Sonnet-20241022 at 84.2%, which is 9.0 points ahead. It covers Aider official benchmark. The board median is 55.6%, so claude-3-5-haiku-20241022 is 19.6 points above it. Source: Aider Aider Code Editing leaderboard, captured 2026-10-13.

claude-3-5-haiku-20241022 lands below the middle on Aider Polyglot: 28.0%, #31 of 49, with 61% of the field scoring higher. gemini-2.5-pro-preview-06-05 leads at 83.1%; the closest result above is GPT-4.1 mini at 32.4%. It covers edits across 6 languages (225 exercises). The board median is 44.9%, so claude-3-5-haiku-20241022 is 16.9 points below it. Source: Aider polyglot leaderboard, captured 2026-10-13.

Strengths and weaknesses

Software engineering: solid, ahead of 66% of the field on average across 2 benchmarks. Its best board here is Aider Code Editing (#5 of 92) and its weakest is Aider Polyglot (#31 of 49).

Price and value

The median input price across the 427 priced models is $0.500 per million tokens, so claude-3-5-haiku-20241022 costs more than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4 Flash 0731 (max) ($0.016, 53.1), GLM-5.3-Flash (max) ($0.026, 49.6). Similar scores cost more on DeepSeek v4 Pro (max) ($1.15) and Muse Spark 1.2 (xhigh) ($1.25).

Release history

The Anthropic model released before it was Claude 3.5 Haiku on 2024-10-22, which scores 48.5. The next one was Claude 3.5 Haiku (Oct 2024) on 2024-10-22, at 41.3.

Reading these numbers

The 2 scores on this page come from 2 sources: Aider Aider Code Editing leaderboard (1), Aider polyglot leaderboard (1). 2 of them come from an official leaderboard and 0 from datasets or third-party runs. With 2 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

More from Anthropic

Compare it on the live leaderboard → · How the aggregate score works