Claude 4.5 Haiku: benchmark scores, price and ranking
Claude 4.5 Haiku from Anthropic ranks #197 of 743 LLMs on the LLMs Tiger aggregate benchmark score (50.3), based on 2 benchmark results captured up to 2026-10-13.
- Organisation
- Anthropic
- Type
- Fast / low-cost (flash) model
- Open weights
- No
- Released
- 2025-10-15 (source: curated)
- Cheapest API price
- $1.00 in / $5.00 out per million tokens (via replicate, observed 2026-10-13T20:47Z)
- Aggregate rank
- #197 of 743 (score 50.3)
Across the 2 benchmarks where at least ten models are scored, Claude 4.5 Haiku is in the top 10% on 0 and in the top half on 1.
Its cheapest listed input price, $1.00 per million tokens, is lower than that of 35% of the 427 models with a listed price.
Claude 4.5 Haiku benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| SWE-bench Verified | 66.6% | #24 of 73 | SWE-bench Verified leaderboard | 2026-10-13 |
| SWE-bench Multilingual | 64.7% | #10 of 11 | SWE-bench Multilingual leaderboard | 2026-10-13 |
About Claude 4.5 Haiku
Claude 4.5 Haiku is a smaller, lower-cost model from Anthropic. It was released on 2025-10-15, according to the developer's announcement. The cheapest API listing we track charges $1.00 per million input tokens and $5.00 per million output tokens, through replicate. We hold 2 benchmark results for it across 2 areas, and none is in the top tenth of its board.
Where Claude 4.5 Haiku stands
On our aggregate score, Claude 4.5 Haiku is #197 of 743 ranked models, around the middle of the table. Its score is 50.3; the scale is centred on 50, so it sits 0.3 points above the typical model. That beats 73% of the ranked field. Among the 70 ranked Anthropic models it is #33. The next one up is Claude 3.7 Sonnet (64k thinking) at 50.4. The next one down is claude-opus-4-5-20251101-thinking-64k-high-effort at 50.3.
Claude 4.5 Haiku, benchmark by benchmark
SWE-bench Verified puts Claude 4.5 Haiku at 66.6%, #24 of 73. That beats 67% of the models tested, but 16.9 points short of Claude Opus 4.7 (max) (83.5%). The results either side are Claude 4 Opus (67.6%) and GPT-5.1 Codex (66.0%). It covers real GitHub issues resolved. The board median is 56.4%, so Claude 4.5 Haiku is 10.2 points above it. Source: SWE-bench Verified leaderboard, captured 2026-10-13.
SWE-bench Multilingual is a weak spot. Claude 4.5 Haiku scores 64.7%, #10 of 11, behind 82% of the models measured. The leader, Gemini 3 Flash, reaches 72.7%. It covers real GitHub issues resolved. The board median is 68.3%, so Claude 4.5 Haiku is 3.6 points below it. Source: SWE-bench Multilingual leaderboard, captured 2026-10-13.
Strengths and weaknesses
Claude 4.5 Haiku has too few results on boards with ten or more models to say where it is strong or weak. Treat any single score as a data point, not a verdict.
Price and value
The median input price across the 427 priced models is $0.500 per million tokens, so Claude 4.5 Haiku costs more than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4.1 Flash (high) ($0.010, 48.9), DeepSeek V4 Flash 0731 (max) ($0.016, 53.1). Similar scores cost more on DeepSeek v4 Pro (max) ($1.15) and Muse Spark 1.2 (xhigh) ($1.25).
Release history
The Anthropic model released before it was claude-haiku-4-5-20251001_1K on 2025-10-01, which scores 49.8. The next one was claude-haiku-4-5-20251001 on 2025-10-15, at 45.2.
Reading these numbers
The 2 scores on this page come from 2 sources: SWE-bench Multilingual leaderboard (1), SWE-bench Verified leaderboard (1). 1 of them come from an official leaderboard and 1 from datasets or third-party runs. With 2 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #194 Nemotron-Cascade-2-30B-A3B (50.4)
- #195 DeepSeek-V3.2-Speciale (50.4)
- #196 gemini-2.5-flash-preview-04-17 (50.4)
- #198 claude-opus-4-5-20251101-thinking-64k-high-effort (50.3)
- #199 Grok Build + Grok 4.7 (50.3)
- #200 CodeAct v1.8 (50.3)
More from Anthropic
- Claude Opus 5.5 (max) (#1, 64.3)
- Claude Fable 5.1 (max) (#3, 61.9)
- Claude Sonnet 5.5 (max) (#4, 60.8)
- Claude Opus 5 (max) (#8, 60.0)
- Claude Fable 5 (max) (#9, 59.9)
- claude-opus-4-8-xhigh-effort (#14, 56.6)
Compare it on the live leaderboard → · How the aggregate score works