claude-3.5-sonnet-20240620: benchmark scores, price and ranking

claude-3.5-sonnet-20240620 from Anthropic ranks #52 of 743 LLMs on the LLMs Tiger aggregate benchmark score (52.7), based on 2 benchmark results captured up to 2026-10-13.

Organisation: Anthropic
Type: Frontier model
Open weights: No
Released: 2024-06-20 (source: name)
Cheapest API price: $3.00 in / $15.00 out per million tokens (via vertex_ai, observed 2026-10-13T20:47Z)
Aggregate rank: #52 of 743 (score 52.7)

Across the 2 benchmarks where at least ten models are scored, claude-3.5-sonnet-20240620 is in the top 10% on 1 and in the top half on 2.

Its cheapest listed input price, $3.00 per million tokens, is lower than that of 11% of the 427 models with a listed price.

claude-3.5-sonnet-20240620 benchmark results

claude-3.5-sonnet-20240620 benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
Aider Code Editing	77.4%	#4 of 92	Aider Aider Code Editing leaderboard	2026-10-13
Aider Refactoring	64.0%	#4 of 12	Aider Aider Refactoring leaderboard	2026-10-13

About claude-3.5-sonnet-20240620

claude-3.5-sonnet-20240620 is a frontier model from Anthropic. It was released on 2024-06-20, according to the model's own name. The cheapest API listing we track charges $3.00 per million input tokens and $15.00 per million output tokens, through vertex_ai. We hold 2 benchmark results for it across 2 areas, and 1 is in the top tenth of its board.

Where claude-3.5-sonnet-20240620 stands

On our aggregate score, claude-3.5-sonnet-20240620 is #52 of 743 ranked models, in the top quarter. Its score is 52.7; the scale is centred on 50, so it sits 2.7 points above the typical model. That beats 93% of the ranked field. Among the 70 ranked Anthropic models it is #13. The next one up is CodeAct v2.1 (claude-3-5-sonnet-20241022) at 52.8. The next one down is Claude Sonnet 5 (max) at 52.7.

claude-3.5-sonnet-20240620, benchmark by benchmark

On Aider Code Editing, claude-3.5-sonnet-20240620 scores 77.4% and ranks #4 of 92. Only 3 models score higher, led by Claude 3.5-Sonnet-20241022 at 84.2%, which is 6.8 points ahead. It covers Aider official benchmark. The board median is 55.6%, so claude-3.5-sonnet-20240620 is 21.8 points above it. Source: Aider Aider Code Editing leaderboard, captured 2026-10-13.

On Aider Refactoring, claude-3.5-sonnet-20240620 reaches 64.0%. It ranks #4 of 12, ahead of 67% of the field, and 28.1 points behind Claude 3.5-Sonnet-20241022 at 92.1%. The results either side are claude-3-opus-20240229 (72.3%) and GPT-4o (62.9%). It covers Aider official benchmark. The board median is 50.0%, so claude-3.5-sonnet-20240620 is 14.0 points above it. Source: Aider Aider Refactoring leaderboard, captured 2026-10-13.

Strengths and weaknesses

claude-3.5-sonnet-20240620 has too few results on boards with ten or more models to say where it is strong or weak. Treat any single score as a data point, not a verdict.

Price and value

The median input price across the 427 priced models is $0.500 per million tokens, so claude-3.5-sonnet-20240620 costs more than the typical listing. Models that score within 1.5 points or better and cost less: DeepSeek V4 Flash 0731 (max) ($0.016, 53.1), GLM-5.2 (high) ($0.060, 51.6), Qwen3-Coder-30B-A3B-Instruct ($0.070, 52.7). Similar scores cost more on Claude Opus 4.7 (max) ($5.00) and Claude Opus 4.6 (max) ($5.00).

Release history

The Anthropic model released before it was Claude 3.5 Sonnet on 2024-06-20, which scores 49.2. The next one was Claude 3.5 Sonnet (Jun 2024) on 2024-06-20, at 44.2.

Reading these numbers

The 2 scores on this page come from 2 sources: Aider Aider Code Editing leaderboard (1), Aider Aider Refactoring leaderboard (1). 2 of them come from an official leaderboard and 0 from datasets or third-party runs. With 2 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

#49 Solar-Open2-250B (52.9)
#50 Kimi K2.5 (Fireworks) (52.8)
#51 CodeAct v2.1 (claude-3-5-sonnet-20241022) (52.8)
#53 Qwen3-Coder-30B-A3B-Instruct (52.7)
#54 GPT-5.1 (high) (52.7)
#55 Claude Sonnet 5 (max) (52.7)