CodeAct v2.1 (claude-3-5-sonnet-20241022): benchmark scores, price and ranking
CodeAct v2.1 (claude-3-5-sonnet-20241022) from Anthropic ranks #51 of 743 LLMs on the LLMs Tiger aggregate benchmark score (52.8), based on 2 benchmark results captured up to 2026-10-13.
- Organisation
- Anthropic
- Type
- Frontier model
- Open weights
- No
- Aggregate rank
- #51 of 743 (score 52.8)
Across the 2 benchmarks where at least ten models are scored, CodeAct v2.1 (claude-3-5-sonnet-20241022) is in the top 10% on 0 and in the top half on 2.
CodeAct v2.1 (claude-3-5-sonnet-20241022) benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| SWE-bench Lite | 41.7% | #3 of 20 | SWE-bench Lite leaderboard | 2026-10-13 |
| SWE-bench Test | 29.4% | #2 of 11 | SWE-bench Test leaderboard | 2026-10-13 |
About CodeAct v2.1 (claude-3-5-sonnet-20241022)
CodeAct v2.1 (claude-3-5-sonnet-20241022) is a frontier model from Anthropic. No API price is listed for it yet. We hold 2 benchmark results for it across 2 areas, and none is in the top tenth of its board.
Where CodeAct v2.1 (claude-3-5-sonnet-20241022) stands
On our aggregate score, CodeAct v2.1 (claude-3-5-sonnet-20241022) is #51 of 743 ranked models, in the top quarter. Its score is 52.8; the scale is centred on 50, so it sits 2.8 points above the typical model. That beats 93% of the ranked field. Among the 70 ranked Anthropic models it is #12. The next one up is Claude Mythos Preview (Early) at 53.0. The next one down is claude-3.5-sonnet-20240620 at 52.7.
CodeAct v2.1 (claude-3-5-sonnet-20241022), benchmark by benchmark
SWE-bench Lite puts CodeAct v2.1 (claude-3-5-sonnet-20241022) at 41.7%, #3 of 20. That beats 85% of the models tested, but 15.0 points short of Claude 4 Sonnet (56.7%). The results either side are Qwen3-Coder-30B-A3B-Instruct (49.7%) and GPT-4 (0806) (39.7%). It covers real GitHub issues resolved. The board median is 24.7%, so CodeAct v2.1 (claude-3-5-sonnet-20241022) is 17.0 points above it. Source: SWE-bench Lite leaderboard, captured 2026-10-13.
On SWE-bench Test, CodeAct v2.1 (claude-3-5-sonnet-20241022) reaches 29.4%. It ranks #2 of 11, ahead of 82% of the field, and 23.2 points behind Claude 4.5 Opus at 52.6%. The results either side are Claude 4.5 Opus (52.6%) and Claude 3.5-Sonnet-20241022 (24.9%). It covers real GitHub issues resolved. The board median is 12.5%, so CodeAct v2.1 (claude-3-5-sonnet-20241022) is 16.9 points above it. Source: SWE-bench Test leaderboard, captured 2026-10-13.
Strengths and weaknesses
CodeAct v2.1 (claude-3-5-sonnet-20241022) has too few results on boards with ten or more models to say where it is strong or weak. Treat any single score as a data point, not a verdict.
Reading these numbers
The 2 scores on this page come from 2 sources: SWE-bench Lite leaderboard (1), SWE-bench Test leaderboard (1). 2 of them come from an official leaderboard and 0 from datasets or third-party runs. With 2 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #48 Gemini 2.5 Pro Preview 05-06 (53.0)
- #49 Solar-Open2-250B (52.9)
- #50 Kimi K2.5 (Fireworks) (52.8)
- #52 claude-3.5-sonnet-20240620 (52.7)
- #53 Qwen3-Coder-30B-A3B-Instruct (52.7)
- #54 GPT-5.1 (high) (52.7)
More from Anthropic
- Claude Opus 5.5 (max) (#1, 64.3)
- Claude Fable 5.1 (max) (#3, 61.9)
- Claude Sonnet 5.5 (max) (#4, 60.8)
- Claude Opus 5 (max) (#8, 60.0)
- Claude Fable 5 (max) (#9, 59.9)
- claude-opus-4-8-xhigh-effort (#14, 56.6)
Compare it on the live leaderboard → · How the aggregate score works