SWE-Llama 13B: benchmark scores, price and ranking
SWE-Llama 13B ranks #686 of 743 LLMs on the LLMs Tiger aggregate benchmark score (43.2), based on 3 benchmark results captured up to 2026-10-13.
- Type
- Open-weight / local model
- Open weights
- Yes
- Aggregate rank
- #686 of 743 (score 43.2)
Relative to other models, SWE-Llama 13B is strongest on SWE-bench Test (#9 of 11) and weakest on SWE-bench Verified (#72 of 73).
Across the 3 benchmarks where at least ten models are scored, SWE-Llama 13B is in the top 10% on 0 and in the top half on 0.
SWE-Llama 13B benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| SWE-bench Test | 0.7% | #9 of 11 | SWE-bench Test leaderboard | 2026-10-13 |
| SWE-bench Lite | 1.0% | #19 of 20 | SWE-bench Lite leaderboard | 2026-10-13 |
| SWE-bench Verified | 1.2% | #72 of 73 | SWE-bench Verified leaderboard | 2026-10-13 |
About SWE-Llama 13B
SWE-Llama 13B is an open-weight model that can run on your own hardware. No API price is listed for it yet. We hold 3 benchmark results for it across 2 areas, and none is in the top tenth of its board.
Where SWE-Llama 13B stands
On our aggregate score, SWE-Llama 13B is #686 of 743 ranked models, in the lower half. Its score is 43.2; the scale is centred on 50, so it sits 6.8 points below the typical model. That beats 8% of the ranked field.
SWE-Llama 13B, benchmark by benchmark
SWE-bench Test is a weak spot. SWE-Llama 13B scores 0.7%, #9 of 11, behind 73% of the models measured. The leader, Claude 4.5 Opus, reaches 52.6%. It covers real GitHub issues resolved. The board median is 12.5%, so SWE-Llama 13B is 11.8 points below it. Source: SWE-bench Test leaderboard, captured 2026-10-13.
SWE-bench Lite is a weak spot. SWE-Llama 13B scores 1.0%, #19 of 20, behind 90% of the models measured. The leader, Claude 4 Sonnet, reaches 56.7%. It covers real GitHub issues resolved. The board median is 24.7%, so SWE-Llama 13B is 23.7 points below it. Source: SWE-bench Lite leaderboard, captured 2026-10-13.
SWE-bench Verified is a weak spot. SWE-Llama 13B scores 1.2%, #72 of 73, behind 97% of the models measured. The leader, Claude Opus 4.7 (max), reaches 83.5%. It covers real GitHub issues resolved. The board median is 56.4%, so SWE-Llama 13B is 55.2 points below it. Source: SWE-bench Verified leaderboard, captured 2026-10-13.
Strengths and weaknesses
Software engineering: weak, ahead of 3% of the field on average across 2 benchmarks. Its best board here is SWE-bench Lite (#19 of 20) and its weakest is SWE-bench Verified (#72 of 73).
Reading these numbers
The 3 scores on this page come from 3 sources: SWE-bench Lite leaderboard (1), SWE-bench Test leaderboard (1), SWE-bench Verified leaderboard (1). 3 of them come from an official leaderboard and 0 from datasets or third-party runs. With 3 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #683 SWE-Llama 7B (43.2)
- #684 Trinity Large Thinking (43.2)
- #685 granite-4.0-micro (43.2)
- #687 claude-3-opus-20240229 (43.2)
- #688 granite-3.1-3b-a800m-base (43.1)
- #689 GPT-4.1 mini (43.0)
Compare it on the live leaderboard → · How the aggregate score works