SWE-Llama 7B: benchmark scores, price and ranking

SWE-Llama 7B from Meta ranks #683 of 743 LLMs on the LLMs Tiger aggregate benchmark score (43.2), based on 3 benchmark results captured up to 2026-10-13.

Organisation: Meta
Type: Open-weight / local model
Open weights: Yes
Aggregate rank: #683 of 743 (score 43.2)

Relative to other models, SWE-Llama 7B is strongest on SWE-bench Lite (#18 of 20) and weakest on SWE-bench Verified (#71 of 73).

Across the 3 benchmarks where at least ten models are scored, SWE-Llama 7B is in the top 10% on 0 and in the top half on 0.

SWE-Llama 7B benchmark results

SWE-Llama 7B benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
SWE-bench Lite	1.3%	#18 of 20	SWE-bench Lite leaderboard	2026-10-13
SWE-bench Test	0.7%	#10 of 11	SWE-bench Test leaderboard	2026-10-13
SWE-bench Verified	1.4%	#71 of 73	SWE-bench Verified leaderboard	2026-10-13

About SWE-Llama 7B

SWE-Llama 7B is an open-weight model that can run on your own hardware from Meta. No API price is listed for it yet. We hold 3 benchmark results for it across 2 areas, and none is in the top tenth of its board.

Where SWE-Llama 7B stands

On our aggregate score, SWE-Llama 7B is #683 of 743 ranked models, in the lower half. Its score is 43.2; the scale is centred on 50, so it sits 6.8 points below the typical model. That beats 8% of the ranked field. Among the 6 ranked Meta models it is #6. The next one up is ollama/llama3.2:3b-instruct-fp16 at 44.5.

SWE-Llama 7B, benchmark by benchmark

SWE-bench Lite is a weak spot. SWE-Llama 7B scores 1.3%, #18 of 20, behind 85% of the models measured. The leader, Claude 4 Sonnet, reaches 56.7%. It covers real GitHub issues resolved. The board median is 24.7%, so SWE-Llama 7B is 23.3 points below it. Source: SWE-bench Lite leaderboard, captured 2026-10-13.

SWE-bench Test is a weak spot. SWE-Llama 7B scores 0.7%, #10 of 11, behind 82% of the models measured. The leader, Claude 4.5 Opus, reaches 52.6%. It covers real GitHub issues resolved. The board median is 12.5%, so SWE-Llama 7B is 11.8 points below it. Source: SWE-bench Test leaderboard, captured 2026-10-13.

SWE-bench Verified is a weak spot. SWE-Llama 7B scores 1.4%, #71 of 73, behind 96% of the models measured. The leader, Claude Opus 4.7 (max), reaches 83.5%. It covers real GitHub issues resolved. The board median is 56.4%, so SWE-Llama 7B is 55.0 points below it. Source: SWE-bench Verified leaderboard, captured 2026-10-13.

Strengths and weaknesses

Software engineering: weak, ahead of 6% of the field on average across 2 benchmarks. Its best board here is SWE-bench Lite (#18 of 20) and its weakest is SWE-bench Verified (#71 of 73).

Reading these numbers

The 3 scores on this page come from 3 sources: SWE-bench Lite leaderboard (1), SWE-bench Test leaderboard (1), SWE-bench Verified leaderboard (1). 3 of them come from an official leaderboard and 0 from datasets or third-party runs. With 3 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

#680 mistral-large-2407 (43.3)
#681 granite-3.0-2b-base (43.3)
#682 open-mixtral-8x7b (43.2)
#684 Trinity Large Thinking (43.2)
#685 granite-4.0-micro (43.2)
#686 SWE-Llama 13B (43.2)