llemma_7b: benchmark scores, price and ranking
llemma_7b from EleutherAI ranks #672 of 743 LLMs on the LLMs Tiger aggregate benchmark score (43.6), based on 1 benchmark results captured up to 2026-10-13.
- Organisation
- EleutherAI
- Type
- Open-weight / local model
- Open weights
- Yes
- Aggregate rank
- #672 of 743 (score 43.6)
Across the 1 benchmark where at least ten models are scored, llemma_7b is in the top 10% on 0 and in the top half on 0.
llemma_7b benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| MMLU-Pro | 23.4% | #124 of 136 | HuggingFace MMLU-Pro leaderboard | 2026-10-13 |
About llemma_7b
llemma_7b is an open-weight model that can run on your own hardware from EleutherAI. No API price is listed for it yet. We hold 1 benchmark result for it across 1 area, and none is in the top tenth of its board.
Where llemma_7b stands
On our aggregate score, llemma_7b is #672 of 743 ranked models, in the lower half. Its score is 43.6; the scale is centred on 50, so it sits 6.4 points below the typical model. That beats 10% of the ranked field.
llemma_7b, benchmark by benchmark
MMLU-Pro is a weak spot. llemma_7b scores 23.4%, #124 of 136, behind 90% of the models measured. The leader, Darwin-180B-RSI, reaches 88.1%. It covers 57-subject knowledge + reasoning. The board median is 55.3%, so llemma_7b is 31.8 points below it. Source: HuggingFace MMLU-Pro leaderboard, captured 2026-10-13.
Reading these numbers
The 1 score on this page comes from 1 source: HuggingFace MMLU-Pro leaderboard (1). No official leaderboard supplied any of them, so treat them as third-party measurements. With 1 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #669 granite-3.1-2b-base (43.6)
- #670 deepseek-r1-0528-qwen3-8b (43.6)
- #671 ollama/granite3-dense:8b (43.6)
- #673 Mixtral-8x22B-Instruct-v0.1 (43.5)
- #674 Mistral Medium 3.5 (43.5)
- #675 Qwen2-1.5B-Instruct (43.4)
Compare it on the live leaderboard → · How the aggregate score works