Llama-3-Smaug-8B: benchmark scores, price and ranking
Llama-3-Smaug-8B from abacusai ranks #589 of 743 LLMs on the LLMs Tiger aggregate benchmark score (45.4), based on 1 benchmark results captured up to 2026-10-13.
- Organisation
- abacusai
- Type
- Open-weight / local model
- Open weights
- Yes
- Aggregate rank
- #589 of 743 (score 45.4)
Across the 1 benchmark where at least ten models are scored, Llama-3-Smaug-8B is in the top 10% on 0 and in the top half on 0.
Llama-3-Smaug-8B benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| MMLU-Pro | 36.9% | #108 of 136 | HuggingFace MMLU-Pro leaderboard | 2026-10-13 |
About Llama-3-Smaug-8B
Llama-3-Smaug-8B is an open-weight model that can run on your own hardware from abacusai. No API price is listed for it yet. We hold 1 benchmark result for it across 1 area, and none is in the top tenth of its board.
Where Llama-3-Smaug-8B stands
On our aggregate score, Llama-3-Smaug-8B is #589 of 743 ranked models, in the lower half. Its score is 45.4; the scale is centred on 50, so it sits 4.6 points below the typical model. That beats 21% of the ranked field.
Llama-3-Smaug-8B, benchmark by benchmark
Llama-3-Smaug-8B lands below the middle on MMLU-Pro: 36.9%, #108 of 136, with 79% of the field scoring higher. Darwin-180B-RSI leads at 88.1%; the closest result above is LLaDA-8B-Instruct at 37.0%. It covers 57-subject knowledge + reasoning. The board median is 55.3%, so Llama-3-Smaug-8B is 18.3 points below it. Source: HuggingFace MMLU-Pro leaderboard, captured 2026-10-13.
Reading these numbers
The 1 score on this page comes from 1 source: HuggingFace MMLU-Pro leaderboard (1). No official leaderboard supplied any of them, so treat them as third-party measurements. With 1 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #586 GPT-3.5 Turbo (Nov 2023) (45.4)
- #587 internlm2-math-plus-20b (45.4)
- #588 LLaDA-8B-Instruct (45.4)
- #590 grok-build-0.1 (45.4)
- #591 mistral-medium-2505 (45.4)
- #592 Devstral Small 2 (45.4)
Compare it on the live leaderboard → · How the aggregate score works