Llama-3-Smaug-8B: benchmark scores, price and ranking

Llama-3-Smaug-8B from abacusai ranks #589 of 743 LLMs on the LLMs Tiger aggregate benchmark score (45.4), based on 1 benchmark results captured up to 2026-10-13.

Organisation
abacusai
Type
Open-weight / local model
Open weights
Yes
Aggregate rank
#589 of 743 (score 45.4)

Across the 1 benchmark where at least ten models are scored, Llama-3-Smaug-8B is in the top 10% on 0 and in the top half on 0.

Llama-3-Smaug-8B benchmark results

Llama-3-Smaug-8B benchmark scores, ranked against all models measured on each benchmark
BenchmarkScoreRankSourceCaptured
MMLU-Pro36.9%#108 of 136HuggingFace MMLU-Pro leaderboard2026-10-13

About Llama-3-Smaug-8B

Llama-3-Smaug-8B is an open-weight model that can run on your own hardware from abacusai. No API price is listed for it yet. We hold 1 benchmark result for it across 1 area, and none is in the top tenth of its board.

Where Llama-3-Smaug-8B stands

On our aggregate score, Llama-3-Smaug-8B is #589 of 743 ranked models, in the lower half. Its score is 45.4; the scale is centred on 50, so it sits 4.6 points below the typical model. That beats 21% of the ranked field.

Llama-3-Smaug-8B, benchmark by benchmark

Llama-3-Smaug-8B lands below the middle on MMLU-Pro: 36.9%, #108 of 136, with 79% of the field scoring higher. Darwin-180B-RSI leads at 88.1%; the closest result above is LLaDA-8B-Instruct at 37.0%. It covers 57-subject knowledge + reasoning. The board median is 55.3%, so Llama-3-Smaug-8B is 18.3 points below it. Source: HuggingFace MMLU-Pro leaderboard, captured 2026-10-13.

Reading these numbers

The 1 score on this page comes from 1 source: HuggingFace MMLU-Pro leaderboard (1). No official leaderboard supplied any of them, so treat them as third-party measurements. With 1 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

Compare it on the live leaderboard → · How the aggregate score works