granite-4.1-8b: benchmark scores, price and ranking
granite-4.1-8b from ibm-granite ranks #461 of 743 LLMs on the LLMs Tiger aggregate benchmark score (47.1), based on 3 benchmark results captured up to 2026-10-13.
- Organisation
- ibm-granite
- Type
- Open-weight / local model
- Open weights
- Yes
- Cheapest API price
- $0.050 in / $0.100 out per million tokens (via wandb, observed 2026-10-13T21:47Z)
- Aggregate rank
- #461 of 743 (score 47.1)
Relative to other models, granite-4.1-8b is strongest on GSM8K (#5 of 17) and weakest on GPQA Diamond (#215 of 275).
Across the 3 benchmarks where at least ten models are scored, granite-4.1-8b is in the top 10% on 0 and in the top half on 2.
Its cheapest listed input price, $0.050 per million tokens, is lower than that of 90% of the 427 models with a listed price.
granite-4.1-8b benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| GSM8K | 92.5% | #5 of 17 | HuggingFace GSM8K leaderboard | 2026-10-13 |
| MMLU-Pro | 56.0% | #67 of 136 | HuggingFace MMLU-Pro leaderboard | 2026-10-13 |
| GPQA Diamond | 42.0% | #215 of 275 | HuggingFace GPQA Diamond leaderboard | 2026-10-13 |
About granite-4.1-8b
granite-4.1-8b is an open-weight model that can run on your own hardware from ibm-granite. The cheapest API listing we track charges $0.050 per million input tokens and $0.100 per million output tokens, through wandb. We hold 3 benchmark results for it across 2 areas, and none is in the top tenth of its board.
Where granite-4.1-8b stands
On our aggregate score, granite-4.1-8b is #461 of 743 ranked models, in the lower half. Its score is 47.1; the scale is centred on 50, so it sits 2.9 points below the typical model. That beats 38% of the ranked field. Among the 9 ranked ibm-granite models it is #1. The next one down is granite-4.1-30b at 45.5.
granite-4.1-8b, benchmark by benchmark
GSM8K puts granite-4.1-8b at 92.5%, #5 of 17. That beats 71% of the models tested, but 7.1 points short of mimo-v2.5-pro (99.6%). The results either side are Llama-3.2-90B-Vision-Instruct (93.1%) and Phi-3-medium-4k-instruct (91.0%). It covers grade-school math word problems. The board median is 86.9%, so granite-4.1-8b is 5.6 points above it. Source: HuggingFace GSM8K leaderboard, captured 2026-10-13.
On MMLU-Pro, granite-4.1-8b reaches 56.0%. It ranks #67 of 136, ahead of 51% of the field, and 32.1 points behind Darwin-180B-RSI at 88.1%. The results either side are ERNIE-4.5-21B-A3B-Base-PT (56.7%) and Phi-3-medium-4k-instruct (55.7%). It covers 57-subject knowledge + reasoning. The board median is 55.3%, so granite-4.1-8b is 0.7 points above it. Source: HuggingFace MMLU-Pro leaderboard, captured 2026-10-13.
granite-4.1-8b lands below the middle on GPQA Diamond: 42.0%, #215 of 275, with 78% of the field scoring higher. GPT-6 Astra (max) leads at 95.8%; the closest result above is GPT-4 Turbo Preview (January 2024) at 42.3%. It covers expert-level science questions. The board median is 71.7%, so granite-4.1-8b is 29.8 points below it. Source: HuggingFace GPQA Diamond leaderboard, captured 2026-10-13.
Strengths and weaknesses
Reasoning, maths and science: uneven, ahead of 36% of the field on average across 2 benchmarks. Its best board here is MMLU-Pro (#67 of 136) and its weakest is GPQA Diamond (#215 of 275).
Price and value
The median input price across the 427 priced models is $0.500 per million tokens, so granite-4.1-8b costs less than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4.1 Flash (high) ($0.010, 48.9), Qwen2.5-Coder-3B-Instruct ($0.010, 46.5). Similar scores cost more on Qwen2.5 Coder 32B Instruct ($0.060) and amazon.nova-lite-v1:0 ($0.060).
Reading these numbers
The 3 scores on this page come from 3 sources: HuggingFace GPQA Diamond leaderboard (1), HuggingFace GSM8K leaderboard (1), HuggingFace MMLU-Pro leaderboard (1). No official leaderboard supplied any of them, so treat them as third-party measurements. With 3 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #458 GPT-4o (47.2)
- #459 openhands-lm-32b-v0.1 (47.2)
- #460 qwen3.7-max-20260517 (47.2)
- #462 GPT-4o mini (47.1)
- #463 Qwen1.5-110B (47.1)
- #464 gpt-5.5-xhigh (codex-harness) (47.1)
More from ibm-granite
- granite-4.1-30b (#577, 45.5)
- granite-3.1-8b-base (#619, 44.9)
- granite-3.0-8b-base (#629, 44.6)
- granite-4.1-3b (#639, 44.4)
- granite-3.1-2b-base (#669, 43.6)
- granite-3.0-2b-base (#681, 43.3)
Compare it on the live leaderboard → · How the aggregate score works