gemma-2-9b-it: benchmark scores, price and ranking
gemma-2-9b-it from Google DeepMind ranks #691 of 743 LLMs on the LLMs Tiger aggregate benchmark score (43.0), based on 2 benchmark results captured up to 2026-10-13.
- Organisation
- Google DeepMind
- Type
- Open-weight / local model
- Open weights
- Yes
- Released
- 2024-06-24 (source: epoch)
- Aggregate rank
- #691 of 743 (score 43.0)
Across the 2 benchmarks where at least ten models are scored, gemma-2-9b-it is in the top 10% on 0 and in the top half on 0.
gemma-2-9b-it benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| GPQA Diamond | 27.5% | #257 of 275 | Epoch AI Benchmarking Hub | 2026-10-13 |
| OTIS Mock AIME | 0.6% | #184 of 189 | Epoch AI Benchmarking Hub | 2026-10-13 |
About gemma-2-9b-it
gemma-2-9b-it is an open-weight model that can run on your own hardware from Google DeepMind. It was released on 2024-06-24, according to Epoch AI. No API price is listed for it yet. We hold 2 benchmark results for it across 1 area, and none is in the top tenth of its board.
Where gemma-2-9b-it stands
On our aggregate score, gemma-2-9b-it is #691 of 743 ranked models, in the lower half. Its score is 43.0; the scale is centred on 50, so it sits 7.0 points below the typical model. That beats 7% of the ranked field. Among the 41 ranked Google DeepMind models it is #33. The next one up is gemma-2-27b at 43.7. The next one down is gemini-1.5-flash-002 at 42.8.
gemma-2-9b-it, benchmark by benchmark
GPQA Diamond is a weak spot. gemma-2-9b-it scores 27.5%, #257 of 275, behind 93% of the models measured. The leader, GPT-6 Astra (max), reaches 95.8%. It covers expert-level science questions. The board median is 71.7%, so gemma-2-9b-it is 44.3 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
OTIS Mock AIME is a weak spot. gemma-2-9b-it scores 0.6%, #184 of 189, behind 97% of the models measured. The leader, Claude Fable 5.1 (max), reaches 100.0%. It covers competition maths (AIME 2024-25 style). The board median is 57.8%, so gemma-2-9b-it is 57.2 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
Strengths and weaknesses
Reasoning, maths and science: weak, ahead of 5% of the field on average across 2 benchmarks. Its best board here is GPQA Diamond (#257 of 275) and its weakest is OTIS Mock AIME (#184 of 189).
Release history
The Google DeepMind model released before it was Gemma 2 9B on 2024-06-24, which scores 46.5. The next one was gemini-1.5-flash-002 on 2024-09-24, at 42.8.
Reading these numbers
The 2 scores on this page come from 1 source: Epoch AI Benchmarking Hub (2). No official leaderboard supplied any of them, so treat them as third-party measurements. With 2 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #688 granite-3.1-3b-a800m-base (43.1)
- #689 GPT-4.1 mini (43.0)
- #690 GPT-3.5 (43.0)
- #692 Llama-2-70b-chat-hf (42.9)
- #693 SmolLM2-1.7B (42.9)
- #694 mistral-large-2402 (42.8)
More from Google DeepMind
- Gemini 3.8 Flash (high) (#26, 54.0)
- Gemini 3.7 Flash (high) (#27, 53.9)
- Gemini 3 Pro Preview (#31, 53.7)
- Gemini 3 Deep Think (#60, 52.6)
- AI co-mathematician (#69, 52.3)
- Gemini 3 Flash (#120, 51.5)
Compare it on the live leaderboard → · How the aggregate score works