gemini-1.5-flash-8b-001: benchmark scores, price and ranking
gemini-1.5-flash-8b-001 from Google DeepMind ranks #716 of 743 LLMs on the LLMs Tiger aggregate benchmark score (42.0), based on 3 benchmark results captured up to 2026-10-13.
- Organisation
- Google DeepMind
- Type
- Fast / low-cost (flash) model
- Open weights
- No
- Released
- 2024-10-03 (source: epoch)
- Aggregate rank
- #716 of 743 (score 42.0)
Relative to other models, gemini-1.5-flash-8b-001 is strongest on OTIS Mock AIME (#159 of 189) and weakest on DTBench (#131 of 146).
Across the 3 benchmarks where at least ten models are scored, gemini-1.5-flash-8b-001 is in the top 10% on 0 and in the top half on 0.
gemini-1.5-flash-8b-001 benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| OTIS Mock AIME | 4.6% | #159 of 189 | Epoch AI Benchmarking Hub | 2026-10-13 |
| GPQA Diamond | 33.0% | #242 of 275 | Epoch AI Benchmarking Hub | 2026-10-13 |
| DTBench | 50.0% | #131 of 146 | Epoch AI Benchmarking Hub | 2026-10-13 |
About gemini-1.5-flash-8b-001
gemini-1.5-flash-8b-001 is a smaller, lower-cost model from Google DeepMind. It was released on 2024-10-03, according to Epoch AI. No API price is listed for it yet. We hold 3 benchmark results for it across 2 areas, and none is in the top tenth of its board.
Where gemini-1.5-flash-8b-001 stands
On our aggregate score, gemini-1.5-flash-8b-001 is #716 of 743 ranked models, in the lower half. Its score is 42.0; the scale is centred on 50, so it sits 8.0 points below the typical model. That beats 4% of the ranked field. Among the 41 ranked Google DeepMind models it is #37. The next one up is gemma-3-1b-it at 42.4. The next one down is gemini-1.0-pro-001 at 41.5.
gemini-1.5-flash-8b-001, benchmark by benchmark
OTIS Mock AIME is a weak spot. gemini-1.5-flash-8b-001 scores 4.6%, #159 of 189, behind 84% of the models measured. The leader, Claude Fable 5.1 (max), reaches 100.0%. It covers competition maths (AIME 2024-25 style). The board median is 57.8%, so gemini-1.5-flash-8b-001 is 53.2 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
GPQA Diamond is a weak spot. gemini-1.5-flash-8b-001 scores 33.0%, #242 of 275, behind 88% of the models measured. The leader, GPT-6 Astra (max), reaches 95.8%. It covers expert-level science questions. The board median is 71.7%, so gemini-1.5-flash-8b-001 is 38.8 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
DTBench is a weak spot. gemini-1.5-flash-8b-001 scores 50.0%, #131 of 146, behind 89% of the models measured. The leader, Claude Opus 5.5 (max), reaches 98.9%. It covers dynamic tool-use benchmark. The board median is 68.8%, so gemini-1.5-flash-8b-001 is 18.8 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
Strengths and weaknesses
Reasoning, maths and science: weak, ahead of 14% of the field on average across 2 benchmarks. Its best board here is OTIS Mock AIME (#159 of 189) and its weakest is GPQA Diamond (#242 of 275).
Release history
The Google DeepMind model released before it was gemini-1.5-pro-002 on 2024-09-24, which scores 43.9. The next one was Gemini 2.0 Flash on 2024-12-11, at 44.6.
Reading these numbers
The 3 scores on this page come from 1 source: Epoch AI Benchmarking Hub (3). No official leaderboard supplied any of them, so treat them as third-party measurements. With 3 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #713 Llama 3.2 1B (42.0)
- #714 SmolLM2-135M (42.0)
- #715 SmolLM2-360M (42.0)
- #717 Llama 4 Maverick (42.0)
- #718 Mistral-7B-Instruct-v0.3 (41.9)
- #719 mistral-small-2503 (41.9)
More from Google DeepMind
- Gemini 3.8 Flash (high) (#26, 54.0)
- Gemini 3.7 Flash (high) (#27, 53.9)
- Gemini 3 Pro Preview (#31, 53.7)
- Gemini 3 Deep Think (#60, 52.6)
- AI co-mathematician (#69, 52.3)
- Gemini 3 Flash (#120, 51.5)
Compare it on the live leaderboard → · How the aggregate score works