Gemini 1.5 Flash (May 2024): benchmark scores, price and ranking
Gemini 1.5 Flash (May 2024) from Google DeepMind ranks #701 of 743 LLMs on the LLMs Tiger aggregate benchmark score (42.6), based on 4 benchmark results captured up to 2026-10-13.
- Organisation
- Google DeepMind
- Type
- Fast / low-cost (flash) model
- Open weights
- No
- Released
- 2024-05-23 (source: epoch)
- Aggregate rank
- #701 of 743 (score 42.6)
Relative to other models, Gemini 1.5 Flash (May 2024) is strongest on Epoch ECI (#119 of 204) and weakest on DTBench (#126 of 146).
Across the 4 benchmarks where at least ten models are scored, Gemini 1.5 Flash (May 2024) is in the top 10% on 0 and in the top half on 0.
Gemini 1.5 Flash (May 2024) benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| Epoch ECI | 123 | #119 of 204 | Epoch AI Benchmarking Hub | 2026-10-13 |
| GPQA Diamond | 40.4% | #222 of 275 | Epoch AI Benchmarking Hub | 2026-10-13 |
| OTIS Mock AIME | 3.9% | #163 of 189 | Epoch AI Benchmarking Hub | 2026-10-13 |
| DTBench | 51.4% | #126 of 146 | Epoch AI Benchmarking Hub | 2026-10-13 |
About Gemini 1.5 Flash (May 2024)
Gemini 1.5 Flash (May 2024) is a smaller, lower-cost model from Google DeepMind. It was released on 2024-05-23, according to Epoch AI. No API price is listed for it yet. We hold 4 benchmark results for it across 3 areas, and none is in the top tenth of its board.
Where Gemini 1.5 Flash (May 2024) stands
On our aggregate score, Gemini 1.5 Flash (May 2024) is #701 of 743 ranked models, in the lower half. Its score is 42.6; the scale is centred on 50, so it sits 7.4 points below the typical model. That beats 6% of the ranked field. Among the 41 ranked Google DeepMind models it is #35. The next one up is gemini-1.5-flash-002 at 42.8. The next one down is gemma-3-1b-it at 42.4.
Gemini 1.5 Flash (May 2024), benchmark by benchmark
Gemini 1.5 Flash (May 2024) lands below the middle on Epoch ECI: 123, #119 of 204, with 58% of the field scoring higher. Qwen 3.8 Max leads at 156; the closest result above is Llama 3-70B at 123. It covers Epoch Capabilities Index: Epoch's own aggregate of ~40 benchmarks. The board median is 127, so Gemini 1.5 Flash (May 2024) is 5 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
GPQA Diamond is a weak spot. Gemini 1.5 Flash (May 2024) scores 40.4%, #222 of 275, behind 80% of the models measured. The leader, GPT-6 Astra (max), reaches 95.8%. It covers expert-level science questions. The board median is 71.7%, so Gemini 1.5 Flash (May 2024) is 31.3 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
OTIS Mock AIME is a weak spot. Gemini 1.5 Flash (May 2024) scores 3.9%, #163 of 189, behind 86% of the models measured. The leader, Claude Fable 5.1 (max), reaches 100.0%. It covers competition maths (AIME 2024-25 style). The board median is 57.8%, so Gemini 1.5 Flash (May 2024) is 53.9 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
DTBench is a weak spot. Gemini 1.5 Flash (May 2024) scores 51.4%, #126 of 146, behind 86% of the models measured. The leader, Claude Opus 5.5 (max), reaches 98.9%. It covers dynamic tool-use benchmark. The board median is 68.8%, so Gemini 1.5 Flash (May 2024) is 17.4 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
Strengths and weaknesses
Reasoning, maths and science: weak, ahead of 17% of the field on average across 2 benchmarks. Its best board here is GPQA Diamond (#222 of 275) and its weakest is OTIS Mock AIME (#163 of 189).
Release history
The Google DeepMind model released before it was gemini-1.5-pro-001 on 2024-05-14, which scores 44.0. The next one was gemma-2-27b on 2024-06-24, at 43.7.
Reading these numbers
The 4 scores on this page come from 1 source: Epoch AI Benchmarking Hub (4). No official leaderboard supplied any of them, so treat them as third-party measurements. With 4 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #698 granite-4.0-1b (42.7)
- #699 Qwen2.5-Coder-0.5B-Instruct (42.6)
- #700 Llama-3.1-70B-Instruct (42.6)
- #702 gpt-4-turbo-2024-04-09 (42.6)
- #703 ministral-8b-2410 (42.6)
- #704 Meta-Llama-3-70B-Instruct (42.5)
More from Google DeepMind
- Gemini 3.8 Flash (high) (#26, 54.0)
- Gemini 3.7 Flash (high) (#27, 53.9)
- Gemini 3 Pro Preview (#31, 53.7)
- Gemini 3 Deep Think (#60, 52.6)
- AI co-mathematician (#69, 52.3)
- Gemini 3 Flash (#120, 51.5)
Compare it on the live leaderboard → · How the aggregate score works