Gemini 2.5 Flash (Preview) (Thinking 24K): benchmark scores, price and ranking

Gemini 2.5 Flash (Preview) (Thinking 24K) from Google ranks #415 of 743 LLMs on the LLMs Tiger aggregate benchmark score (47.6), based on 1 benchmark results captured up to 2026-10-13.

Organisation: Google
Type: Preview release
Open weights: No
Cheapest API price: $0.300 in / $2.50 out per million tokens (via deepinfra, observed 2026-10-13T20:47Z)
Aggregate rank: #415 of 743 (score 47.6)

Across the 1 benchmark where at least ten models are scored, Gemini 2.5 Flash (Preview) (Thinking 24K) is in the top 10% on 0 and in the top half on 0.

Its cheapest listed input price, $0.300 per million tokens, is lower than that of 58% of the 427 models with a listed price.

Gemini 2.5 Flash (Preview) (Thinking 24K) benchmark results

Gemini 2.5 Flash (Preview) (Thinking 24K) benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
ARC-AGI-2	2.5%	#66 of 87	ARC Prize official leaderboard	2026-10-13

About Gemini 2.5 Flash (Preview) (Thinking 24K)

Gemini 2.5 Flash (Preview) (Thinking 24K) is a preview release from Google. The cheapest API listing we track charges $0.300 per million input tokens and $2.50 per million output tokens, through deepinfra. We hold 1 benchmark result for it across 1 area, and none is in the top tenth of its board.

Where Gemini 2.5 Flash (Preview) (Thinking 24K) stands

On our aggregate score, Gemini 2.5 Flash (Preview) (Thinking 24K) is #415 of 743 ranked models, around the middle of the table. Its score is 47.6; the scale is centred on 50, so it sits 2.4 points below the typical model. That beats 44% of the ranked field. Among the 29 ranked Google models it is #23. The next one up is gemini-3.1-flash-lite (high) at 47.7. The next one down is Gemini 1.5 Pro at 47.5.

Gemini 2.5 Flash (Preview) (Thinking 24K), benchmark by benchmark

Gemini 2.5 Flash (Preview) (Thinking 24K) lands below the middle on ARC-AGI-2: 2.5%, #66 of 87, with 75% of the field scoring higher. GPT-6 Astra (max) leads at 95.0%; the closest result above is GPT-5 nano (high) at 2.6%. It covers abstract reasoning, ARC Prize public eval set. The board median is 22.8%, so Gemini 2.5 Flash (Preview) (Thinking 24K) is 20.2 points below it. Source: ARC Prize official leaderboard, captured 2026-10-13.

Price and value

The median input price across the 427 priced models is $0.500 per million tokens, so Gemini 2.5 Flash (Preview) (Thinking 24K) costs less than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4.1 Flash (high) ($0.010, 48.9), Qwen2.5-Coder-3B-Instruct ($0.010, 46.5). Similar scores cost more on qwen3.6-plus ($0.325) and qwen-plus-2025-04-28 ($0.400).

Reading these numbers

The 1 score on this page comes from 1 source: ARC Prize official leaderboard (1). 1 of them come from an official leaderboard and 0 from datasets or third-party runs. The leaderboard also lists 4 other reasoning-effort settings of this model, which redirect here. This page shows the highest. With 1 results the aggregate rank can move a lot when one new score arrives.

Gemini 2.5 Flash (Preview) (Thinking 24K) is also listed at 4 other reasoning-effort settings; this page shows the highest-effort row, which is the one the leaderboard keeps by default.

Models ranked nearby

#412 Claude Haiku 4.5 (Thinking 32K) (47.7)
#413 gemini-3.1-flash-lite (high) (47.7)
#414 ollama/codestral (47.6)
#416 Qwen2-VL-72B-Instruct (47.6)
#417 GPT-5.5 Instant (47.6)
#418 Qwen2.5-VL-72B-Instruct (47.6)