Mellum2-12B-A2.5B-Instruct: benchmark scores, price and ranking

Mellum2-12B-A2.5B-Instruct from JetBrains ranks #487 of 743 LLMs on the LLMs Tiger aggregate benchmark score (46.8), based on 1 benchmark results captured up to 2026-10-13.

Organisation: JetBrains
Type: Open-weight / local model
Open weights: Yes
Cheapest API price: $0.050 in / $0.100 out per million tokens (via wandb, observed 2026-10-13T20:47Z)
Aggregate rank: #487 of 743 (score 46.8)

Across the 1 benchmark where at least ten models are scored, Mellum2-12B-A2.5B-Instruct is in the top 10% on 0 and in the top half on 0.

Its cheapest listed input price, $0.050 per million tokens, is lower than that of 90% of the 427 models with a listed price.

Mellum2-12B-A2.5B-Instruct benchmark results

Mellum2-12B-A2.5B-Instruct benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
GPQA Diamond	40.9%	#218 of 275	HuggingFace GPQA Diamond leaderboard	2026-10-13

About Mellum2-12B-A2.5B-Instruct

Mellum2-12B-A2.5B-Instruct is an open-weight model that can run on your own hardware from JetBrains. The cheapest API listing we track charges $0.050 per million input tokens and $0.100 per million output tokens, through wandb. We hold 1 benchmark result for it across 1 area, and none is in the top tenth of its board.

Where Mellum2-12B-A2.5B-Instruct stands

On our aggregate score, Mellum2-12B-A2.5B-Instruct is #487 of 743 ranked models, in the lower half. Its score is 46.8; the scale is centred on 50, so it sits 3.2 points below the typical model. That beats 34% of the ranked field. Among the 6 ranked JetBrains models it is #2. The next one up is Mellum2-12B-A2.5B-Thinking at 48.5. The next one down is Mellum2-12B-A2.5B-Thinking-SFT at 46.6.

Mellum2-12B-A2.5B-Instruct, benchmark by benchmark

Mellum2-12B-A2.5B-Instruct lands below the middle on GPQA Diamond: 40.9%, #218 of 275, with 79% of the field scoring higher. GPT-6 Astra (max) leads at 95.8%; the closest result above is qwen-turbo-2024-11-01 at 41.8%. It covers expert-level science questions. The board median is 71.7%, so Mellum2-12B-A2.5B-Instruct is 30.8 points below it. Source: HuggingFace GPQA Diamond leaderboard, captured 2026-10-13.

Price and value

The median input price across the 427 priced models is $0.500 per million tokens, so Mellum2-12B-A2.5B-Instruct costs less than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4.1 Flash (high) ($0.010, 48.9), Qwen2.5-Coder-3B-Instruct ($0.010, 46.5). Similar scores cost more on amazon.nova-lite-v1:0 ($0.060) and Qwen3.5 Flash ($0.065).

Reading these numbers

The 1 score on this page comes from 1 source: HuggingFace GPQA Diamond leaderboard (1). No official leaderboard supplied any of them, so treat them as third-party measurements. With 1 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

#484 MiniMax-M2.5 (46.8)
#485 o4-mini (high) (46.8)
#486 codestral-2508 (46.8)
#488 Gemini 2.0 Pro Exp (Feb 2025) (46.7)
#489 mistral-medium-2312 (46.7)
#490 grok-4-1-fast-reasoning (46.7)