Mellum2-12B-A2.5B-Thinking-SFT: benchmark scores, price and ranking
Mellum2-12B-A2.5B-Thinking-SFT from JetBrains ranks #499 of 743 LLMs on the LLMs Tiger aggregate benchmark score (46.6), based on 1 benchmark results captured up to 2026-10-13.
- Organisation
- JetBrains
- Type
- Open-weight / local model
- Open weights
- Yes
- Aggregate rank
- #499 of 743 (score 46.6)
Across the 1 benchmark where at least ten models are scored, Mellum2-12B-A2.5B-Thinking-SFT is in the top 10% on 0 and in the top half on 0.
Mellum2-12B-A2.5B-Thinking-SFT benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| GPQA Diamond | 39.9% | #223 of 275 | HuggingFace GPQA Diamond leaderboard | 2026-10-13 |
About Mellum2-12B-A2.5B-Thinking-SFT
Mellum2-12B-A2.5B-Thinking-SFT is an open-weight model that can run on your own hardware from JetBrains. No API price is listed for it yet. We hold 1 benchmark result for it across 1 area, and none is in the top tenth of its board.
Where Mellum2-12B-A2.5B-Thinking-SFT stands
On our aggregate score, Mellum2-12B-A2.5B-Thinking-SFT is #499 of 743 ranked models, in the lower half. Its score is 46.6; the scale is centred on 50, so it sits 3.4 points below the typical model. That beats 33% of the ranked field. Among the 6 ranked JetBrains models it is #3. The next one up is Mellum2-12B-A2.5B-Instruct at 46.8. The next one down is Mellum2-12B-A2.5B-Instruct-SFT at 46.5.
Mellum2-12B-A2.5B-Thinking-SFT, benchmark by benchmark
GPQA Diamond is a weak spot. Mellum2-12B-A2.5B-Thinking-SFT scores 39.9%, #223 of 275, behind 81% of the models measured. The leader, GPT-6 Astra (max), reaches 95.8%. It covers expert-level science questions. The board median is 71.7%, so Mellum2-12B-A2.5B-Thinking-SFT is 31.8 points below it. Source: HuggingFace GPQA Diamond leaderboard, captured 2026-10-13.
Reading these numbers
The 1 score on this page comes from 1 source: HuggingFace GPQA Diamond leaderboard (1). No official leaderboard supplied any of them, so treat them as third-party measurements. With 1 results the aggregate rank can move a lot when one new score arrives.
Models ranked nearby
- #496 MCTS Refine 7B (46.7)
- #497 Composer 2.5 (46.6)
- #498 gemini-2.0-flash-lite (46.6)
- #500 EXAONE-3.5-7.8B-Instruct (46.6)
- #501 GPT-4.5 Preview (Feb 2025) (46.6)
- #502 mimo-v2-pro (46.6)
More from JetBrains
- Mellum2-12B-A2.5B-Thinking (#347, 48.5)
- Mellum2-12B-A2.5B-Instruct (#487, 46.8)
- Mellum2-12B-A2.5B-Instruct-SFT (#509, 46.5)
- Mellum2-12B-A2.5B-Base (#651, 44.0)
- Mellum2-12B-A2.5B-Base-Pretrain (#652, 44.0)
Compare it on the live leaderboard → · How the aggregate score works