mistral-small-3.1-2503: benchmark scores, price and ranking

mistral-small-3.1-2503 from Mistral AI ranks #637 of 743 LLMs on the LLMs Tiger aggregate benchmark score (44.4), based on 3 benchmark results captured up to 2026-10-13.

Organisation: Mistral AI
Type: Open-weight / local model
Open weights: Yes
Released: 2025-03-17 (source: epoch)
Aggregate rank: #637 of 743 (score 44.4)

Relative to other models, mistral-small-3.1-2503 is strongest on Chess Puzzles (#95 of 122) and weakest on OTIS Mock AIME (#164 of 189).

Across the 3 benchmarks where at least ten models are scored, mistral-small-3.1-2503 is in the top 10% on 0 and in the top half on 0.

mistral-small-3.1-2503 benchmark results

mistral-small-3.1-2503 benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
Chess Puzzles	1.0%	#95 of 122	Epoch AI Benchmarking Hub	2026-10-13
GPQA Diamond	41.9%	#216 of 275	Epoch AI Benchmarking Hub	2026-10-13
OTIS Mock AIME	3.9%	#164 of 189	Epoch AI Benchmarking Hub	2026-10-13

About mistral-small-3.1-2503

mistral-small-3.1-2503 is an open-weight model that can run on your own hardware from Mistral AI. It was released on 2025-03-17, according to Epoch AI. No API price is listed for it yet. We hold 3 benchmark results for it across 2 areas, and none is in the top tenth of its board.

Where mistral-small-3.1-2503 stands

On our aggregate score, mistral-small-3.1-2503 is #637 of 743 ranked models, in the lower half. Its score is 44.4; the scale is centred on 50, so it sits 5.6 points below the typical model. That beats 14% of the ranked field. Among the 44 ranked Mistral AI models it is #30. The next one up is mistral-small-2501 at 44.8. The next one down is Mistral Small 3.2 at 44.0.

mistral-small-3.1-2503, benchmark by benchmark

mistral-small-3.1-2503 lands below the middle on Chess Puzzles: 1.0%, #95 of 122, with 77% of the field scoring higher. GPT-6 Astra (max) leads at 72.0%; the closest result above is DeepSeek-R1-Distill-Qwen-32B at 1.0%. It covers chess tactics puzzles. The board median is 12.5%, so mistral-small-3.1-2503 is 11.5 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.

mistral-small-3.1-2503 lands below the middle on GPQA Diamond: 41.9%, #216 of 275, with 78% of the field scoring higher. GPT-6 Astra (max) leads at 95.8%; the closest result above is granite-4.1-8b at 42.0%. It covers expert-level science questions. The board median is 71.7%, so mistral-small-3.1-2503 is 29.8 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.

OTIS Mock AIME is a weak spot. mistral-small-3.1-2503 scores 3.9%, #164 of 189, behind 86% of the models measured. The leader, Claude Fable 5.1 (max), reaches 100.0%. It covers competition maths (AIME 2024-25 style). The board median is 57.8%, so mistral-small-3.1-2503 is 53.9 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.

Strengths and weaknesses

Reasoning, maths and science: weak, ahead of 17% of the field on average across 2 benchmarks. Its best board here is GPQA Diamond (#216 of 275) and its weakest is OTIS Mock AIME (#164 of 189).

Release history

The Mistral AI model released before it was mistral-small-2503 on 2025-03-17, which scores 41.9. The next one was mistral-medium-2505 on 2025-05-07, at 45.4.

Reading these numbers

The 3 scores on this page come from 1 source: Epoch AI Benchmarking Hub (3). No official leaderboard supplied any of them, so treat them as third-party measurements. With 3 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

#634 Mistral-7B-v0.2 (44.5)
#635 c4ai-command-a-03-2025 (44.5)
#636 DeepSeek-V3.2 (Thinking; Novita) (44.5)
#638 Yi-1.5-34B-Chat (44.4)
#639 granite-4.1-3b (44.4)
#640 Laguna M.1 (44.4)