Devstral Small (2512): benchmark scores, price and ranking

Devstral Small (2512) from mistral ranks #224 of 743 LLMs on the LLMs Tiger aggregate benchmark score (49.9), based on 1 benchmark results captured up to 2026-10-13.

Organisation: mistral
Type: Open-weight / local model
Open weights: Yes
Cheapest API price: $0.070 in / $0.280 out per million tokens (via vercel_ai_gateway, observed 2026-10-13T21:47Z)
Aggregate rank: #224 of 743 (score 49.9)

Across the 1 benchmark where at least ten models are scored, Devstral Small (2512) is in the top 10% on 0 and in the top half on 0.

Its cheapest listed input price, $0.070 per million tokens, is lower than that of 87% of the 427 models with a listed price.

Devstral Small (2512) benchmark results

Devstral Small (2512) benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
SWE-bench Verified	56.4%	#37 of 73	SWE-bench Verified leaderboard	2026-10-13

About Devstral Small (2512)

Devstral Small (2512) is an open-weight model that can run on your own hardware from mistral. The cheapest API listing we track charges $0.070 per million input tokens and $0.280 per million output tokens, through vercel_ai_gateway. We hold 1 benchmark result for it across 1 area, and none is in the top tenth of its board.

Where Devstral Small (2512) stands

On our aggregate score, Devstral Small (2512) is #224 of 743 ranked models, around the middle of the table. Its score is 49.9; the scale is centred on 50, so it sits 0.1 points below the typical model. That beats 70% of the ranked field. Among the 2 ranked mistral models it is #1. The next one down is Devstral (2512) at 49.7.

Devstral Small (2512), benchmark by benchmark

Devstral Small (2512) lands below the middle on SWE-bench Verified: 56.4%, #37 of 73, with 49% of the field scoring higher. Claude Opus 4.7 (max) leads at 83.5%; the closest result above is Qwen 3.6 Plus (2026-04-02) at 57.9%. It covers real GitHub issues resolved. The median score on this board is also 56.4%. Source: SWE-bench Verified leaderboard, captured 2026-10-13.

Price and value

The median input price across the 427 priced models is $0.500 per million tokens, so Devstral Small (2512) costs less than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4.1 Flash (high) ($0.010, 48.9), DeepSeek V4 Flash 0731 (max) ($0.016, 53.1). Similar scores cost more on DeepSeek v4 Flash (max) ($0.090) and Qwen3-Next-80B-A3B-Instruct ($0.090).

Reading these numbers

The 1 score on this page comes from 1 source: SWE-bench Verified leaderboard (1). 1 of them come from an official leaderboard and 0 from datasets or third-party runs. With 1 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

#221 gemini-exp-1114 (50.0)
#222 gemini-2.5-flash-preview-09-2025 (50.0)
#223 DeepSeek v4 (unknown) (50.0)
#225 claude-sonnet-4-20250514_32K (49.9)
#226 Mistral-Small-4-119B-2603 (49.9)
#227 DeepSeek Coder V2 0724 (49.9)