Mistral-Nemo-Instruct-2407: benchmark scores, price and ranking

Mistral-Nemo-Instruct-2407 from Mistral AI ranks #601 of 743 LLMs on the LLMs Tiger aggregate benchmark score (45.2), based on 2 benchmark results captured up to 2026-10-13.

Organisation: Mistral AI
Type: Open-weight / local model
Open weights: Yes
Released: 2024-07-18 (source: epoch)
Cheapest API price: $0.019 in / $0.030 out per million tokens (via deepinfra, observed 2026-10-13T20:47Z)
Aggregate rank: #601 of 743 (score 45.2)

Across the 2 benchmarks where at least ten models are scored, Mistral-Nemo-Instruct-2407 is in the top 10% on 0 and in the top half on 0.

Its cheapest listed input price, $0.019 per million tokens, is lower than that of 98% of the 427 models with a listed price.

Mistral-Nemo-Instruct-2407 benchmark results

Mistral-Nemo-Instruct-2407 benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
BALROG	17.6%	#23 of 34	Epoch AI Benchmarking Hub	2026-10-13
DTBench	48.6%	#135 of 146	Epoch AI Benchmarking Hub	2026-10-13

About Mistral-Nemo-Instruct-2407

Mistral-Nemo-Instruct-2407 is an open-weight model that can run on your own hardware from Mistral AI. It was released on 2024-07-18, according to Epoch AI. The cheapest API listing we track charges $0.019 per million input tokens and $0.030 per million output tokens, through deepinfra. We hold 2 benchmark results for it across 1 area, and none is in the top tenth of its board.

Where Mistral-Nemo-Instruct-2407 stands

On our aggregate score, Mistral-Nemo-Instruct-2407 is #601 of 743 ranked models, in the lower half. Its score is 45.2; the scale is centred on 50, so it sits 4.8 points below the typical model. That beats 19% of the ranked field. Among the 44 ranked Mistral AI models it is #27. The next one up is Devstral Small 2 at 45.4. The next one down is mistral-small-3-2501 at 45.0.

Mistral-Nemo-Instruct-2407, benchmark by benchmark

Mistral-Nemo-Instruct-2407 lands below the middle on BALROG: 17.6%, #23 of 34, with 65% of the field scoring higher. GPT-6 Astra (max) leads at 68.3%; the closest result above is Claude 3.5 Haiku (Oct 2024) at 19.3%. It covers long-horizon game-playing agents. The board median is 27.6%, so Mistral-Nemo-Instruct-2407 is 10.0 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.

DTBench is a weak spot. Mistral-Nemo-Instruct-2407 scores 48.6%, #135 of 146, behind 92% of the models measured. The leader, Claude Opus 5.5 (max), reaches 98.9%. It covers dynamic tool-use benchmark. The board median is 68.8%, so Mistral-Nemo-Instruct-2407 is 20.2 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.

Strengths and weaknesses

Agents and tool use: weak, ahead of 20% of the field on average across 2 benchmarks. Its best board here is BALROG (#23 of 34) and its weakest is DTBench (#135 of 146).

Price and value

The median input price across the 427 priced models is $0.500 per million tokens, so Mistral-Nemo-Instruct-2407 costs less than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4.1 Flash (high) ($0.010, 48.9), Qwen2.5-Coder-3B-Instruct ($0.010, 46.5). Similar scores cost more on Qwen2-VL-7B-Instruct ($0.020) and Llama 3.1-8B ($0.030).

Release history

The Mistral AI model released before it was Mistral-7B-Instruct-v0.3 on 2024-05-27, which scores 41.9. The next one was open-mistral-nemo-2407 on 2024-07-18, at 45.6.

Reading these numbers

The 2 scores on this page come from 1 source: Epoch AI Benchmarking Hub (2). No official leaderboard supplied any of them, so treat them as third-party measurements. With 2 results the aggregate rank can move a lot when one new score arrives.