o1-mini-2024-09-12: benchmark scores, price and ranking

o1-mini-2024-09-12 from OpenAI ranks #622 of 743 LLMs on the LLMs Tiger aggregate benchmark score (44.8), based on 2 benchmark results captured up to 2026-10-13.

Organisation: OpenAI
Type: Fast / low-cost (flash) model
Open weights: No
Released: 2024-09-12 (source: name)
Cheapest API price: $1.10 in / $4.40 out per million tokens (via azure, observed 2026-10-13T20:47Z)
Aggregate rank: #622 of 743 (score 44.8)

Across the 2 benchmarks where at least ten models are scored, o1-mini-2024-09-12 is in the top 10% on 0 and in the top half on 0.

Its cheapest listed input price, $1.10 per million tokens, is lower than that of 33% of the 427 models with a listed price.

o1-mini-2024-09-12 benchmark results

o1-mini-2024-09-12 benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
Aider Polyglot	32.9%	#29 of 49	Aider polyglot leaderboard	2026-10-13
Aider Code Editing	27.1%	#87 of 92	Aider Aider Code Editing leaderboard	2026-10-13

About o1-mini-2024-09-12

o1-mini-2024-09-12 is a smaller, lower-cost model from OpenAI. It was released on 2024-09-12, according to the model's own name. The cheapest API listing we track charges $1.10 per million input tokens and $4.40 per million output tokens, through azure. We hold 2 benchmark results for it across 1 area, and none is in the top tenth of its board.

Where o1-mini-2024-09-12 stands

On our aggregate score, o1-mini-2024-09-12 is #622 of 743 ranked models, in the lower half. Its score is 44.8; the scale is centred on 50, so it sits 5.2 points below the typical model. That beats 16% of the ranked field. Among the 88 ranked OpenAI models it is #74. The next one up is GPT-4.1 at 44.9. The next one down is GPT-4o (May 2024) at 44.3.

o1-mini-2024-09-12, benchmark by benchmark

o1-mini-2024-09-12 lands below the middle on Aider Polyglot: 32.9%, #29 of 49, with 57% of the field scoring higher. gemini-2.5-pro-preview-06-05 leads at 83.1%; the closest result above is Gemini 2.0 Pro exp-02-05 at 35.6%. It covers edits across 6 languages (225 exercises). The board median is 44.9%, so o1-mini-2024-09-12 is 12.0 points below it. Source: Aider polyglot leaderboard, captured 2026-10-13.

Aider Code Editing is a weak spot. o1-mini-2024-09-12 scores 27.1%, #87 of 92, behind 93% of the models measured. The leader, Claude 3.5-Sonnet-20241022, reaches 84.2%. It covers Aider official benchmark. The board median is 55.6%, so o1-mini-2024-09-12 is 28.5 points below it. Source: Aider Aider Code Editing leaderboard, captured 2026-10-13.

Strengths and weaknesses

Software engineering: weak, ahead of 23% of the field on average across 2 benchmarks. Its best board here is Aider Polyglot (#29 of 49) and its weakest is Aider Code Editing (#87 of 92).

Price and value

The median input price across the 427 priced models is $0.500 per million tokens, so o1-mini-2024-09-12 costs more than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4.1 Flash (high) ($0.010, 48.9), Qwen2.5-Coder-3B-Instruct ($0.010, 46.5). Similar scores cost more on Mistral Medium 3.5 ($1.50) and Llama-3.2-90B-Vision-Instruct ($2.00).

Release history

The OpenAI model released before it was GPT-4o (Aug 2024) on 2024-08-06, which scores 42.2. The next one was o1-mini (high) on 2024-09-12, at 48.4.

Reading these numbers

The 2 scores on this page come from 2 sources: Aider Aider Code Editing leaderboard (1), Aider polyglot leaderboard (1). 2 of them come from an official leaderboard and 0 from datasets or third-party runs. With 2 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

#619 granite-3.1-8b-base (44.9)
#620 GPT-4.1 (44.9)
#621 Llama-3.1-Tulu-3-70B-DPO (44.8)
#623 mistral-small-2501 (44.8)
#624 Qwen2.5-1.5B (44.7)
#625 Solar Pro 3 (44.7)