o1-2024-12-17: benchmark scores, price and ranking

o1-2024-12-17 from OpenAI ranks #107 of 743 LLMs on the LLMs Tiger aggregate benchmark score (51.6), based on 1 benchmark results captured up to 2026-10-13.

Organisation: OpenAI
Type: Frontier model
Open weights: No
Released: 2024-12-17 (source: name)
Context window: 200,000 tokens
Cheapest API price: $15.00 in / $60.00 out per million tokens (via azure, observed 2026-10-13T20:47Z)
Aggregate rank: #107 of 743 (score 51.6)

Across the 1 benchmark where at least ten models are scored, o1-2024-12-17 is in the top 10% on 0 and in the top half on 1.

Its cheapest listed input price, $15.00 per million tokens, is lower than that of 2% of the 427 models with a listed price.

o1-2024-12-17 benchmark results

o1-2024-12-17 benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
Aider Polyglot	61.7%	#10 of 49	Aider polyglot leaderboard	2026-10-13

About o1-2024-12-17

o1-2024-12-17 is a frontier model from OpenAI. It was released on 2024-12-17, according to the model's own name. It accepts up to 200,000 tokens of input at once. The cheapest API listing we track charges $15.00 per million input tokens and $60.00 per million output tokens, through azure. We hold 1 benchmark result for it across 1 area, and none is in the top tenth of its board.

Where o1-2024-12-17 stands

On our aggregate score, o1-2024-12-17 is #107 of 743 ranked models, in the top quarter. Its score is 51.6; the scale is centred on 50, so it sits 1.6 points above the typical model. That beats 86% of the ranked field. Among the 88 ranked OpenAI models it is #18. The next one up is openai/chatgpt-4o-latest at 51.7. The next one down is GPT-5 (high) at 51.1.

o1-2024-12-17, benchmark by benchmark

Aider Polyglot puts o1-2024-12-17 at 61.7%, #10 of 49. That beats 80% of the models tested, but 21.4 points short of gemini-2.5-pro-preview-06-05 (83.1%). The results either side are DeepSeek R1 + claude-3-5-sonnet-20241022 (64.0%) and claude-sonnet-4-20250514 (61.3%). It covers edits across 6 languages (225 exercises). The board median is 44.9%, so o1-2024-12-17 is 16.8 points above it. Source: Aider polyglot leaderboard, captured 2026-10-13.

Price and value

The median input price across the 427 priced models is $0.500 per million tokens, so o1-2024-12-17 costs more than the typical listing. Models that score within 1.5 points or better and cost less: DeepSeek V4 Flash 0731 (max) ($0.016, 53.1), Qwen3.7 Flash ($0.030, 50.5), GLM-5.2 (high) ($0.060, 51.6). Similar scores cost more on GPT-4 (0806) ($30.00) and GPT-4 (0613) ($30.00).

Release history

The OpenAI model released before it was o1 (high) on 2024-12-05, which scores 48.1. The next one was chatgpt-4o-01-29-2025 on 2025-01-29, at 50.6.

Reading these numbers

The 1 score on this page comes from 1 source: Aider polyglot leaderboard (1). 1 of them come from an official leaderboard and 0 from datasets or third-party runs. With 1 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

#104 Intern-S1 (51.7)
#105 GLM-4.7-FP8 (51.6)
#106 Codex + GPT-6 Sol (51.6)
#108 DeepSeek v4 Pro (max) (51.6)
#109 GLM-5.2 (high) (51.6)
#110 Hy3-preview (51.6)