gpt-4o-2024-11-20: benchmark scores, price and ranking

gpt-4o-2024-11-20 from OpenAI ranks #256 of 743 LLMs on the LLMs Tiger aggregate benchmark score (49.6), based on 2 benchmark results captured up to 2026-10-13.

Organisation: OpenAI
Type: Frontier model
Open weights: No
Released: 2024-11-20 (source: name)
Context window: 128,000 tokens
Cheapest API price: $2.50 in / $10.00 out per million tokens (via azure, observed 2026-10-13T20:47Z)
Aggregate rank: #256 of 743 (score 49.6)

Across the 2 benchmarks where at least ten models are scored, gpt-4o-2024-11-20 is in the top 10% on 0 and in the top half on 1.

Its cheapest listed input price, $2.50 per million tokens, is lower than that of 15% of the 427 models with a listed price.

gpt-4o-2024-11-20 benchmark results

gpt-4o-2024-11-20 benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
Aider Code Editing	71.4%	#13 of 92	Aider Aider Code Editing leaderboard	2026-10-13
Aider Polyglot	18.2%	#39 of 49	Aider polyglot leaderboard	2026-10-13

About gpt-4o-2024-11-20

gpt-4o-2024-11-20 is a frontier model from OpenAI. It was released on 2024-11-20, according to the model's own name. It accepts up to 128,000 tokens of input at once. The cheapest API listing we track charges $2.50 per million input tokens and $10.00 per million output tokens, through azure. We hold 2 benchmark results for it across 1 area, and none is in the top tenth of its board.

Where gpt-4o-2024-11-20 stands

On our aggregate score, gpt-4o-2024-11-20 is #256 of 743 ranked models, around the middle of the table. Its score is 49.6; the scale is centred on 50, so it sits 0.4 points below the typical model. That beats 66% of the ranked field. Among the 88 ranked OpenAI models it is #34. The next one up is o3 (high) at 49.8. The next one down is gpt-3.5-turbo-0301 at 49.5.

gpt-4o-2024-11-20, benchmark by benchmark

Aider Code Editing puts gpt-4o-2024-11-20 at 71.4%, #13 of 92. That beats 86% of the models tested, but 12.8 points short of Claude 3.5-Sonnet-20241022 (84.2%). The results either side are gpt-4o-2024-08-06 (71.4%) and Qwen2.5 Coder 32B Instruct (71.4%). It covers Aider official benchmark. The board median is 55.6%, so gpt-4o-2024-11-20 is 15.8 points above it. Source: Aider Aider Code Editing leaderboard, captured 2026-10-13.

gpt-4o-2024-11-20 lands below the middle on Aider Polyglot: 18.2%, #39 of 49, with 78% of the field scoring higher. gemini-2.5-pro-preview-06-05 leads at 83.1%; the closest result above is gemini-2.0-flash-thinking-exp-01-21 at 18.2%. It covers edits across 6 languages (225 exercises). The board median is 44.9%, so gpt-4o-2024-11-20 is 26.7 points below it. Source: Aider polyglot leaderboard, captured 2026-10-13.

Strengths and weaknesses

Software engineering: solid, ahead of 53% of the field on average across 2 benchmarks. Its best board here is Aider Code Editing (#13 of 92) and its weakest is Aider Polyglot (#39 of 49).

Price and value

The median input price across the 427 priced models is $0.500 per million tokens, so gpt-4o-2024-11-20 costs more than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4.1 Flash (high) ($0.010, 48.9), DeepSeek V4 Flash 0731 (max) ($0.016, 53.1). Similar scores cost more on Claude Sonnet 4.5 (59k thinking) ($3.00) and Claude 3.7 Sonnet (64k thinking) ($3.00).

Release history

The OpenAI model released before it was o1-mini (high) on 2024-09-12, which scores 48.4. The next one was GPT-4o (Nov 2024) on 2024-11-20, at 42.3.

Reading these numbers

The 2 scores on this page come from 2 sources: Aider Aider Code Editing leaderboard (1), Aider polyglot leaderboard (1). 2 of them come from an official leaderboard and 0 from datasets or third-party runs. With 2 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

#253 Qwen3.5 Plus (49.6)
#254 Mistral-Large-Instruct-2411 (49.6)
#255 DeepSeek v4 Flash (max) (49.6)
#257 claude-haiku-4-5-20251001_16K (49.5)
#258 Kimi-K2-Instruct-0905 (49.5)
#259 mimo-v2.5-pro (49.5)