gpt-4o-2024-08-06: benchmark scores, price and ranking

gpt-4o-2024-08-06 from OpenAI ranks #265 of 743 LLMs on the LLMs Tiger aggregate benchmark score (49.5), based on 3 benchmark results captured up to 2026-10-13.

Organisation: OpenAI
Type: Frontier model
Open weights: No
Released: 2024-08-06 (source: name)
Context window: 128,000 tokens
Cheapest API price: $2.50 in / $10.00 out per million tokens (via azure, observed 2026-10-13T20:47Z)
Aggregate rank: #265 of 743 (score 49.5)

Relative to other models, gpt-4o-2024-08-06 is strongest on Aider Code Editing (#12 of 92) and weakest on Aider Polyglot (#34 of 49).

Across the 3 benchmarks where at least ten models are scored, gpt-4o-2024-08-06 is in the top 10% on 0 and in the top half on 1.

Its cheapest listed input price, $2.50 per million tokens, is lower than that of 15% of the 427 models with a listed price.

gpt-4o-2024-08-06 benchmark results

gpt-4o-2024-08-06 benchmark scores, ranked against all models measured on each benchmark
Benchmark	Score	Rank	Source	Captured
Aider Code Editing	71.4%	#12 of 92	Aider Aider Code Editing leaderboard	2026-10-13
Aider Refactoring	49.4%	#8 of 12	Aider Aider Refactoring leaderboard	2026-10-13
Aider Polyglot	23.1%	#34 of 49	Aider polyglot leaderboard	2026-10-13

About gpt-4o-2024-08-06

gpt-4o-2024-08-06 is a frontier model from OpenAI. It was released on 2024-08-06, according to the model's own name. It accepts up to 128,000 tokens of input at once. The cheapest API listing we track charges $2.50 per million input tokens and $10.00 per million output tokens, through azure. We hold 3 benchmark results for it across 2 areas, and none is in the top tenth of its board.

Where gpt-4o-2024-08-06 stands

On our aggregate score, gpt-4o-2024-08-06 is #265 of 743 ranked models, around the middle of the table. Its score is 49.5; the scale is centred on 50, so it sits 0.5 points below the typical model. That beats 64% of the ranked field. Among the 88 ranked OpenAI models it is #36. The next one up is gpt-3.5-turbo-0301 at 49.5. The next one down is GPT-4 (0125) at 49.4.

gpt-4o-2024-08-06, benchmark by benchmark

Aider Code Editing puts gpt-4o-2024-08-06 at 71.4%, #12 of 92. That beats 87% of the models tested, but 12.8 points short of Claude 3.5-Sonnet-20241022 (84.2%). The results either side are openai/chatgpt-4o-latest (72.2%) and gpt-4o-2024-11-20 (71.4%). It covers Aider official benchmark. The board median is 55.6%, so gpt-4o-2024-08-06 is 15.8 points above it. Source: Aider Aider Code Editing leaderboard, captured 2026-10-13.

gpt-4o-2024-08-06 lands below the middle on Aider Refactoring: 49.4%, #8 of 12, with 58% of the field scoring higher. Claude 3.5-Sonnet-20241022 leads at 92.1%; the closest result above is gemini/gemini-1.5-pro-latest at 49.4%. It covers Aider official benchmark. The board median is 50.0%, so gpt-4o-2024-08-06 is 0.6 points below it. Source: Aider Aider Refactoring leaderboard, captured 2026-10-13.

gpt-4o-2024-08-06 lands below the middle on Aider Polyglot: 23.1%, #34 of 49, with 67% of the field scoring higher. gemini-2.5-pro-preview-06-05 leads at 83.1%; the closest result above is QwQ-32B + Qwen 2.5 Coder Instruct at 26.2%. It covers edits across 6 languages (225 exercises). The board median is 44.9%, so gpt-4o-2024-08-06 is 21.8 points below it. Source: Aider polyglot leaderboard, captured 2026-10-13.

Strengths and weaknesses

Software engineering: solid, ahead of 59% of the field on average across 2 benchmarks. Its best board here is Aider Code Editing (#12 of 92) and its weakest is Aider Polyglot (#34 of 49).

Price and value

The median input price across the 427 priced models is $0.500 per million tokens, so gpt-4o-2024-08-06 costs more than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4.1 Flash (high) ($0.010, 48.9), DeepSeek V4 Flash 0731 (max) ($0.016, 53.1). Similar scores cost more on Claude Sonnet 4.5 (59k thinking) ($3.00) and Claude 3.7 Sonnet (64k thinking) ($3.00).

Release history

The OpenAI model released before it was gpt-4o-mini-2024-07-18 on 2024-07-18, which scores 38.3. The next one was GPT-4o (Aug 2024) on 2024-08-06, at 42.2.

Reading these numbers

The 3 scores on this page come from 3 sources: Aider Aider Code Editing leaderboard (1), Aider polyglot leaderboard (1), Aider Aider Refactoring leaderboard (1). 3 of them come from an official leaderboard and 0 from datasets or third-party runs. With 3 results the aggregate rank can move a lot when one new score arrives.

Models ranked nearby

#262 gpt-3.5-turbo-0301 (49.5)
#263 Qwen2.5-Coder-7B-Instruct (49.5)
#264 Hunyuan-A13B-Instruct (49.5)
#266 claude-opus-4-1-20250805_16K (49.5)
#267 grok-4-fast (49.5)
#268 Grok 3 mini (49.4)