GPT-4o (Nov 2024): benchmark scores, price and ranking
GPT-4o (Nov 2024) from OpenAI ranks #708 of 743 LLMs on the LLMs Tiger aggregate benchmark score (42.3), based on 11 benchmark results captured up to 2026-10-13.
- Organisation
- OpenAI
- Type
- Frontier model
- Open weights
- No
- Released
- 2024-11-20 (source: epoch)
- Cheapest API price
- $2.50 in / $10.00 out per million tokens (via azure, observed 2026-10-13T19:47Z)
- Aggregate rank
- #708 of 743 (score 42.3)
Relative to other models, GPT-4o (Nov 2024) is strongest on Epoch ECI (#95 of 204) and weakest on GSO-Bench (#19 of 19).
Across the 11 benchmarks where at least ten models are scored, GPT-4o (Nov 2024) is in the top 10% on 0 and in the top half on 1.
Its cheapest listed input price, $2.50 per million tokens, is lower than that of 15% of the 427 models with a listed price.
GPT-4o (Nov 2024) benchmark results
| Benchmark | Score | Rank | Source | Captured |
|---|---|---|---|---|
| Epoch ECI | 129 | #95 of 204 | Epoch AI Benchmarking Hub | 2026-10-13 |
| TheAgentCompany | 8.6% | #7 of 13 | Epoch AI Benchmarking Hub | 2026-10-13 |
| Cybench | 12.5% | #10 of 16 | Epoch AI Benchmarking Hub | 2026-10-13 |
| GPQA Diamond | 47.9% | #194 of 275 | Epoch AI Benchmarking Hub | 2026-10-13 |
| OTIS Mock AIME | 6.2% | #153 of 189 | Epoch AI Benchmarking Hub | 2026-10-13 |
| WeirdML | 25.1% | #89 of 109 | Epoch AI Benchmarking Hub | 2026-10-13 |
| SWE-bench Verified | 31.0% | #60 of 73 | Epoch AI Benchmarking Hub | 2026-10-13 |
| CritPt | 0.0% | #95 of 115 | Epoch AI Benchmarking Hub | 2026-10-13 |
| EnigmaEval | 0.8% | #20 of 24 | Epoch AI Benchmarking Hub | 2026-10-13 |
| Humanity's Last Exam | 2.7% | #27 of 27 | Epoch AI Benchmarking Hub | 2026-10-13 |
| GSO-Bench | 0.0% | #19 of 19 | Epoch AI Benchmarking Hub | 2026-10-13 |
About GPT-4o (Nov 2024)
GPT-4o (Nov 2024) is a frontier model from OpenAI. It was released on 2024-11-20, according to Epoch AI. The cheapest API listing we track charges $2.50 per million input tokens and $10.00 per million output tokens, through azure. We hold 11 benchmark results for it across 4 areas, and none is in the top tenth of its board.
Where GPT-4o (Nov 2024) stands
On our aggregate score, GPT-4o (Nov 2024) is #708 of 743 ranked models, in the lower half. Its score is 42.3; the scale is centred on 50, so it sits 7.7 points below the typical model. That beats 5% of the ranked field. Among the 88 ranked OpenAI models it is #83. The next one up is gpt-4-turbo-2024-04-09 at 42.6. The next one down is GPT-4o (Aug 2024) at 42.2.
GPT-4o (Nov 2024), benchmark by benchmark
Epoch ECI puts GPT-4o (Nov 2024) at 129, #95 of 204. That beats 53% of the models tested, but 28 points short of Qwen 3.8 Max (156). The results either side are GPT-4o (May 2024) (129) and GPT-4o (Aug 2024) (129). It covers Epoch Capabilities Index: Epoch's own aggregate of ~40 benchmarks. The board median is 127, so GPT-4o (Nov 2024) is 2 points above it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
GPT-4o (Nov 2024) lands below the middle on TheAgentCompany: 8.6%, #7 of 13, with 46% of the field scoring higher. gemini-2.5-flash-preview-09-2025 leads at 41.1%; the closest result above is Gemini 2.0 Flash (Feb 2025) at 11.4%. It covers work tasks in a simulated software company. The median score on this board is also 8.6%. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
GPT-4o (Nov 2024) lands below the middle on Cybench: 12.5%, #10 of 16, with 56% of the field scoring higher. grok-4-0709 leads at 43.0%; the closest result above is GPT-4.5 Preview (Feb 2025) at 17.5%. It covers cybersecurity capture-the-flag tasks. The board median is 17.5%, so GPT-4o (Nov 2024) is 5.0 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
GPT-4o (Nov 2024) lands below the middle on GPQA Diamond: 47.9%, #194 of 275, with 70% of the field scoring higher. GPT-6 Astra (max) leads at 95.8%; the closest result above is qwen-plus-2025-01-25 at 48.1%. It covers expert-level science questions. The board median is 71.7%, so GPT-4o (Nov 2024) is 23.8 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
OTIS Mock AIME is a weak spot. GPT-4o (Nov 2024) scores 6.2%, #153 of 189, behind 80% of the models measured. The leader, Claude Fable 5.1 (max), reaches 100.0%. It covers competition maths (AIME 2024-25 style). The board median is 57.8%, so GPT-4o (Nov 2024) is 51.5 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
WeirdML is a weak spot. GPT-4o (Nov 2024) scores 25.1%, #89 of 109, behind 81% of the models measured. The leader, GPT-6 Astra (max), reaches 93.3%. It covers unusual machine-learning tasks. The board median is 41.2%, so GPT-4o (Nov 2024) is 16.1 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
CritPt is a weak spot. GPT-4o (Nov 2024) scores 0.0%, #95 of 115, behind 82% of the models measured. The leader, GPT-5.6 Sol (max), reaches 32.3%. It covers unpublished research-level physics problems. The board median is 2.9%, so GPT-4o (Nov 2024) is 2.9 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
EnigmaEval is a weak spot. GPT-4o (Nov 2024) scores 0.8%, #20 of 24, behind 79% of the models measured. The leader, Gemini 3 Pro Preview, reaches 18.2%. It covers multi-step puzzle hunts. The board median is 2.9%, so GPT-4o (Nov 2024) is 2.1 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
Humanity's Last Exam is a weak spot. GPT-4o (Nov 2024) scores 2.7%, #27 of 27, behind 96% of the models measured. The leader, Muse Spark, reaches 40.6%. It covers expert-level questions across domains. The board median is 10.7%, so GPT-4o (Nov 2024) is 8.0 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
GSO-Bench is a weak spot. GPT-4o (Nov 2024) scores 0.0%, #19 of 19, behind 95% of the models measured. The leader, GPT-5.5 (xhigh), reaches 40.2%. It covers software performance optimisation. The board median is 4.9%, so GPT-4o (Nov 2024) is 4.9 points below it. Source: Epoch AI Benchmarking Hub, captured 2026-10-13.
The full table above also lists the other 1 result, including boards with fewer than ten models, where a rank says little.
Strengths and weaknesses
Software engineering: weak, ahead of 9% of the field on average across 2 benchmarks. Its best board here is SWE-bench Verified (#60 of 73) and its weakest is GSO-Bench (#19 of 19). Reasoning, maths and science: weak, ahead of 17% of the field on average across 5 benchmarks. Its best board here is GPQA Diamond (#194 of 275) and its weakest is Humanity's Last Exam (#27 of 27). General knowledge and chat: uneven, ahead of 36% of the field on average across 3 benchmarks. Its best board here is Epoch ECI (#95 of 204) and its weakest is WeirdML (#89 of 109).
Price and value
The median input price across the 427 priced models is $0.500 per million tokens, so GPT-4o (Nov 2024) costs more than the typical listing. Models that score within 1.5 points or better and cost less: Qwen2.5-Coder-7B-Instruct ($0.010, 49.5), DeepSeek V4.1 Flash (high) ($0.010, 48.9), Qwen2.5-Coder-3B-Instruct ($0.010, 46.5). Similar scores cost more on claude-3-sonnet-20240229 ($3.00) and Llama-3.1-405B-Instruct ($3.50).
Release history
The OpenAI model released before it was gpt-4o-2024-11-20 on 2024-11-20, which scores 49.6. The next one was o1 (high) on 2024-12-05, at 48.1.
Reading these numbers
The 11 scores on this page come from 1 source: Epoch AI Benchmarking Hub (11). No official leaderboard supplied any of them, so treat them as third-party measurements.
Models ranked nearby
- #705 Qwen2-0.5B (42.4)
- #706 Qwen2.5-0.5B (42.4)
- #707 gemma-3-1b-it (42.4)
- #709 GPT-4o (Aug 2024) (42.2)
- #710 claude-2.0 (42.2)
- #711 qwen2.5-72b-instruct (42.2)
More from OpenAI
- GPT-6 Astra (max) (#2, 64.0)
- GPT-6.1 Sol (max) (#5, 60.6)
- GPT-5.6 Sol (max) (#6, 60.1)
- GPT-6 Sol (max) (#7, 60.0)
- GPT-5.5 (xhigh) (#11, 58.0)
- GPT-5.6 Terra (max) (#12, 57.8)
Compare it on the live leaderboard → · How the aggregate score works