Aider Polyglot leaderboard: which LLMs score highest

Aider Polyglot (edits across 6 languages (225 exercises)) currently has scores for 49 models. The top score is 83.1% by gemini-2.5-pro-preview-06-05; the median model scores 44.9% and the lowest scores 3.6%.

Aider Polyglot leaderboard: top 49 of 49 models (highest-effort row per model)
#ModelOrganisationAider Polyglot scoreCheapest input $/MSourceCaptured
1gemini-2.5-pro-preview-06-05Google83.1%$1.25Aider polyglot leaderboard2026-10-05
2Grok 4xAI79.6%$3.00Aider polyglot leaderboard2026-10-05
3o3 + gpt-4.1โ€”78.2%โ€”Aider polyglot leaderboard2026-10-05
4Gemini 2.5 Pro Preview 05-06Google76.9%โ€”Aider polyglot leaderboard2026-10-05
5Gemini 2.5 Pro Preview 03-25Google72.9%โ€”Aider polyglot leaderboard2026-10-05
6claude-opus-4-20250514Anthropic72.0%โ€”Aider polyglot leaderboard2026-10-05
7DeepSeek R1 (0528)deepseek-ai71.4%$0.400Aider polyglot leaderboard2026-10-05
8claude-3-7-sonnet-20250219Anthropic64.9%โ€”Aider polyglot leaderboard2026-10-05
9DeepSeek R1 + claude-3-5-sonnet-20241022โ€”64.0%โ€”Aider polyglot leaderboard2026-10-05
10o1-2024-12-17OpenAI61.7%$15.00Aider polyglot leaderboard2026-10-05
11claude-sonnet-4-20250514Anthropic61.3%โ€”Aider polyglot leaderboard2026-10-05
12Qwen3 235B A22B diff, no think, Alibaba APIAlibaba59.6%โ€”Aider polyglot leaderboard2026-10-05
13Kimi K2Moonshot AI59.1%$0.550Aider polyglot leaderboard2026-10-05
14DeepSeek-R1DeepSeek56.9%$0.400Aider polyglot leaderboard2026-10-05
15DeepSeek V3 0324DeepSeek55.1%$0.200Aider polyglot leaderboard2026-10-05
16gemini-2.5-flash-preview-05-20Google DeepMind55.1%โ€”Aider polyglot leaderboard2026-10-05
17Quasar Alphaโ€”54.7%โ€”Aider polyglot leaderboard2026-10-05
18grok-3-betaxAI53.3%โ€”Aider polyglot leaderboard2026-10-05
19Optimus Alphaโ€”52.9%โ€”Aider polyglot leaderboard2026-10-05
20GPT-4.1OpenAI52.4%$2.00Aider polyglot leaderboard2026-10-05
21Claude 3.5-Sonnet-20241022Anthropic51.6%$3.00Aider polyglot leaderboard2026-10-05
22DeepSeek Chat V3 (prev)DeepSeek48.4%โ€”Aider polyglot leaderboard2026-10-05
23gemini-2.5-flash-preview-04-17Google47.1%โ€”Aider polyglot leaderboard2026-10-05
24chatgpt-4o-latest (2025-03-29)OpenAI45.3%โ€”Aider polyglot leaderboard2026-10-05
25gpt-4.5-previewOpenAI44.9%$75.00Aider polyglot leaderboard2026-10-05
26Qwen3-32BAlibaba40.0%$0.080Aider polyglot leaderboard2026-10-05
27gemini-exp-1206Google DeepMind,Google38.2%$0.300Aider polyglot leaderboard2026-10-05
28Gemini 2.0 Pro exp-02-05Google35.6%โ€”Aider polyglot leaderboard2026-10-05
29o1-mini-2024-09-12OpenAI32.9%$1.10Aider polyglot leaderboard2026-10-05
30GPT-4.1 miniOpenAI32.4%$0.400Aider polyglot leaderboard2026-10-05
31claude-3-5-haiku-20241022Anthropic28.0%$1.00Aider polyglot leaderboard2026-10-05
32chatgpt-4o-latest (2025-02-15)OpenAI27.1%โ€”Aider polyglot leaderboard2026-10-05
33QwQ-32B + Qwen 2.5 Coder Instructโ€”26.2%โ€”Aider polyglot leaderboard2026-10-05
34gpt-4o-2024-08-06OpenAI23.1%$2.50Aider polyglot leaderboard2026-10-05
35gemini-2.0-flash-expGoogle DeepMind,Google22.2%โ€”Aider polyglot leaderboard2026-10-05
36qwen-max-2025-01-25Alibaba21.8%โ€”Aider polyglot leaderboard2026-10-05
37QwQ-32BAlibaba20.9%$0.150Aider polyglot leaderboard2026-10-05
38gemini-2.0-flash-thinking-exp-01-21Google18.2%โ€”Aider polyglot leaderboard2026-10-05
39gpt-4o-2024-11-20OpenAI18.2%$2.50Aider polyglot leaderboard2026-10-05
40DeepSeek Chat V2.5DeepSeek17.8%โ€”Aider polyglot leaderboard2026-10-05
41Qwen2.5 Coder 32B InstructQwen16.4%$0.060Aider polyglot leaderboard2026-10-05
42Llama 4 MaverickMeta AI15.6%$0.188Aider polyglot leaderboard2026-10-05
43yi-lightningโ€”12.9%โ€”Aider polyglot leaderboard2026-10-05
44command-a-03-2025-qualityCohere12.0%โ€”Aider polyglot leaderboard2026-10-05
45Codestral 25.01Mistral AI11.1%โ€”Aider polyglot leaderboard2026-10-05
46openhands-lm-32b-v0.1โ€”10.2%โ€”Aider polyglot leaderboard2026-10-05
47GPT-4.1 nanoOpenAI8.9%$0.100Aider polyglot leaderboard2026-10-05
48gemma-3-27b-itGoogle DeepMind4.9%$0.080Aider polyglot leaderboard2026-10-05
49gpt-4o-mini-2024-07-18OpenAI3.6%$0.150Aider polyglot leaderboard2026-10-05

Compare all benchmarks side by side on the live leaderboard โ†’

Among the ten highest scorers, the cheapest listed API price belongs to DeepSeek R1 (0528) at $0.400 per million input tokens (score 71.4%).

What Aider Polyglot measures

Aider's polyglot benchmark gives a model 225 hard Exercism exercises in C++, Go, Java, JavaScript, Python and Rust and checks whether its code edits make the tests pass.

How to read these scores

Scores are percentages (higher is better): the share of questions or tasks the model completed correctly. Where a model is listed at several reasoning efforts, only its highest-effort row is shown. See the methodology for how rows are chosen.

Where the data comes from

Aider polyglot leaderboard. Scores were last captured 2026-10-05; the Captured column gives each row's date.

Related benchmarks