Skip to content
Best AI Ever

Best AI by use case

Best AI for coding

Our coding ranking weighs DeepSWE v1.1 and Terminal-Bench 4.0 results against token price, context window and tool calling. This page explains the criteria, which benchmark runs count as comparable and how to read the scores.

By Updated Ranking as of 2026-10-27Methodology v3

The ranking

As of , DeepSeek-V4.1-Flash leads our coding ranking of 20 models, ahead of Gemini 4 Argon and GPT-6.1 Sol.

Rank Model Score DeepSWE v1.1 (software engineering) 45 %Terminal-Bench 4.0 (command-line agents) 20 %Blended price per 1M tokens (3:1) 25 %Context window 5 %Tool calling 5 % Coverage
#1 DeepSeek-V4.1-FlashDeepSeek 85.0 7797/100snapshot DeepSeek-V4.1-Flash-1017; v1.1; effort not stated; Mini-SWE-V2 harnessself-reported 42.357/100snapshot DeepSeek-V4.1-Flash-1017; effort not stated; Claude Code harnessself-reported $0.525 per 1M tokens (blended 3:1)79/100 1,048,576 tokens100/100 Yes100/100 100 %
#2 Gemini 4 ArgonGoogle 80.3 77.999/100v1.1; high effort; mini-swe-agent harnessself-reported 57.486/100high effort; harness not stated (self-computed by Google)self-reported $4.00 per 1M tokens (blended 3:1)35/100 1,048,576 tokens100/100 Yes100/100 100 %
#3 GPT-6.1 SolOpenAI 78.8 75.295/100v1.1; high effortself-reported 58.287/100max effort; Codex harness $4.00 per 1M tokens (blended 3:1)35/100 1,050,000 tokens100/100 Yes100/100 100 %
#4 Claude Sonnet 5.5Anthropic 77.0 7188/100v1.1; max effort; scaffold not stated; mean of 5 trialsself-reported 61.894/100max effort; Claude Code harness $4.00 per 1M tokens (blended 3:1)35/100 1,000,000 tokens93/100 Yes100/100 100 %
#5 Claude Opus 5.5Anthropic 76.6 74.293/100v1.1; max effort; scaffold not stated; mean of 5 trialsself-reported 64.8100/100max effort; Claude Code harness $8.00 per 1M tokens (blended 3:1)20/100 1,000,000 tokens93/100 Yes100/100 100 %
#6 Muse WonderMeta 75.1 78.8100/100v1.1 (113 tasks), pass@1; max effort; result Meta attributes to Datacurve, harness not stated (not on the public Datacurve board as of 2026-10-25)self-reported 5276/100Terminal-Bench 4.0; max effort; result sourced by Meta from Artificial Analysis (Artificial Analysis harness)self-reported $8.00 per 1M tokens (blended 3:1)20/100 1,048,576 tokens100/100 Yes100/100 100 %
#7 GPT-6 LunaOpenAI 73.3 66.682/100v1.1; max effortself-reported 16.48/100max effort; Codex harness $0.20 per 1M tokens (blended 3:1)100/100 1,050,000 tokens100/100 Yes100/100 100 %
#8 GPT-6 SolOpenAI 71.1 68.885/100v1.1; max effortself-reported 49.471/100max effort; Codex harness $4.00 per 1M tokens (blended 3:1)35/100 1,050,000 tokens100/100 Yes100/100 100 %
#9 GPT-6 AstraOpenAI 69.3 7493/100v1.1; xhigh effort; mini-swe-agent 58.287/100max effort; Codex harness $20.00 per 1M tokens (blended 3:1)0/100 1,050,000 tokens100/100 Yes100/100 100 %
#10 Gemini 3.8 FlashGoogle 68.4 7493/100v1.1; high effort; mini-swe-agent harness 19.113/100high effort; mini-SWE-agent harness $1.50 per 1M tokens (blended 3:1)56/100 1,048,576 tokens100/100 Yes100/100 100 %
#11 Muse Spark 1.3Meta 66.0 75.495/100v1.1 (113 tasks), task pass rate; max effort; mini-swe-agent (run by Meta)self-reported 14.54/100Terminal-Bench 4.0; xhigh effort; Muse Code harness $2.00 per 1M tokens (blended 3:1)50/100 1,048,576 tokens100/100 Yes100/100 100 %
#12 Grok 4.7xAI 64.7 7188/100v1.1; high effort; mini-SWE-agent harnessself-reported 37.648/100xhigh effort; Grok Build harness $3.00 per 1M tokens (blended 3:1)41/100 500,000 tokens0/100 Yes100/100 100 %
#13 Claude Fable 5.1Anthropic 64.4 67.483/100v1.1; max effort; scaffold not stated; mean of 5 trialsself-reported 57.987/100xhigh effort; Claude Code harness $20.00 per 1M tokens (blended 3:1)0/100 1,000,000 tokens93/100 Yes100/100 100 %
#14 Muse Spark 1.2Meta 64.3 5564/100v1.1 (113 tasks), pass@1; xhigh effort; mini-swe-agent (official leaderboard harness) No data $2.00 per 1M tokens (blended 3:1)50/100 1,048,576 tokens100/100 Yes100/100 80 %
#15 Muse Spark 1.1Meta 62.6 5361/100v1.1 (113 tasks), pass@1; xhigh effort; mini-swe-agent (official leaderboard harness) No data $2.00 per 1M tokens (blended 3:1)50/100 1,048,576 tokens100/100 Yes100/100 80 %
#16 Gemini 3.6 FlashGoogle 59.5 4752/100v1.1; high effort; mini-swe-agent harness No data $1.50 per 1M tokens (blended 3:1)56/100 1,048,576 tokens100/100 Yes100/100 80 %
#17 Qwen3.8-MaxAlibaba Cloud (Qwen) 55.9 5767/100v1.1 (113 tasks); xhigh effort; mini-swe-agent 2728/100snapshot qwen3.8-max-0902; max effort; Claude Code harness $3.00 per 1M tokens (blended 3:1)41/100 1,000,000 tokens93/100 Yes100/100 100 %
#18 Grok 4.6xAI 55.4 6782/100v1.1; xhigh effort; mini-swe-agent 20.315/100high effort; Grok Build harness $3.00 per 1M tokens (blended 3:1)41/100 500,000 tokens0/100 Yes100/100 100 %
#19 Grok 4.5xAI 43.6 5463/100v1.1; high effort; mini-swe-agent 12.40/100high effort; Grok Build harness $3.00 per 1M tokens (blended 3:1)41/100 500,000 tokens0/100 Yes100/100 100 %
#20 Gemini 3.1 ProGoogle 22.6 120/100v1.1; high effort; mini-swe-agent harness No data $4.50 per 1M tokens (blended 3:1)32/100 1,048,576 tokens100/100 Yes100/100 80 %

Each criterion is normalized to 0–100 across the ranked candidates; the score is the weighted average over the criteria with data. Missing data is never counted as zero.

In short

  • This ranking compares language models for software engineering. Coding benchmarks carry 65% of the weight: DeepSWE v1.1 counts 45% and Terminal-Bench 4.0 counts 20%.
  • The blended price per million tokens (three input tokens per output token) counts 25%. Context window and tool calling count 5% each.
  • Coding scores depend heavily on the agent harness and reasoning effort. Use the ranking to build a shortlist, then test two or three models on your own code.

Who this page is for

This page is for developers and teams choosing a model for coding work: an assistant in the editor, a coding agent that edits files and runs commands, or an API model inside your own tooling. It covers language models used for software engineering, not code-completion products or IDE plugins as such.

If you would rather pay a monthly fee for a chat app with a coding agent than pay per token, see the best AI subscription for coding, where consumer plans are scored per price tier on model quality, coding agents, usage limits and price.

How this ranking works

The ranking combines five criteria into one score. The weights are fixed and add up to 100%. Our methodology explains how each criterion is scaled and combined.

  • DeepSWE v1.1, 45%. DeepSWE tests coding agents on 113 long-horizon tasks across 91 repositories, written from scratch to limit training-data contamination [1]. It is the closest match to real software engineering work that we track, so it carries the largest weight.
  • Terminal-Bench 4.0, 20%. Terminal-Bench measures agents completing tasks in a command-line environment, such as builds, debugging and tooling [2].
  • Blended price, 25%. Coding agents resend large amounts of context across long sessions, so cost per token matters. Lower is better, on a log scale, so that a few very expensive models don't flatten the differences among the rest.
  • Context window, 5%. A larger window lets the model see more of a codebase at once. The weight is low because most current flagship models already document 500,000 to about one million tokens.
  • Tool calling, 5%. Coding agents read and edit files and run commands through tool calls. The weight is low because nearly all current text models support it.

Which benchmark results count

Scores from different setups are not directly comparable, so each benchmark criterion uses a setting group: a list of stored settings we treat as comparable for this ranking.

  • DeepSWE v1.1: all v1.1 runs on the official mini-swe-agent harness, which Datacurve's leaderboard uses for every model [1], or on a harness that the source does not state, at any reasoning effort. Runs on provider-specific coding agents are left out. So, for example, Mistral's DeepSWE figure for a preview of Mistral Large 4, measured with a separate harness run by Artificial Analysis [3], is not part of the group.
  • Terminal-Bench 4.0: every 4.0 run counts, whatever the harness and effort. The benchmark always pairs a model with an agent, and its leaderboard lists each combination of harness, model and effort separately [2]. Many models only have results on their provider's own agent, such as Claude Code, Codex or Grok Build [4].

Within each group, a model counts with its best result. Independent results are preferred over results a provider reports itself; if only a provider result exists, it is used and marked "self-reported". The methodology box on this page lists every stored setting in each group.

A model needs data for at least 60% of the total weight to be ranked. Terminal-Bench, price, context and tool calling together make up 55%, so only models with a DeepSWE v1.1 result in the group can be ranked.

How to read the results

  • Scores are relative. Each criterion is rescaled from 0 to 100 across the candidates on this page. 100 means best among these models, not perfect, and adding or removing a model can shift the others.
  • Check the setting. The table shows the setting behind each score, including reasoning effort and harness where the source states them.
  • "Self-reported" marks a result that comes from the model's own provider, run on a setup the provider chose.
  • Small gaps are noise. DeepSWE has only 113 tasks, so differences of a few points are within noise [1]. Terminal-Bench 4.0 margins are about three points [4].

Limitations

Grouping lets us compare most current models, at the cost of comparing runs that were not set up identically. Provider-reported coding scores move by several points depending on the setup:

  • DeepSeek reports DeepSWE v1.1 scores between 65.5% and 74.2% for the same model, the first release of DeepSeek-V4.1-Flash (September 2026), depending on which agent harness it used [5].
  • OpenAI reports GPT-6 Astra's DeepSWE score separately for each reasoning effort, from 67.0% at low effort to 74.1% at extra-high effort [6]. Because the group takes each model's best run at any effort, a model whose provider published a high-effort run can look stronger than one with only a lower-effort result.
  • Anthropic reports 70.6% on Terminal-Bench 4.0 for Claude Sonnet 5.5 from its own run on Claude Code at max effort [7], while the public leaderboard lists 61.8% for the same model, harness and effort [4]. Where both exist, the ranking uses the independent one.

Further caveats:

  • Terminal-Bench results in the group mostly pair each provider's models with that provider's own agent, so part of the score reflects the agent rather than the model.
  • Many DeepSWE results are reported by the model's own provider; they are marked "self-reported" in the table.
  • Results from earlier benchmark versions are not comparable with DeepSWE v1.1 or Terminal-Bench 4.0, and we don't mix them [1] [2].
  • A missing result doesn't mean a model is weak at coding, only that we have no comparable measurement. Models without a DeepSWE v1.1 result in the group don't appear in the ranking.
  • The data behind this page is as of October 2026.

All published results

The tables below list every published result we hold for both benchmarks, each with its setting and who reported it, including runs outside the ranking's setting groups.

ModelScoreSettingReported byMeasuredVerifiedSource
Muse Wonder Full Meta 79 % v1.1 (113 tasks), pass@1; max effort; result Meta attributes to Datacurve, harness not stated (not on the public Datacurve board as of 2026-10-25) Self-reported — 2026-10-25 —
Muse Wonder Meta 78.8 % v1.1 (113 tasks), pass@1; max effort; result Meta attributes to Datacurve, harness not stated (not on the public Datacurve board as of 2026-10-25) Self-reported — 2026-10-25 —
Gemini 4 Argon Google 77.9 % v1.1; high effort; mini-swe-agent harness Self-reported — 2026-10-25 —
DeepSeek-V4.1-Flash DeepSeek 77 % snapshot DeepSeek-V4.1-Flash-1017; v1.1; effort not stated; Mini-SWE-V2 harness Self-reported — 2026-10-25 —
Muse Spark 1.3 Meta 75.4 % v1.1 (113 tasks), task pass rate; max effort; mini-swe-agent (run by Meta) Self-reported — 2026-10-25 —
GPT-6.1 Sol OpenAI 75.2 % v1.1; high effort Self-reported — 2026-10-25 —
Claude Opus 5.5 Anthropic 74.2 % v1.1; max effort; scaffold not stated; mean of 5 trials Self-reported — 2026-10-12 —
DeepSeek-V4.1-Flash DeepSeek 74.2 % Resolved, N=8 samples per task; max effort; mini-SWE harness (mini-swe-agent) Self-reported — 2026-10-25 —
GPT-6 Astra OpenAI 74.1 % v1.1; xhigh effort Self-reported — 2026-10-25 —
Gemini 3.8 Flash Google 74 % v1.1; high effort; mini-swe-agent harness Third party — 2026-10-25 —
GPT-6 Astra OpenAI 74 % v1.1; xhigh effort; mini-swe-agent Third party — 2026-10-25 —
Gemini 3.8 Flash Google 73.7 % v1.1; high effort; mini-swe-agent harness Self-reported — 2026-10-25 —
GPT-6 Astra OpenAI 73.2 % v1.1; high effort Self-reported — 2026-10-25 —
GPT-6 Astra OpenAI 73 % v1.1; max effort Self-reported — 2026-10-25 —
GPT-6 Astra OpenAI 73 % v1.1; high effort; mini-swe-agent Third party — 2026-10-25 —
GPT-6 Astra OpenAI 73 % v1.1; max effort; mini-swe-agent Third party — 2026-10-25 —
GPT-6 Astra OpenAI 73 % v1.1; medium effort; mini-swe-agent Third party — 2026-10-25 —
GPT-6.1 Sol OpenAI 73 % v1.1; medium effort Self-reported — 2026-10-25 —
GPT-6 Astra OpenAI 72.8 % v1.1; medium effort Self-reported — 2026-10-25 —
DeepSeek-V4.1-Flash DeepSeek 72.6 % Resolved, N=8 samples per task; max effort; DeepSeek Harness (Minimal mode) Self-reported — 2026-10-25 —
GPT-6.1 Sol OpenAI 71.9 % v1.1; xhigh effort Self-reported — 2026-10-25 —
GPT-6.1 Sol OpenAI 71.9 % v1.1; max effort Self-reported — 2026-10-25 —
Claude Sonnet 5.5 Anthropic 71 % v1.1; max effort; scaffold not stated; mean of 5 trials Self-reported — 2026-10-12 —
Gemini 3.8 Flash Google 71 % v1.1; medium effort; mini-swe-agent harness Third party — 2026-10-25 —
Grok 4.7 xAI 71 % v1.1; high effort; mini-SWE-agent harness Self-reported — 2026-10-25 —
DeepSeek-V4.1-Flash DeepSeek 70.5 % Resolved, N=8 samples per task; max effort; DeepSeek Harness (Standard mode) Self-reported — 2026-10-25 —
DeepSeek-V4.1-Flash DeepSeek 69.8 % Resolved, N=8 samples per task; max effort; Claude Code v2.1.251 Self-reported — 2026-10-25 —
GPT-6 Sol OpenAI 68.8 % v1.1; max effort Self-reported — 2026-10-25 —
DeepSeek-V4.1-Flash DeepSeek 67.6 % Resolved, N=8 samples per task; max effort; DeepSeek Harness (PTC mode) Self-reported — 2026-10-25 —
Claude Fable 5.1 Anthropic 67.4 % v1.1; max effort; scaffold not stated; mean of 5 trials Self-reported — 2026-10-12 —
GPT-6 Astra OpenAI 67 % v1.1; low effort Self-reported — 2026-10-25 —
GPT-6 Astra OpenAI 67 % v1.1; low effort; mini-swe-agent Third party — 2026-10-25 —
Grok 4.6 xAI 67 % v1.1; medium effort; mini-swe-agent Third party — 2026-10-25 —
Grok 4.6 xAI 67 % v1.1; xhigh effort; mini-swe-agent Third party — 2026-10-25 —
Grok 4.6 xAI 67 % v1.1; xhigh effort; mini-swe-agent harness Self-reported — 2026-10-25 —
GPT-6 Luna OpenAI 66.6 % v1.1; max effort Self-reported — 2026-10-25 —
GPT-6 Sol OpenAI 66.6 % v1.1; xhigh effort Self-reported — 2026-10-25 —
DeepSeek-V4.1-Flash DeepSeek 66.2 % Resolved, N=8 samples per task; max effort; Pi v0.84.2 Self-reported — 2026-10-25 —
DeepSeek-V4.1-Flash DeepSeek 66 % Resolved; reasoning effort 25 (of 100); harness not stated Self-reported — 2026-10-25 —
Grok 4.6 xAI 65.9 % v1.1; high effort; mini-swe-agent harness Self-reported — 2026-10-25 —
DeepSeek-V4.1-Flash DeepSeek 65.6 % Resolved, N=8 samples per task; max effort; Codex v0.147.0 Self-reported — 2026-10-25 —
DeepSeek-V4.1-Flash DeepSeek 65.5 % Resolved, N=8 samples per task; max effort; OpenCode v1.18.15 Self-reported — 2026-10-25 —
GPT-6 Sol OpenAI 65.3 % v1.1; high effort Self-reported — 2026-10-25 —
Grok 4.6 xAI 65 % v1.1; high effort; mini-swe-agent Third party — 2026-10-25 —
GPT-6.1 Sol OpenAI 64.4 % v1.1; low effort Self-reported — 2026-10-25 —
DeepSeek-V4-Pro DeepSeek 62.7 % Resolved; max effort; DeepSeek Harness (Minimal mode) Self-reported — 2026-10-25 —
Mistral Large 4 Mistral AI 61.7 % v1.1, 'Mistral Large 4 Preview'; effort not stated; Artificial Analysis harness ('AA-DeepSWE 1.1', run privately by AA), not mini-swe-agent Self-reported — 2026-10-25 —
GPT-6 Luna OpenAI 61.3 % v1.1; xhigh effort Self-reported — 2026-10-25 —
Muse Spark Open Meta 60 % v1.1 (113 tasks); xhigh effort; Muse Code harness; result sourced by Meta from Artificial Analysis Self-reported — 2026-10-25 —
GPT-6 Luna OpenAI 59.3 % v1.1; high effort Self-reported — 2026-10-25 —
Muse Spark 1.2 Meta 59.3 % v1.1 (113 tasks), pass@1 averaged over 5 attempts; xhigh effort; Muse Code harness (Meta internal framework, Daytona sandboxes) Self-reported — 2026-10-25 —
Qwen3.8-Flash Alibaba Cloud (Qwen) 58.7 % v1.1; effort not stated; best of Claude Code and mini-SWE-agent harnesses, temp 1.0, top_p 0.95, 256K context Self-reported — 2026-10-25 —
Qwen3.8-Omni-Flash Alibaba Cloud (Qwen) 57.8 % v1.1; effort not stated; best of Claude Code and mini-SWE-agent harnesses, temp 1.0, top_p 0.95, 256K context Self-reported — 2026-10-25 —
Qwen3.8-Max Alibaba Cloud (Qwen) 57 % v1.1 (113 tasks); xhigh effort; mini-swe-agent Third party — 2026-10-25 —
GPT-6 Sol OpenAI 56.6 % v1.1; medium effort Self-reported — 2026-10-25 —
Qwen3.8-Max Alibaba Cloud (Qwen) 56.6 % v1.1; effort not stated; best of Claude Code and mini-SWE-agent harnesses (Claude Code best), temp 1.0, top_p 0.95, 256K context Self-reported — 2026-10-25 —
Muse Spark 1.2 Meta 55 % v1.1 (113 tasks), pass@1; xhigh effort; mini-swe-agent (official leaderboard harness) Third party — 2026-10-25 —
Grok 4.5 xAI 54 % v1.1; high effort; mini-swe-agent Third party — 2026-10-25 —
Muse Spark 1.1 Meta 53.3 % v1.1 (113 tasks), pass@1 averaged over 5 attempts; xhigh effort; Meta internal fork of the bash-only mini-swe-agent harness, internet disabled Self-reported — 2026-10-25 —
Grok 4.5 xAI 53 % v1.1; high effort; mini-swe-agent harness run by Datacurve Self-reported — 2026-10-25 —
Muse Spark 1.1 Meta 53 % v1.1 (113 tasks), pass@1; xhigh effort; mini-swe-agent (official leaderboard harness) Third party — 2026-10-25 —
Gemini 3.6 Flash Google 47 % v1.1; high effort; mini-swe-agent harness Third party — 2026-10-25 —
GPT-6 Luna OpenAI 44.5 % v1.1; medium effort Self-reported — 2026-10-25 —
Qwen3.8-27B Alibaba Cloud (Qwen) 42.2 % v1.1; effort not stated; Claude Code harness, temp 1.0, top_p 0.95, 256K context Self-reported — 2026-10-25 —
Grok 4.6 xAI 42 % v1.1; low effort; mini-swe-agent Third party — 2026-10-25 —
GPT-6 Sol OpenAI 37.2 % v1.1; low effort Self-reported — 2026-10-25 —
Qwen3.7-Plus Alibaba Cloud (Qwen) 16.5 % v1.1; effort not stated; best of Claude Code and mini-SWE-agent harnesses, temp 1.0, top_p 0.95, 256K context Self-reported — 2026-10-25 —
Qwen3.7-Plus Alibaba Cloud (Qwen) 14.2 % v1.1; effort not stated; Claude Code harness, temp 1.0, top_p 0.95, 256K context Self-reported — 2026-10-25 —
Gemini 3.1 Pro Google 12 % v1.1; high effort; mini-swe-agent harness Third party — 2026-10-25 —
GPT-6 Luna OpenAI 2.4 % v1.1; low effort Self-reported — 2026-10-25 —

Sorted by score, without rank numbers: each result was measured under its own setting (effort level, harness, tools, test version), as stated by the source. Scores are only directly comparable between rows with the same setting. Self-reported results come from the provider and have not been reproduced independently.

DeepSWE v1.1: % resolved (pass@1), higher is better.
ModelScoreSettingReported byMeasuredVerifiedSource
Claude Sonnet 5.5 Anthropic 70.6 % max effort; Claude Code (--bare), 5 trials/task Self-reported — 2026-10-12 —
Claude Opus 5.5 Anthropic 66.4 % xhigh effort; Claude Code (--bare), 5 trials/task Self-reported — 2026-10-12 —
Claude Opus 5.5 Anthropic 64.8 % max effort; Claude Code (--bare), 5 trials/task Self-reported — 2026-10-12 —
Claude Opus 5.5 Anthropic 64.8 % max effort; Claude Code harness Third party — 2026-10-12 —
Claude Sonnet 5.5 Anthropic 61.8 % max effort; Claude Code harness Third party — 2026-10-12 —
GPT-6 Astra OpenAI 58.2 % max effort; Codex harness Third party — 2026-10-25 —
GPT-6.1 Sol OpenAI 58.2 % max effort; Codex harness Third party — 2026-10-25 —
Claude Fable 5.1 Anthropic 57.9 % max effort; Claude Code harness Third party — 2026-10-12 —
Claude Fable 5.1 Anthropic 57.9 % xhigh effort; Claude Code harness Third party — 2026-10-12 —
GPT-6 Astra OpenAI 57.9 % high effort Self-reported — 2026-10-25 —
GPT-6 Astra OpenAI 57.9 % xhigh effort; Codex harness Third party — 2026-10-25 —
GPT-6 Astra OpenAI 57.9 % high effort; Codex harness Third party — 2026-10-25 —
GPT-6 Astra OpenAI 57.6 % xhigh effort Self-reported — 2026-10-25 —
Gemini 4 Argon Google 57.4 % high effort; harness not stated (self-computed by Google) Self-reported — 2026-10-25 —
Muse Wonder Full Meta 57.1 % Terminal-Bench 4.0; max effort; result sourced by Meta from Artificial Analysis (Artificial Analysis harness) Self-reported — 2026-10-25 —
GPT-6 Astra OpenAI 56.7 % max effort Self-reported — 2026-10-25 —
Claude Fable 5.1 Anthropic 55.8 % max effort; Claude Code (--bare), 15 trials/task Self-reported — 2026-10-12 —
Claude Fable 5.1 Anthropic 54.5 % high effort; Claude Code harness Third party — 2026-10-12 —
GPT-6 Astra OpenAI 54.2 % medium effort; Codex harness Third party — 2026-10-25 —
Claude Fable 5.1 Anthropic 53.9 % medium effort; Claude Code harness Third party — 2026-10-12 —
GPT-6 Astra OpenAI 53.9 % medium effort Self-reported — 2026-10-25 —
Muse Wonder Meta 52 % Terminal-Bench 4.0; max effort; result sourced by Meta from Artificial Analysis (Artificial Analysis harness) Self-reported — 2026-10-25 —
GPT-6 Astra OpenAI 50.6 % low effort; Codex harness Third party — 2026-10-25 —
GPT-6 Astra OpenAI 49.7 % low effort Self-reported — 2026-10-25 —
GPT-6 Sol OpenAI 49.4 % max effort; Codex harness Third party — 2026-10-25 —
Claude Fable 5.1 Anthropic 43.3 % low effort; Claude Code harness Third party — 2026-10-12 —
DeepSeek-V4.1-Flash DeepSeek 42.3 % snapshot DeepSeek-V4.1-Flash-1017; effort not stated; Claude Code harness Self-reported — 2026-10-25 —
Claude Haiku 5.5 Anthropic 39.2 % max effort; Claude Code (--bare), 10 trials/task Self-reported — 2026-10-12 —
Grok 4.7 xAI 37.6 % xhigh effort; Grok Build harness Third party — 2026-10-25 —
Grok 4.7 xAI 37.6 % xhigh effort Self-reported — 2026-10-25 —
DeepSeek-V4.1-Flash DeepSeek 31.2 % Pass@1; max effort (reasoning_effort=100); DeepSeek Harness (Minimal mode), 1M-token context Self-reported — 2026-10-25 —
Mistral Large 4 Mistral AI 28.3 % Terminal-Bench 4.0, 'Mistral Large 4 Preview'; effort not stated; Artificial Analysis harness (run privately by AA before the harness' public launch) Self-reported — 2026-10-25 —
Qwen3.8-Max Alibaba Cloud (Qwen) 27 % snapshot qwen3.8-max-0902; max effort; Claude Code harness Third party — 2026-10-25 —
Grok 4.6 xAI 20.3 % high effort; Grok Build harness Third party — 2026-10-25 —
Grok 4.6 xAI 20.3 % high effort Self-reported — 2026-10-25 —
Gemini 3.8 Flash Google 19.1 % high effort; mini-SWE-agent harness Third party — 2026-10-25 —
GPT-6 Luna OpenAI 16.4 % max effort; Codex harness Third party — 2026-10-25 —
Muse Spark 1.3 Meta 14.5 % Terminal-Bench 4.0; xhigh effort; Muse Code harness Third party — 2026-10-25 —
DeepSeek-V4-Pro DeepSeek 12.4 % Pass@1; max effort; harness not stated Self-reported — 2026-10-25 —
Grok 4.5 xAI 12.4 % high effort; Grok Build harness Third party — 2026-10-25 —
Grok 4.5 xAI 12.4 % high effort Self-reported — 2026-10-25 —

Sorted by score, without rank numbers: each result was measured under its own setting (effort level, harness, tools, test version), as stated by the source. Scores are only directly comparable between rows with the same setting. Self-reported results come from the provider and have not been reproduced independently.

Terminal-Bench 4.0: % tasks resolved, higher is better.

How to choose for your own work

  1. Start from the ranking, then check the benchmark pages. On DeepSWE v1.1 and Terminal-Bench 4.0, look for models with results in the same harness you plan to use, or in the official leaderboard setting [8].
  2. Check cost at your volume. Coding agents resend large amounts of context on every step, so input price and caching matter more than for chat. Use AI pricing and the cost calculator.
  3. Compare the shortlist side by side with model comparisons and the individual model pages: context window, maximum output, tool calling and data policy.
  4. Test on your own repository. Run the same handful of real tasks, such as a bug fix, a refactor and a test-writing task, with each candidate in your own harness. That is the only result that measures your setup.

Model by model

#1 DeepSeek-V4.1-Flash

DeepSeek-V4.1-Flash (DeepSeek): 77 % on DeepSWE v1.1, 42.3 % on Terminal-Bench 4.0, at $0.52 per 1M tokens blended.

Pros

  • DeepSWE v1.1: 77 % (snapshot DeepSeek-V4.1-Flash-1017; v1.1; effort not stated; Mini-SWE-V2 harness; provider-reported).
  • Lower list price: $0.52 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • The DeepSWE v1.1 result is provider-reported; no independent run in a comparable setting is recorded.
  • Below the median of the compared models on Terminal-Bench 4.0: 42.3 % (snapshot DeepSeek-V4.1-Flash-1017; effort not stated; Claude Code harness; provider-reported).

#2 Gemini 4 Argon

Gemini 4 Argon (Google): 77.9 % on DeepSWE v1.1, 57.4 % on Terminal-Bench 4.0, at $4.00 per 1M tokens blended.

Pros

  • DeepSWE v1.1: 77.9 % (v1.1; high effort; mini-swe-agent harness; provider-reported).
  • Terminal-Bench 4.0: 57.4 % (high effort; harness not stated (self-computed by Google); provider-reported).
  • Context window of 1,048,576 tokens.

Cons

  • The DeepSWE v1.1 result is provider-reported; no independent run in a comparable setting is recorded.
  • The Terminal-Bench 4.0 result is provider-reported; no independent run in a comparable setting is recorded.
  • Higher list price: $4.00 per 1M tokens (blended 3:1 input:output).

#3 GPT-6.1 Sol

GPT-6.1 Sol (OpenAI): 75.2 % on DeepSWE v1.1, 58.2 % on Terminal-Bench 4.0, at $4.00 per 1M tokens blended.

Pros

  • DeepSWE v1.1: 75.2 % (v1.1; high effort; provider-reported).
  • Terminal-Bench 4.0: 58.2 % (max effort; Codex harness).
  • Context window of 1,050,000 tokens.

Cons

  • The DeepSWE v1.1 result is provider-reported; no independent run in a comparable setting is recorded.
  • Higher list price: $4.00 per 1M tokens (blended 3:1 input:output).

#4 Claude Sonnet 5.5

Claude Sonnet 5.5 (Anthropic): 71 % on DeepSWE v1.1, 61.8 % on Terminal-Bench 4.0, at $4.00 per 1M tokens blended.

Pros

  • DeepSWE v1.1: 71 % (v1.1; max effort; scaffold not stated; mean of 5 trials; provider-reported).
  • Terminal-Bench 4.0: 61.8 % (max effort; Claude Code harness).
  • Context window of 1,000,000 tokens.

Cons

  • The DeepSWE v1.1 result is provider-reported; no independent run in a comparable setting is recorded.
  • Higher list price: $4.00 per 1M tokens (blended 3:1 input:output).

#5 Claude Opus 5.5

Claude Opus 5.5 (Anthropic): 74.2 % on DeepSWE v1.1, 64.8 % on Terminal-Bench 4.0, at $8.00 per 1M tokens blended.

Pros

  • DeepSWE v1.1: 74.2 % (v1.1; max effort; scaffold not stated; mean of 5 trials; provider-reported).
  • Terminal-Bench 4.0: 64.8 % (max effort; Claude Code harness).
  • Context window of 1,000,000 tokens.

Cons

  • The DeepSWE v1.1 result is provider-reported; no independent run in a comparable setting is recorded.
  • Higher list price: $8.00 per 1M tokens (blended 3:1 input:output).

#6 Muse Wonder

Muse Wonder (Meta): 78.8 % on DeepSWE v1.1, 52 % on Terminal-Bench 4.0, at $8.00 per 1M tokens blended.

Pros

  • DeepSWE v1.1: 78.8 % (v1.1 (113 tasks), pass@1; max effort; result Meta attributes to Datacurve, harness not stated (not on the public Datacurve board as of 2026-10-25); provider-reported).
  • Terminal-Bench 4.0: 52 % (Terminal-Bench 4.0; max effort; result sourced by Meta from Artificial Analysis (Artificial Analysis harness); provider-reported).
  • Context window of 1,048,576 tokens.

Cons

  • The DeepSWE v1.1 result is provider-reported; no independent run in a comparable setting is recorded.
  • The Terminal-Bench 4.0 result is provider-reported; no independent run in a comparable setting is recorded.
  • Higher list price: $8.00 per 1M tokens (blended 3:1 input:output).

#7 GPT-6 Luna

GPT-6 Luna (OpenAI): 66.6 % on DeepSWE v1.1, 16.4 % on Terminal-Bench 4.0, at $0.20 per 1M tokens blended.

Pros

  • Lower list price: $0.20 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,050,000 tokens.

Cons

  • Below the median of the compared models on DeepSWE v1.1: 66.6 % (v1.1; max effort; provider-reported).
  • Below the median of the compared models on Terminal-Bench 4.0: 16.4 % (max effort; Codex harness).

#8 GPT-6 Sol

GPT-6 Sol (OpenAI): 68.8 % on DeepSWE v1.1, 49.4 % on Terminal-Bench 4.0, at $4.00 per 1M tokens blended.

Pros

  • Terminal-Bench 4.0: 49.4 % (max effort; Codex harness).
  • Context window of 1,050,000 tokens.

Cons

  • Below the median of the compared models on DeepSWE v1.1: 68.8 % (v1.1; max effort; provider-reported).
  • Higher list price: $4.00 per 1M tokens (blended 3:1 input:output).

#9 GPT-6 Astra

GPT-6 Astra (OpenAI): 74 % on DeepSWE v1.1, 58.2 % on Terminal-Bench 4.0, at $20.00 per 1M tokens blended.

Pros

  • DeepSWE v1.1: 74 % (v1.1; xhigh effort; mini-swe-agent).
  • Terminal-Bench 4.0: 58.2 % (max effort; Codex harness).
  • Context window of 1,050,000 tokens.

Cons

  • Higher list price: $20.00 per 1M tokens (blended 3:1 input:output).

#10 Gemini 3.8 Flash

Gemini 3.8 Flash (Google): 74 % on DeepSWE v1.1, 19.1 % on Terminal-Bench 4.0, at $1.50 per 1M tokens blended.

Pros

  • DeepSWE v1.1: 74 % (v1.1; high effort; mini-swe-agent harness).
  • Lower list price: $1.50 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • Below the median of the compared models on Terminal-Bench 4.0: 19.1 % (high effort; mini-SWE-agent harness).

#11 Muse Spark 1.3

Muse Spark 1.3 (Meta): 75.4 % on DeepSWE v1.1, 14.5 % on Terminal-Bench 4.0, at $2.00 per 1M tokens blended.

Pros

  • DeepSWE v1.1: 75.4 % (v1.1 (113 tasks), task pass rate; max effort; mini-swe-agent (run by Meta); provider-reported).
  • Lower list price: $2.00 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • The DeepSWE v1.1 result is provider-reported; no independent run in a comparable setting is recorded.
  • Below the median of the compared models on Terminal-Bench 4.0: 14.5 % (Terminal-Bench 4.0; xhigh effort; Muse Code harness).

#12 Grok 4.7

Grok 4.7 (xAI): 71 % on DeepSWE v1.1, 37.6 % on Terminal-Bench 4.0, at $3.00 per 1M tokens blended.

Pros

  • DeepSWE v1.1: 71 % (v1.1; high effort; mini-SWE-agent harness; provider-reported).
  • Lower list price: $3.00 per 1M tokens (blended 3:1 input:output).

Cons

  • The DeepSWE v1.1 result is provider-reported; no independent run in a comparable setting is recorded.
  • Below the median of the compared models on Terminal-Bench 4.0: 37.6 % (xhigh effort; Grok Build harness).

#13 Claude Fable 5.1

Claude Fable 5.1 (Anthropic): 67.4 % on DeepSWE v1.1, 57.9 % on Terminal-Bench 4.0, at $20.00 per 1M tokens blended.

Pros

  • Terminal-Bench 4.0: 57.9 % (max effort; Claude Code harness).
  • Context window of 1,000,000 tokens.

Cons

  • Below the median of the compared models on DeepSWE v1.1: 67.4 % (v1.1; max effort; scaffold not stated; mean of 5 trials; provider-reported).
  • Higher list price: $20.00 per 1M tokens (blended 3:1 input:output).

#14 Muse Spark 1.2

Muse Spark 1.2 (Meta): 55 % on DeepSWE v1.1, at $2.00 per 1M tokens blended.

Pros

  • Lower list price: $2.00 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • Below the median of the compared models on DeepSWE v1.1: 55 % (v1.1 (113 tasks), pass@1; xhigh effort; mini-swe-agent (official leaderboard harness)).
  • No comparable Terminal-Bench 4.0 result yet.

#15 Muse Spark 1.1

Muse Spark 1.1 (Meta): 53 % on DeepSWE v1.1, at $2.00 per 1M tokens blended.

Pros

  • Lower list price: $2.00 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • Below the median of the compared models on DeepSWE v1.1: 53 % (v1.1 (113 tasks), pass@1; xhigh effort; mini-swe-agent (official leaderboard harness)).
  • No comparable Terminal-Bench 4.0 result yet.

#16 Gemini 3.6 Flash

Gemini 3.6 Flash (Google): 47 % on DeepSWE v1.1, at $1.50 per 1M tokens blended.

Pros

  • Lower list price: $1.50 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • Below the median of the compared models on DeepSWE v1.1: 47 % (v1.1; high effort; mini-swe-agent harness).
  • No comparable Terminal-Bench 4.0 result yet.

#17 Qwen3.8-Max

Qwen3.8-Max (Alibaba Cloud (Qwen)): 57 % on DeepSWE v1.1, 27 % on Terminal-Bench 4.0, at $3.00 per 1M tokens blended.

Pros

  • Lower list price: $3.00 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,000,000 tokens.

Cons

  • Below the median of the compared models on DeepSWE v1.1: 57 % (v1.1 (113 tasks); xhigh effort; mini-swe-agent).
  • Below the median of the compared models on Terminal-Bench 4.0: 27 % (snapshot qwen3.8-max-0902; max effort; Claude Code harness).

#18 Grok 4.6

Grok 4.6 (xAI): 67 % on DeepSWE v1.1, 20.3 % on Terminal-Bench 4.0, at $3.00 per 1M tokens blended.

Pros

  • Lower list price: $3.00 per 1M tokens (blended 3:1 input:output).

Cons

  • Below the median of the compared models on DeepSWE v1.1: 67 % (v1.1; medium effort; mini-swe-agent).
  • Below the median of the compared models on Terminal-Bench 4.0: 20.3 % (high effort; Grok Build harness).

#19 Grok 4.5

Grok 4.5 (xAI): 54 % on DeepSWE v1.1, 12.4 % on Terminal-Bench 4.0, at $3.00 per 1M tokens blended.

Pros

  • Lower list price: $3.00 per 1M tokens (blended 3:1 input:output).

Cons

  • Below the median of the compared models on DeepSWE v1.1: 54 % (v1.1; high effort; mini-swe-agent).
  • Below the median of the compared models on Terminal-Bench 4.0: 12.4 % (high effort; Grok Build harness).

#20 Gemini 3.1 Pro

Gemini 3.1 Pro (Google): 12 % on DeepSWE v1.1, at $4.50 per 1M tokens blended.

Pros

  • Context window of 1,048,576 tokens.

Cons

  • Below the median of the compared models on DeepSWE v1.1: 12 % (v1.1; high effort; mini-swe-agent harness).
  • No comparable Terminal-Bench 4.0 result yet.
  • Higher list price: $4.50 per 1M tokens (blended 3:1 input:output).

Methodology

CriterionMeasuresWeightScaleBetterWhy it matters
DeepSWE v1.1 (software engineering) Benchmark score, best result in one of these comparable settings (independent results preferred): "Resolved, N=8 samples per task; max effort; mini-SWE harness (mini-swe-agent)"; "snapshot DeepSeek-V4.1-Flash-1017; v1.1; effort not stated; Mini-SWE-V2 harness"; "v1.1 (113 tasks), pass@1; max effort; result Meta attributes to Datacurve, harness not stated (not on the public Datacurve board as of 2026-10-25)"; "v1.1 (113 tasks), pass@1; xhigh effort; mini-swe-agent (official leaderboard harness)"; "v1.1 (113 tasks), task pass rate; max effort; mini-swe-agent (run by Meta)"; "v1.1 (113 tasks); xhigh effort; mini-swe-agent"; "v1.1; high effort"; "v1.1; high effort; mini-SWE-agent harness"; "v1.1; high effort; mini-swe-agent"; "v1.1; high effort; mini-swe-agent harness"; "v1.1; high effort; mini-swe-agent harness run by Datacurve"; "v1.1; low effort"; "v1.1; low effort; mini-swe-agent"; "v1.1; max effort"; "v1.1; max effort; mini-swe-agent"; "v1.1; max effort; scaffold not stated; mean of 5 trials"; "v1.1; medium effort"; "v1.1; medium effort; mini-swe-agent"; "v1.1; medium effort; mini-swe-agent harness"; "v1.1; xhigh effort"; "v1.1; xhigh effort; mini-swe-agent"; "v1.1; xhigh effort; mini-swe-agent harness" 45 % linear higher Long-horizon software engineering tasks across 91 repositories, written from scratch to limit contamination. Runs on the official mini-swe-agent harness or an unstated harness count at any reasoning effort; provider-specific coding agents do not.
Terminal-Bench 4.0 (command-line agents) Benchmark score, best result in one of these comparable settings (independent results preferred): "Pass@1; max effort (reasoning_effort=100); DeepSeek Harness (Minimal mode), 1M-token context"; "Pass@1; max effort; harness not stated"; "Terminal-Bench 4.0; max effort; result sourced by Meta from Artificial Analysis (Artificial Analysis harness)"; "Terminal-Bench 4.0; xhigh effort; Muse Code harness"; "high effort"; "high effort; Claude Code harness"; "high effort; Codex harness"; "high effort; Grok Build harness"; "high effort; harness not stated (self-computed by Google)"; "high effort; mini-SWE-agent harness"; "low effort"; "low effort; Claude Code harness"; "low effort; Codex harness"; "max effort"; "max effort; Claude Code (--bare), 10 trials/task"; "max effort; Claude Code (--bare), 15 trials/task"; "max effort; Claude Code (--bare), 5 trials/task"; "max effort; Claude Code harness"; "max effort; Codex harness"; "medium effort"; "medium effort; Claude Code harness"; "medium effort; Codex harness"; "snapshot DeepSeek-V4.1-Flash-1017; effort not stated; Claude Code harness"; "snapshot qwen3.8-max-0902; max effort; Claude Code harness"; "xhigh effort"; "xhigh effort; Claude Code (--bare), 5 trials/task"; "xhigh effort; Claude Code harness"; "xhigh effort; Codex harness"; "xhigh effort; Grok Build harness" 20 % linear higher Measures agentic work in a real command-line environment (builds, debugging, tooling). The benchmark always pairs a model with an agent harness, so every Terminal-Bench 4.0 run counts and a model is rated by its best one.
Blended price per 1M tokens (3:1) Blended token price (input:output 3:1), in USD 25 % logarithmic lower Coding agents consume many input tokens across long sessions, so cost per token matters. A log scale keeps a few very expensive models from flattening the differences among the rest.
Context window Context window 5 % logarithmic higher A larger window lets the model see more of a codebase at once. It gets a low weight because most current flagship models already document 500K to about 1M tokens.
Tool calling Capability: tool calling (yes 1, partial 0.5, no 0; unknown = no data) 5 % linear higher Coding agents rely on tool calls to read and edit files and run commands. It gets a low weight because nearly all current text models support it.
  • Logarithmic criteria use log10(1 + value) before normalization, so a few very large values do not flatten the rest.
  • Values are normalized min–max to 0–100 across candidates with data (inverted where lower is better).
  • Score = Σ weight × normalized value / Σ weight of the criteria with data. Models with data for less than 60 % of the weights are not ranked.
  • Ties are broken by coverage, then alphabetically. There is no manual position override; badges such as "Best value" are separate editorial labels.
  • Only models available through an API or released with downloadable weights (open weights or open source) are ranked; models that can only be used inside an app or a subscription are left out.

Data sources of the ranking

  1. qwen3.8-max Model Info - Alibaba Cloud Model Studio
  2. Pricing - Claude Platform Docs
  3. Models & Pricing | DeepSeek API Docs
  4. Gemini Developer API pricing
  5. Pricing and rate limits - Meta Model API
  6. Muse Spark 1.3 model page
  7. Pricing | OpenAI API
  8. API Pricing
  9. Model Card: Grok 4.7 (Revision 2026-09-21)
  10. DeepSWE leaderboard (Datacurve)
  11. Terminal-Bench 4.0 leaderboard (Harbor Hub)
  12. Claude Opus 5.5 System Card (Anthropic, 2026-09-22)
  13. Claude Sonnet 5.5 System Card (Anthropic, 2026-09-28)
  14. Claude Fable 5.1 & Claude Mythos 5.1 System Card (Anthropic, 2026-09-01)
  15. Terminal-Bench 4.0 leaderboard (tbench.ai)
  16. Introducing GPT-6 Sol and Luna | OpenAI
  17. Introducing GPT-6.1 Sol | OpenAI
  18. deepseek-ai/DeepSeek-V4.1-Flash-1017 model card (Hugging Face)
  19. Gemini 4 Argon model card - Google DeepMind
  20. Muse Wonder Model Card (PDF)

Other rankings

Sources

  1. DeepSWE v1.1
  2. Terminal-Bench 4.0
  3. Introducing Mistral Large 4 | Mistral
  4. Terminal-Bench 4.0 leaderboard (tbench.ai)
  5. DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression (DeepSeek-AI, arXiv 2609.19969, submitted 2026-09-17)
  6. GPT-6 Astra: A new generation of intelligence | OpenAI
  7. Claude Sonnet 5.5 System Card (Anthropic, 2026-09-28)
  8. DeepSWE leaderboard (Datacurve)