Skip to content
Best AI Ever

Best AI by use case

Best AI for business

Our business ranking weighs GDPval-AA knowledge-work results and AutomationBench workflow results against token price and tool calling. This page explains the criteria, which runs count as comparable and how to read the scores.

By Updated Ranking as of 2026-10-26Methodology v3

The ranking

As of , DeepSeek-V4.1-Flash leads our business ranking of 39 models, ahead of Claude Sonnet 5.5 and Gemini 4 Argon.

Rank Model Score GDPval-AA v2.1 (knowledge work) 40 %AutomationBench v1.0.6 (workflow automation) 25 %Blended price per 1M tokens (3:1) 25 %Tool calling 10 % Coverage
#1 DeepSeek-V4.1-FlashDeepSeek 86.1 1,74693/100snapshot DeepSeek-V4.1-Flash-1017; max effort; Stirrup agent loop (shell + web browsing) No data $0.525 per 1M tokens (blended 3:1)69/100 Yes100/100 75 %
#2 Claude Sonnet 5.5Anthropic 78.8 1,83898/100max effort; Default Fallback 44.7587/100v1.0.6; default fallbacks; max effort $4.00 per 1M tokens (blended 3:1)30/100 Yes100/100 100 %
#3 Gemini 4 ArgonGoogle 77.3 1,62487/100v2.1; high effort; Artificial Analysis Stirrup agent harness 51.29100/100v1.0.6; high effort $4.00 per 1M tokens (blended 3:1)30/100 Yes100/100 100 %
#4 Claude Opus 5.5Anthropic 75.0 1,866100/100max effort; Default Fallback 42.4783/100v1.0.6; default fallbacks; max effort $8.00 per 1M tokens (blended 3:1)17/100 Yes100/100 100 %
#5 Grok 4.7xAI 74.2 1,71492/100v2.1; xhigh effort No data $3.00 per 1M tokens (blended 3:1)36/100 Yes100/100 75 %
#6 Qwen3.8-MaxAlibaba Cloud (Qwen) 72.8 1,66689/100snapshot 'Qwen3.8 Max (0902)'; effort not shown; Stirrup agent harness No data $3.00 per 1M tokens (blended 3:1)36/100 Yes100/100 75 %
#7 GPT-6 LunaOpenAI 72.4 1,43376/100max effort 20.740/100v1.0.6; max effort $0.20 per 1M tokens (blended 3:1)87/100 Yes100/100 100 %
#8 Grok 4.6xAI 72.2 1,64788/100v2.1; xhigh effort No data $3.00 per 1M tokens (blended 3:1)36/100 Yes100/100 75 %
#9 Claude Haiku 5.5Anthropic 72.1 1,61887/100max effort 12.0223/100v1.0.6; default fallbacks; max effort $0.20 per 1M tokens (blended 3:1)87/100 Yes100/100 100 %
#10 Qwen3.8-27BAlibaba Cloud (Qwen) 71.8 1,41976/100xhigh effort; Stirrup agent harness No data $1.125 per 1M tokens (blended 3:1)54/100 Yes100/100 75 %
#11 Qwen3.8-2.4T-A95BAlibaba Cloud (Qwen) 71.1 1,60786/100'Qwen3.8 2.4T A95B'; effort not shown; Stirrup agent harness No data $3.00 per 1M tokens (blended 3:1)36/100 Yes100/100 75 %
#12 Muse Spark 1.2Meta 69.8 1,47579/100v2.1; xhigh effort; Artificial Analysis Stirrup harness No data $2.00 per 1M tokens (blended 3:1)43/100 Yes100/100 75 %
#13 Muse WonderMeta 69.6 1,77095/100v2.1; max effort; Artificial Analysis Stirrup harness No data $8.00 per 1M tokens (blended 3:1)17/100 Yes100/100 75 %
#14 GPT-6.1 SolOpenAI 69.3 1,59685/100max effort 36.170/100v1.0.6; max effortself-reported $4.00 per 1M tokens (blended 3:1)30/100 Yes100/100 100 %
#15 DeepSeek-V4-ProDeepSeek 69.1 1,44977/100max effort; Stirrup agent loop (shell + web browsing) No data $1.98 per 1M tokens (blended 3:1)44/100 Yes100/100 75 %
#16 Mistral Large 4Mistral AI 68.1 1,42276/100v2.1, 'Mistral Large 4 Preview'; effort not stated; Stirrup harness (shell + web browsing) No data $2.065 per 1M tokens (blended 3:1)43/100 Yes100/100 75 %
#17 Gemini 3.8 FlashGoogle 67.3 1,43677/100v2.1; high effort; Artificial Analysis Stirrup agent harness 29.6858/100v1.0.6; high effort $1.50 per 1M tokens (blended 3:1)49/100 Yes100/100 100 %
#18 Muse Spark 1.3Meta 66.9 1,68190/100v2.1; max effort; Artificial Analysis Stirrup harness 20.740/100v1.0.6 (official held-out private task set); max effort $2.00 per 1M tokens (blended 3:1)43/100 Yes100/100 100 %
#19 GPT-6 SolOpenAI 66.0 1,50981/100max effort 33.265/100v1.0.6; xhigh effort $4.00 per 1M tokens (blended 3:1)30/100 Yes100/100 100 %
#20 Grok 4.5xAI 64.5 1,38174/100v2.1; high effort No data $3.00 per 1M tokens (blended 3:1)36/100 Yes100/100 75 %
#21 GPT-6 AstraOpenAI 63.8 1,57484/100max effort 41.481/100v1.0.6; max effort $20.00 per 1M tokens (blended 3:1)0/100 Yes100/100 100 %
#22 Claude Fable 5.1Anthropic 62.9 1,75694/100max effort; Default Fallback 31.461/100v1.0.6; with Opus 5 fallback $20.00 per 1M tokens (blended 3:1)0/100 Yes100/100 100 %
#23 Muse Spark 1.1Meta 62.1 1,21164/100v2.1; xhigh effort; Artificial Analysis Stirrup harness No data $2.00 per 1M tokens (blended 3:1)43/100 Yes100/100 75 %
#24 Gemini 3.6 FlashGoogle 57.9 1,28668/100v2.1; high effort; Artificial Analysis Stirrup agent harness 17.0533/100v1.0.6; high effort $1.50 per 1M tokens (blended 3:1)49/100 Yes100/100 100 %
#25 Grok 4.3xAI 55.9 94150/100v2.1; non-reasoning No data $1.5625 per 1M tokens (blended 3:1)48/100 Yes100/100 75 %
#26 Mistral Small 4Mistral AI 50.3 36218/100v2.1, 'Mistral Small 4 (Reasoning)'; reasoning on, effort level not stated; Stirrup harness (shell + web browsing) No data $0.2625 per 1M tokens (blended 3:1)82/100 Yes100/100 75 %
#27 Ministral 3 8BMistral AI 49.5 21310/100v2.1; no effort label; Stirrup harness (shell + web browsing) No data $0.15 per 1M tokens (blended 3:1)92/100 Yes100/100 75 %
#28 Ministral 3 14BMistral AI 48.6 24712/100v2.1; no effort label; Stirrup harness (shell + web browsing) No data $0.20 per 1M tokens (blended 3:1)87/100 Yes100/100 75 %
#29 Gemini 3.5 Flash-LiteGoogle 47.6 98552/100v2.1; effort not shown; Artificial Analysis Stirrup agent harness 3.967/100v1.0.6; medium effort $0.85 per 1M tokens (blended 3:1)60/100 Yes100/100 100 %
#30 Gemini 3.1 Flash-LiteGoogle 47.4 43022/100v2.1; effort not shown; Artificial Analysis Stirrup agent harness No data $0.5625 per 1M tokens (blended 3:1)67/100 Yes100/100 75 %
#31 Ministral 3 3BMistral AI 46.7 290/100v2.1; no effort label; Stirrup harness (shell + web browsing) No data $0.10 per 1M tokens (blended 3:1)100/100 Yes100/100 75 %
#32 Mistral Medium 3.5Mistral AI 46.5 76140/100v2.1; effort not stated; Stirrup harness (shell + web browsing) No data $3.00 per 1M tokens (blended 3:1)36/100 Yes100/100 75 %
#33 Claude Sonnet 4.5Anthropic 46.5 90948/100Reasoning No data $6.00 per 1M tokens (blended 3:1)23/100 Yes100/100 75 %
#34 Mistral Large 3Mistral AI 45.3 42021/100v2.1; no effort label; Stirrup harness (shell + web browsing) No data $0.75 per 1M tokens (blended 3:1)62/100 Yes100/100 75 %
#35 Qwen3.7-PlusAlibaba Cloud (Qwen) 43.6 76740/100'Qwen3.7 Plus'; effort not shown; Stirrup agent harness 3.77/100v1.0.6; effort not shown $0.70 per 1M tokens (blended 3:1)63/100 Yes100/100 100 %
#36 Amazon Nova 2 LiteAmazon 43.0 36618/100v2.1; high effort; Stirrup agent harness (shell + web browsing) No data $0.85 per 1M tokens (blended 3:1)60/100 Yes100/100 75 %
#37 Gemini 3.1 ProGoogle 37.8 79141/100v2.1; effort not shown; Artificial Analysis Stirrup agent harness 8.6817/100v1.0.6; high effort $4.50 per 1M tokens (blended 3:1)28/100 Yes100/100 100 %
#38 Gemma 4 31BGoogle 31.5 61932/100v2.1; reasoning; Artificial Analysis Stirrup agent harness 1.73/100v1.0.6; max effort No data Yes100/100 75 %
#39 gpt-oss-120bOpenAI 30.1 60832/100high effort 0.150/100v1.0.6; high effort No data Yes100/100 75 %

Each criterion is normalized to 0–100 across the ranked candidates; the score is the weighted average over the criteria with data. Missing data is never counted as zero.

"Business work" covers drafting reports and slides, working through spreadsheets, answering customer requests and running multi-step workflows across tools such as a CRM, a help desk and a finance system.

In short

  • This ranking compares language models for business work. Business benchmarks carry 65% of the weight: GDPval-AA v2.1 counts 40% and AutomationBench v1.0.6 counts 25%.
  • The blended price per million tokens (three input tokens per output token) counts 25%, and tool calling 10%.
  • Benchmarks don't cover data protection, contract terms or where your data is processed. Use the ranking to build a shortlist, then check those points and test on your own tasks.

Who this page is for

This page is meant for teams choosing a model for business work, whether in a chat app or through an API: knowledge work that ends in a document, slide deck or spreadsheet, and automated workflows that move data between business apps.

In the app or via API? This ranking scores the models behind both, but its price criterion is the API price per token. If your team works in a chat app instead, see the AI subscriptions scored for work, which compares consumer plans per price tier on model quality, usage, price and work features.

How this ranking works

The ranking combines four criteria into one score. The weights are fixed and add up to 100%. Our methodology explains how each criterion is scaled and combined.

  • GDPval-AA v2.1, 40%. Artificial Analysis rates models on 220 knowledge-work tasks across 44 occupations that need documents, slides, diagrams or spreadsheets as output. Models work in an agentic loop with shell access and web browsing, and an LLM judge compares outputs in pairs to produce Elo ratings [1]. It is the closest match to everyday office deliverables, so it gets the largest weight. Higher is better.
  • AutomationBench v1.0.6, 25%. Zapier tests agents on end-to-end workflows in sales, marketing, operations, support, finance and HR, using simulated business apps. Scoring is deterministic and checks only the final state, with no LLM judge [2] [3]. Higher is better.
  • Blended price, 25%. Business workloads often run at volume, so the list price per token matters. Lower is better, on a log scale, so that a few very expensive models don't flatten the differences among the rest.
  • Tool calling, 10%. Business automation depends on calling tools and APIs. Most models in our catalog support it.

Which benchmark results count

Both benchmarks list the same model several times, for example at different reasoning efforts or with a fallback model. For this ranking each benchmark criterion uses a setting group, a list of stored settings we treat as comparable:

  • GDPval-AA: all v2.1 runs count, at any reasoning effort and including non-reasoning runs. This covers the Stirrup agent harness that Artificial Analysis uses, and the Anthropic runs with "Default Fallback", where refused steps go to a fallback model [1].
  • AutomationBench: all v1.0.6 leaderboard runs count, at any reasoning effort, including runs where refused tasks go to a fallback model [2].

Within each group, a model counts with its best run. Independent results are preferred over results a provider reports itself; if only a provider result exists, it is used and marked "self-reported". The methodology box on this page lists every stored setting in each group.

A model needs data for at least 60% of the total weight to be ranked. Price and tool calling together make up 35%, so a model needs a result on at least one of the two benchmarks.

OSWorld 2.0, which tests computer-use agents on long, multi-step desktop workflows [4] [5], is not part of the ranking. Its results are only comparable when the release, task set, metric, step budget and agent approach all match, and most current numbers are reported by the providers themselves [4]. You can still see them below.

How to read the results

  • Scores are relative. Each criterion is rescaled from 0 to 100 across the candidates on this page. 100 means best among these models, not perfect, and adding or removing a model can shift the others.
  • Check the setting. The table shows the setting behind each score, such as the reasoning effort or a fallback run.
  • "Self-reported" marks a result that comes from the model's own provider rather than from Artificial Analysis or Zapier.
  • Small gaps are noise. Elo ratings such as GDPval-AA's move when models are added [1]. Treat models close in score as roughly equal.

Limitations

  • Grouped runs differ in reasoning effort, and some include a fallback model. A fallback run partly reflects the fallback model, not only the model being ranked.
  • Because each model counts with its best run, a model tested at many effort levels has more chances to score well than one tested once.
  • Benchmark numbers change. Leaderboard versions are not comparable with each other, so we only use GDPval-AA v2.1 and AutomationBench v1.0.6 [1] [2].
  • Some results in our data are reported by the providers themselves; the tables label them "Self-reported".
  • Only models with a result in at least one of the two groups can be ranked. A missing result doesn't mean a model is weak, only that we have no comparable measurement.
  • None of these benchmarks covers data protection, contract terms or where your data is processed, which often decide business purchases.
  • The data behind this page is as of October 2026.

All published results

The benchmark pages list every result we hold, with its setting and who reported it: GDPval-AA v2.1, AutomationBench and OSWorld 2.0.

How to choose for your own work

The ranking narrows the field; your own requirements decide.

  • Look at the criteria, not only the total. A model strong on GDPval-AA suits document and analysis work; a model strong on AutomationBench suits workflows across apps. The table shows both.
  • Check prices. Business workloads often run at high volume, so cost matters. Use AI pricing and the cost calculator with your own token counts.
  • Compare a shortlist. Put two to four candidates side by side in compare and check context window, tool support and price together.
  • Test on your own tasks. A few dozen real requests from your team say more about fit than any single benchmark. How to compare AI models explains how to set up a fair test.

Model by model

#1 DeepSeek-V4.1-Flash

DeepSeek-V4.1-Flash (DeepSeek): 1,746 on GDPval-AA v2.1, at $0.52 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,746 (snapshot DeepSeek-V4.1-Flash-1017; max effort; Stirrup agent loop (shell + web browsing)).
  • Lower list price: $0.52 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • No comparable AutomationBench result yet.

#2 Claude Sonnet 5.5

Claude Sonnet 5.5 (Anthropic): 1,838 on GDPval-AA v2.1, 44.8 % on AutomationBench, at $4.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,838 (max effort; Default Fallback).
  • AutomationBench: 44.8 % (v1.0.6; default fallbacks; max effort).
  • Context window of 1,000,000 tokens.

Cons

  • Higher list price: $4.00 per 1M tokens (blended 3:1 input:output).

#3 Gemini 4 Argon

Gemini 4 Argon (Google): 1,624 on GDPval-AA v2.1, 51.3 % on AutomationBench, at $4.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,624 (v2.1; high effort; Artificial Analysis Stirrup agent harness).
  • AutomationBench: 51.3 % (v1.0.6; high effort).
  • Context window of 1,048,576 tokens.

Cons

  • Higher list price: $4.00 per 1M tokens (blended 3:1 input:output).

#4 Claude Opus 5.5

Claude Opus 5.5 (Anthropic): 1,866 on GDPval-AA v2.1, 42.5 % on AutomationBench, at $8.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,866 (max effort; Default Fallback).
  • AutomationBench: 42.5 % (v1.0.6; default fallbacks; max effort).
  • Context window of 1,000,000 tokens.

Cons

  • Higher list price: $8.00 per 1M tokens (blended 3:1 input:output).

#5 Grok 4.7

Grok 4.7 (xAI): 1,714 on GDPval-AA v2.1, at $3.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,714 (v2.1; xhigh effort).

Cons

  • No comparable AutomationBench result yet.
  • Higher list price: $3.00 per 1M tokens (blended 3:1 input:output).

#6 Qwen3.8-Max

Qwen3.8-Max (Alibaba Cloud (Qwen)): 1,666 on GDPval-AA v2.1, at $3.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,666 (snapshot 'Qwen3.8 Max (0902)'; effort not shown; Stirrup agent harness).
  • Context window of 1,000,000 tokens.

Cons

  • No comparable AutomationBench result yet.
  • Higher list price: $3.00 per 1M tokens (blended 3:1 input:output).

#7 GPT-6 Luna

GPT-6 Luna (OpenAI): 1,433 on GDPval-AA v2.1, 20.7 % on AutomationBench, at $0.20 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,433 (max effort).
  • AutomationBench: 20.7 % (v1.0.6; max effort).
  • Lower list price: $0.20 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,050,000 tokens.

Cons

  • No weakness stands out in the data this ranking uses.

#8 Grok 4.6

Grok 4.6 (xAI): 1,647 on GDPval-AA v2.1, at $3.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,647 (v2.1; xhigh effort).

Cons

  • No comparable AutomationBench result yet.
  • Higher list price: $3.00 per 1M tokens (blended 3:1 input:output).

#9 Claude Haiku 5.5

Claude Haiku 5.5 (Anthropic): 1,618 on GDPval-AA v2.1, 12 % on AutomationBench, at $0.20 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,618 (max effort).
  • Lower list price: $0.20 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,000,000 tokens.

Cons

  • Below the median of the compared models on AutomationBench: 12 % (v1.0.6; default fallbacks; max effort).

#10 Qwen3.8-27B

Qwen3.8-27B (Alibaba Cloud (Qwen)): 1,419 on GDPval-AA v2.1, at $1.12 per 1M tokens blended.

Pros

  • Lower list price: $1.12 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,000,000 tokens.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 1,419 (xhigh effort; Stirrup agent harness).
  • No comparable AutomationBench result yet.

#11 Qwen3.8-2.4T-A95B

Qwen3.8-2.4T-A95B (Alibaba Cloud (Qwen)): 1,607 on GDPval-AA v2.1, at $3.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,607 ('Qwen3.8 2.4T A95B'; effort not shown; Stirrup agent harness).
  • Context window of 1,000,000 tokens.

Cons

  • No comparable AutomationBench result yet.
  • Higher list price: $3.00 per 1M tokens (blended 3:1 input:output).

#12 Muse Spark 1.2

Muse Spark 1.2 (Meta): 1,475 on GDPval-AA v2.1, at $2.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,475 (v2.1; xhigh effort; Artificial Analysis Stirrup harness).
  • Lower list price: $2.00 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • No comparable AutomationBench result yet.

#13 Muse Wonder

Muse Wonder (Meta): 1,770 on GDPval-AA v2.1, at $8.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,770 (v2.1; max effort; Artificial Analysis Stirrup harness).
  • Context window of 1,048,576 tokens.

Cons

  • No comparable AutomationBench result yet.
  • Higher list price: $8.00 per 1M tokens (blended 3:1 input:output).

#14 GPT-6.1 Sol

GPT-6.1 Sol (OpenAI): 1,596 on GDPval-AA v2.1, 36.1 % on AutomationBench, at $4.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,596 (max effort).
  • AutomationBench: 36.1 % (v1.0.6; max effort; provider-reported).
  • Context window of 1,050,000 tokens.

Cons

  • The AutomationBench result is provider-reported; no independent run in a comparable setting is recorded.
  • Higher list price: $4.00 per 1M tokens (blended 3:1 input:output).

#15 DeepSeek-V4-Pro

DeepSeek-V4-Pro (DeepSeek): 1,449 on GDPval-AA v2.1, at $1.98 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,449 (max effort; Stirrup agent loop (shell + web browsing)).
  • Lower list price: $1.98 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • No comparable AutomationBench result yet.

#16 Mistral Large 4

Mistral Large 4 (Mistral AI): 1,422 on GDPval-AA v2.1, at $2.06 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,422 (v2.1, 'Mistral Large 4 Preview'; effort not stated; Stirrup harness (shell + web browsing)).
  • Context window of 1,000,000 tokens.

Cons

  • No comparable AutomationBench result yet.
  • Higher list price: $2.06 per 1M tokens (blended 3:1 input:output).

#17 Gemini 3.8 Flash

Gemini 3.8 Flash (Google): 1,436 on GDPval-AA v2.1, 29.7 % on AutomationBench, at $1.50 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,436 (v2.1; high effort; Artificial Analysis Stirrup agent harness).
  • AutomationBench: 29.7 % (v1.0.6; high effort).
  • Lower list price: $1.50 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • No weakness stands out in the data this ranking uses.

#18 Muse Spark 1.3

Muse Spark 1.3 (Meta): 1,681 on GDPval-AA v2.1, 20.7 % on AutomationBench, at $2.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,681 (v2.1; max effort; Artificial Analysis Stirrup harness).
  • AutomationBench: 20.7 % (v1.0.6 (official held-out private task set); max effort).
  • Lower list price: $2.00 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • No weakness stands out in the data this ranking uses.

#19 GPT-6 Sol

GPT-6 Sol (OpenAI): 1,509 on GDPval-AA v2.1, 33.2 % on AutomationBench, at $4.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,509 (max effort).
  • AutomationBench: 33.2 % (v1.0.6; xhigh effort).
  • Context window of 1,050,000 tokens.

Cons

  • Higher list price: $4.00 per 1M tokens (blended 3:1 input:output).

#20 Grok 4.5

Grok 4.5 (xAI): 1,381 on GDPval-AA v2.1, at $3.00 per 1M tokens blended.

Pros

  • Has results in the comparable settings this ranking uses.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 1,381 (v2.1; high effort).
  • No comparable AutomationBench result yet.
  • Higher list price: $3.00 per 1M tokens (blended 3:1 input:output).

#21 GPT-6 Astra

GPT-6 Astra (OpenAI): 1,574 on GDPval-AA v2.1, 41.4 % on AutomationBench, at $20.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,574 (max effort).
  • AutomationBench: 41.4 % (v1.0.6; max effort).
  • Context window of 1,050,000 tokens.

Cons

  • Higher list price: $20.00 per 1M tokens (blended 3:1 input:output).

#22 Claude Fable 5.1

Claude Fable 5.1 (Anthropic): 1,756 on GDPval-AA v2.1, 31.4 % on AutomationBench, at $20.00 per 1M tokens blended.

Pros

  • GDPval-AA v2.1: 1,756 (max effort; Default Fallback).
  • AutomationBench: 31.4 % (v1.0.6; with Opus 5 fallback).
  • Context window of 1,000,000 tokens.

Cons

  • Higher list price: $20.00 per 1M tokens (blended 3:1 input:output).

#23 Muse Spark 1.1

Muse Spark 1.1 (Meta): 1,211 on GDPval-AA v2.1, at $2.00 per 1M tokens blended.

Pros

  • Lower list price: $2.00 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 1,211 (v2.1; xhigh effort; Artificial Analysis Stirrup harness).
  • No comparable AutomationBench result yet.

#24 Gemini 3.6 Flash

Gemini 3.6 Flash (Google): 1,286 on GDPval-AA v2.1, 17.1 % on AutomationBench, at $1.50 per 1M tokens blended.

Pros

  • Lower list price: $1.50 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 1,286 (v2.1; high effort; Artificial Analysis Stirrup agent harness).
  • Below the median of the compared models on AutomationBench: 17.1 % (v1.0.6; high effort).

#25 Grok 4.3

Grok 4.3 (xAI): 941 on GDPval-AA v2.1, at $1.56 per 1M tokens blended.

Pros

  • Lower list price: $1.56 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,000,000 tokens.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 941 (v2.1; non-reasoning).
  • No comparable AutomationBench result yet.

#26 Mistral Small 4

Mistral Small 4 (Mistral AI): 362 on GDPval-AA v2.1, at $0.26 per 1M tokens blended.

Pros

  • Lower list price: $0.26 per 1M tokens (blended 3:1 input:output).

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 362 (v2.1, 'Mistral Small 4 (Reasoning)'; reasoning on, effort level not stated; Stirrup harness (shell + web browsing)).
  • No comparable AutomationBench result yet.

#27 Ministral 3 8B

Ministral 3 8B (Mistral AI): 213 on GDPval-AA v2.1, at $0.15 per 1M tokens blended.

Pros

  • Lower list price: $0.15 per 1M tokens (blended 3:1 input:output).

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 213 (v2.1; no effort label; Stirrup harness (shell + web browsing)).
  • No comparable AutomationBench result yet.

#28 Ministral 3 14B

Ministral 3 14B (Mistral AI): 247 on GDPval-AA v2.1, at $0.20 per 1M tokens blended.

Pros

  • Lower list price: $0.20 per 1M tokens (blended 3:1 input:output).

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 247 (v2.1; no effort label; Stirrup harness (shell + web browsing)).
  • No comparable AutomationBench result yet.

#29 Gemini 3.5 Flash-Lite

Gemini 3.5 Flash-Lite (Google): 985 on GDPval-AA v2.1, 4 % on AutomationBench, at $0.85 per 1M tokens blended.

Pros

  • Lower list price: $0.85 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 985 (v2.1; effort not shown; Artificial Analysis Stirrup agent harness).
  • Below the median of the compared models on AutomationBench: 4 % (v1.0.6; medium effort).

#30 Gemini 3.1 Flash-Lite

Gemini 3.1 Flash-Lite (Google): 430 on GDPval-AA v2.1, at $0.56 per 1M tokens blended.

Pros

  • Lower list price: $0.56 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,048,576 tokens.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 430 (v2.1; effort not shown; Artificial Analysis Stirrup agent harness).
  • No comparable AutomationBench result yet.

#31 Ministral 3 3B

Ministral 3 3B (Mistral AI): 29.0 on GDPval-AA v2.1, at $0.10 per 1M tokens blended.

Pros

  • Lower list price: $0.10 per 1M tokens (blended 3:1 input:output).

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 29.0 (v2.1; no effort label; Stirrup harness (shell + web browsing)).
  • No comparable AutomationBench result yet.

#32 Mistral Medium 3.5

Mistral Medium 3.5 (Mistral AI): 761 on GDPval-AA v2.1, at $3.00 per 1M tokens blended.

Pros

  • Has results in the comparable settings this ranking uses.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 761 (v2.1; effort not stated; Stirrup harness (shell + web browsing)).
  • No comparable AutomationBench result yet.
  • Higher list price: $3.00 per 1M tokens (blended 3:1 input:output).

#33 Claude Sonnet 4.5

Claude Sonnet 4.5 (Anthropic): 909 on GDPval-AA v2.1, at $6.00 per 1M tokens blended.

Pros

  • Has results in the comparable settings this ranking uses.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 909 (Reasoning).
  • No comparable AutomationBench result yet.
  • Higher list price: $6.00 per 1M tokens (blended 3:1 input:output).

#34 Mistral Large 3

Mistral Large 3 (Mistral AI): 420 on GDPval-AA v2.1, at $0.75 per 1M tokens blended.

Pros

  • Lower list price: $0.75 per 1M tokens (blended 3:1 input:output).

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 420 (v2.1; no effort label; Stirrup harness (shell + web browsing)).
  • No comparable AutomationBench result yet.

#35 Qwen3.7-Plus

Qwen3.7-Plus (Alibaba Cloud (Qwen)): 767 on GDPval-AA v2.1, 3.7 % on AutomationBench, at $0.70 per 1M tokens blended.

Pros

  • Lower list price: $0.70 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,000,000 tokens.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 767 ('Qwen3.7 Plus'; effort not shown; Stirrup agent harness).
  • Below the median of the compared models on AutomationBench: 3.7 % (v1.0.6; effort not shown).

#36 Amazon Nova 2 Lite

Amazon Nova 2 Lite (Amazon): 366 on GDPval-AA v2.1, at $0.85 per 1M tokens blended.

Pros

  • Lower list price: $0.85 per 1M tokens (blended 3:1 input:output).
  • Context window of 1,000,000 tokens.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 366 (v2.1; high effort; Stirrup agent harness (shell + web browsing)).
  • No comparable AutomationBench result yet.

#37 Gemini 3.1 Pro

Gemini 3.1 Pro (Google): 791 on GDPval-AA v2.1, 8.7 % on AutomationBench, at $4.50 per 1M tokens blended.

Pros

  • Context window of 1,048,576 tokens.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 791 (v2.1; effort not shown; Artificial Analysis Stirrup agent harness).
  • Below the median of the compared models on AutomationBench: 8.7 % (v1.0.6; high effort).
  • Higher list price: $4.50 per 1M tokens (blended 3:1 input:output).

#38 Gemma 4 31B

Gemma 4 31B (Google): 619 on GDPval-AA v2.1, 1.7 % on AutomationBench.

Pros

  • Has results in the comparable settings this ranking uses.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 619 (v2.1; reasoning; Artificial Analysis Stirrup agent harness).
  • Below the median of the compared models on AutomationBench: 1.7 % (v1.0.6; max effort).
  • No API list price for text tokens is recorded.

#39 gpt-oss-120b

gpt-oss-120b (OpenAI): 608 on GDPval-AA v2.1, 0.1 % on AutomationBench.

Pros

  • Has results in the comparable settings this ranking uses.

Cons

  • Below the median of the compared models on GDPval-AA v2.1: 608 (high effort).
  • Below the median of the compared models on AutomationBench: 0.1 % (v1.0.6; high effort).
  • No API list price for text tokens is recorded.
  • Smaller context window (131,072 tokens).

Methodology

CriterionMeasuresWeightScaleBetterWhy it matters
GDPval-AA v2.1 (knowledge work) Benchmark score, best result in one of these comparable settings (independent results preferred): "'Qwen3.7 Plus'; effort not shown; Stirrup agent harness"; "'Qwen3.8 2.4T A95B'; effort not shown; Stirrup agent harness"; "'Qwen3.8 Max'; effort not shown; Stirrup agent harness"; "GDPval-AA v2.1; effort not stated (row label 'Command A+'); Stirrup agent harness with shell and web browsing"; "GDPval-AA v2.1; effort not stated (row label 'North Mini Code'); Stirrup agent harness with shell and web browsing"; "Reasoning"; "high effort"; "high effort; Default Fallback"; "low effort"; "low effort; Default Fallback"; "low effort; Stirrup agent harness"; "max effort"; "max effort; Default Fallback"; "max effort; Stirrup agent loop (shell + web browsing)"; "max effort; run by Artificial Analysis"; "medium effort"; "medium effort; Default Fallback"; "medium effort; Stirrup agent harness"; "medium effort; run by Artificial Analysis"; "non-reasoning"; "non-reasoning; Stirrup agent harness"; "non-reasoning; Stirrup agent loop (shell + web browsing)"; "snapshot 'Qwen3.8 Max (0902)'; effort not shown; Stirrup agent harness"; "snapshot DeepSeek-V4.1-Flash-1017; max effort; Stirrup agent loop (shell + web browsing)"; "v2.1, 'Mistral Large 4 Preview'; effort not stated; Stirrup harness (shell + web browsing)"; "v2.1, 'Mistral Small 4 (Reasoning)'; reasoning on, effort level not stated; Stirrup harness (shell + web browsing)"; "v2.1; effort not shown; Artificial Analysis Stirrup agent harness"; "v2.1; effort not stated; Stirrup harness (shell + web browsing)"; "v2.1; high effort"; "v2.1; high effort; Artificial Analysis Stirrup agent harness"; "v2.1; high effort; Stirrup agent harness (shell + web browsing)"; "v2.1; high reasoning; Artificial Analysis Stirrup harness"; "v2.1; low effort"; "v2.1; low effort; Artificial Analysis Stirrup agent harness"; "v2.1; max effort; Artificial Analysis Stirrup harness"; "v2.1; medium effort"; "v2.1; medium effort; Artificial Analysis Stirrup agent harness"; "v2.1; no effort label; Stirrup harness (shell + web browsing)"; "v2.1; no effort setting; Artificial Analysis Stirrup harness"; "v2.1; non-reasoning"; "v2.1; non-reasoning; Artificial Analysis Stirrup agent harness"; "v2.1; reasoning; Artificial Analysis Stirrup agent harness"; "v2.1; xhigh effort"; "v2.1; xhigh effort; Artificial Analysis Stirrup harness"; "xhigh effort"; "xhigh effort; Default Fallback"; "xhigh effort; Stirrup agent harness"; "xhigh effort; run by Artificial Analysis" 40 % linear higher GDPval-AA measures realistic knowledge-work tasks from many professions (documents, spreadsheets, analyses) in an agent harness with shell and web access. All GDPval-AA v2.1 runs count; a model is rated by its best run.
AutomationBench v1.0.6 (workflow automation) Benchmark score, best result in one of these comparable settings (independent results preferred): "v1.0.6 (official held-out private task set); max effort"; "v1.0.6; default fallbacks (refused tasks re-run); max effort; run by Zapier"; "v1.0.6; default fallbacks; between_tools thinking"; "v1.0.6; default fallbacks; high effort"; "v1.0.6; default fallbacks; low effort"; "v1.0.6; default fallbacks; max effort"; "v1.0.6; default fallbacks; max effort; run by Zapier"; "v1.0.6; default fallbacks; medium effort"; "v1.0.6; default fallbacks; xhigh effort"; "v1.0.6; effort not shown"; "v1.0.6; high effort"; "v1.0.6; low effort"; "v1.0.6; max effort"; "v1.0.6; medium effort"; "v1.0.6; none effort"; "v1.0.6; with Opus 5 fallback"; "v1.0.6; xhigh effort" 25 % linear higher AutomationBench tests multi-step business workflows across connected apps, a common business use of AI agents. All v1.0.6 leaderboard runs count; a model is rated by its best run.
Blended price per 1M tokens (3:1) Blended token price (input:output 3:1), in USD 25 % logarithmic lower Business workloads run at volume, so the list price per token matters. A log scale keeps a few very expensive models from flattening the differences among the rest.
Tool calling Capability: tool calling (yes 1, partial 0.5, no 0; unknown = no data) 10 % linear higher Business automation depends on calling tools and APIs.
  • Logarithmic criteria use log10(1 + value) before normalization, so a few very large values do not flatten the rest.
  • Values are normalized min–max to 0–100 across candidates with data (inverted where lower is better).
  • Score = Σ weight × normalized value / Σ weight of the criteria with data. Models with data for less than 60 % of the weights are not ranked.
  • Ties are broken by coverage, then alphabetically. There is no manual position override; badges such as "Best value" are separate editorial labels.
  • Only models available through an API or released with downloadable weights (open weights or open source) are ranked; models that can only be used inside an app or a subscription are left out.

Data sources of the ranking

  1. qwen3.8-max Model Info - Alibaba Cloud Model Studio
  2. qwen3.7-plus Model Info - Alibaba Cloud Model Studio
  3. qwen3.8-27b Model Info - Alibaba Cloud Model Studio
  4. qwen3.8-2.4t-a95b Model Info - Alibaba Cloud Model Studio
  5. Amazon Bedrock Pricing
  6. Pricing - Claude Platform Docs
  7. Models & Pricing | DeepSeek API Docs
  8. Gemini Developer API pricing
  9. Pricing and rate limits - Meta Model API
  10. API pricing | Mistral Docs
  11. Pricing | OpenAI API
  12. API Pricing
  13. GDPval-AA v2.1 Leaderboard (Artificial Analysis)
  14. AutomationBench AI benchmark leaderboard (Zapier)
  15. Introducing GPT-6.1 Sol | OpenAI

Other rankings

Sources

  1. GDPval-AA v2.1 Leaderboard (Artificial Analysis)
  2. AutomationBench AI benchmark leaderboard (Zapier)
  3. AutomationBench (arXiv 2604.18934)
  4. OSWorld 2.0 (project page and leaderboard)
  5. OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks (arXiv 2606.29537)