Skip to content

BenchmarksArtificial Analysis

Artificial Analysis Intelligence Index v4.3 adds AutomationBench-AA and Terminal-Bench 4.0

Artificial Analysis Intelligence at a glance

Version 4.3 replaces τ³-Banking with AutomationBench-AA, a held-out set of 657 business workflow tasks built with Zapier, upgrades Terminal-Bench to 4.0, and raises the share of private-test evaluations to 45%.

What changed with Artificial Analysis Intelligence

On September 7, 2026, Artificial Analysis released v4.3 of its Intelligence Index, three days after v4.2 and as part of its rollout toward v5. It replaced τ³-Banking with AutomationBench-AA, its implementation of Zapier's business workflow automation benchmark, and upgraded Terminal-Bench from 2.1 to 4.0, with 66 harder terminal tasks each run three times.

AutomationBench-AA uses a held-out set of 657 tasks across finance, HR, marketing, operations, sales, and support, where agents work in simulated business apps. It gives partial credit for completed objectives, but any guardrail violation scores the task zero. With it, evaluations using private questions or answers rose from 40% to 45% of the index weight; category weights stayed at Agents 30%, Coding 20%, General 30%, and Scientific Reasoning 20%. At launch, Claude Fable 5.1 and GPT-6 Astra tied for the top score of 53.

Where to compare Artificial Analysis Intelligence

Independent leaderboards and official resources for comparing this model yourself. Rankings change often; each site shows its own current data.

Why Artificial Analysis Intelligence matters for businesses

AutomationBench-AA is the closest public proxy so far for the CRM, email, and ops automations agencies build, and it punishes rule-breaking rather than just rewarding progress. Version 5 replaced v4.3 on October 27, 2026, so use current leaderboard values and treat these launch scores as a dated snapshot.

Sources for this story

  1. Official
  2. Intelligence Benchmarking Methodology (opens in a new tab)

    Artificial Analysis · artificialanalysis.ai

    Official

Last verified: . IA Compa summarizes public announcements for business readers. We are not affiliated with the companies mentioned. Always confirm details, pricing, and availability with the official source.

  • #benchmarks
  • #artificial-analysis
  • #intelligence-index
  • #automation
  • #agents

Want this working in your business?

We turn new AI capabilities into agents, voice receptionists, and automations you can actually use.