Agnes 2.5 Pro Beta
Context 1M tokens
Providers
No provider publishes an API price for this model yet, so no cost can be modeled.
Composite
2 of 7 inputs6 radar axes: DesignArena's two boards share one47.2
Thin data · 2/7Based on only 2 of 7 Composite inputs — treat this rank as uncertaindominance-adjusted from 54.0: a better-measured model that is at least as good on each of these inputs ranks above it
AA Coding v4.x 62.3Coding Agent v1.4 —AA Intelligence (est.) 24.1AA Agentic —Epoch ECI —Software ECI —DesignArena —/—
Radar: percentile among all models measured on each input; a gap means not measured.
Benchmark sheet
10 of 319 registered benchmark versions · bars show the percentile among all models measured on each benchmark.
Agentic
GDPval-AA v2761,376 Elo
GDPval-AA v2 v2 → · Published board — Tests professional knowledge-work deliverables across occupations using AA's Stirrup harness.
Terminal-Bench v2.1 (AA)6969.7%
Terminal-Bench v2.1 (AA) v2.1 → · Published board — Tests terminal-based work on the 89-task verified refresh using Terminus 2.
Coding
SciCode (AA subproblems) v1.0.15048.8%
SciCode (AA subproblems) v1.0.1 → · Published board — Tests scientific Python programming with scientist-annotated background information.
AA Coding Index v4.x · frozen 2026-10-277262.3
AA Coding Index v4.x · frozen 2026-10-27 → · Published board — Artificial Analysis withdrew the Coding Index with Intelligence Index v5.0 (2026-10-28). These are the last v4.x values, frozen with their own date (2026-10-27).
Knowledge
Humanity's Last Exam (AA text-only)8737.5%
Humanity's Last Exam (AA text-only) published 2026-09-10 → · Published board — Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.
AA-Omniscience Index69-10.5
AA-Omniscience Index published 2026-09-10 → · Published board — Tests factual reliability while rewarding correct answers and penalizing hallucinations.
Long-context
AA-LCR v1.19683.0%
AA-LCR v1.1 v1.1 → · Published board — Tests reasoning across multiple long documents with corrected answer keys and grading.
Science
CritPt (AA)8815.7%
CritPt (AA) published 2026-09-10 → · Published board — Tests research-level physics reasoning with Python, symbolic and numerical answers.
GPQA Diamond (AA)9090.5%
GPQA Diamond (AA) published 2026-09-10 → · Published board — Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.
Tool-use
τ³-Banking (AA) v1.0.17935.7%
τ³-Banking (AA) v1.0.1 → · Published board — Tests banking support agents that retrieve policies and change account state through tools.
Vision
MMMU Pro (AA)7075.4%
MMMU Pro (AA) published 2026-09-10 → · Published board — Tests multimodal understanding using challenging ten-option questions.
Missing coverage · 309 benchmark versions
No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.