Benchmark Heaven
Price & provider filters · adjusted costs
Global
Applies to price views & model offers; benchmark evidence stays unfiltered
← All models

Claude Sonnet 5 (Non-reasoning, High Effort)

★ featured
Anthropic · released 2026-06-30 · 14 recorded token offers

Top 5 cheapest providers (Adjusted $/task)

Within the active global provider, residency and confidentiality filters.

#ProviderPlatformRaw input $/1MRaw output $/1MAdjusted $/task
1Google Vertex AIGoogle Vertex AI$2.00$10.00
2AnthropicAnthropic$2.00$10.00
3Claude Platform on AWSOpenRouter$2.00$10.00
4AzureOpenRouter$2.00$10.00
5GoogleOpenRouter$2.00$10.00

Benchmarks

Composite81.2
Composite evidence2/5
AA Coding · unversioned snapshot 2026-09-1066.4
AA Coding Agent · v1.4 · 2026-09-09
AA Intelligence · unversioned snapshot 2026-09-1028.9
DesignArena Frontend · unversioned snapshot 2026-09-10
DesignArena Full-Stack · unversioned snapshot 2026-09-10
Output speed (t/s)67

MODEL EVIDENCE

Benchmark sheet

9 / 73 registered benchmark versions covered · 11 observations including existing index snapshots.

Compare this model ↗
Composite retains Coding Agent v1.4 · source 2026-09-09

The five Composite inputs remain unchanged. Its Coding Agent input is the median across complete harness results in the retained v1.4 snapshot from 2026-09-09. Artificial Analysis now publishes v1.5, with different components. Explore current v1.5 separately. Dated snapshot labels on other indices identify unversioned source captures, not a verified semantic version.

Profile signals

No threshold-crossing signal · 11 eligible benchmark families

How flags are calculated

Heuristic screen, not statistical significance: benchmark families are correlated and source uncertainty is unknown. Peer evidence needs ≥ 20 independently measured matched configurations from ≥ 10 distinct model families. A flag needs a directed population z-score of magnitude ≥ 1.5 and a gap of ≥ 1.5 from the leave-one-benchmark-family-out mean z in the same direction, over ≥ 5 other benchmark families.

Protocol-compatible measured/vendor divergences

No verified protocol-compatible vendor/measured pair is available for this model; agreement cannot be assessed.

Agentic

Agentic: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
GDPval-AA v2

Version 2

Published board

Tests professional knowledge-work deliverables across occupations using AA's Stirrup harness.

1283.47 Elomeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: GDPval-AA v2 · 2 · Published board
Exact value: 1283.47 Elo
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:d58b9ada-fd9d-4fff-a086-242034657963:gdpval
Terminal-Bench v2.1 (AA)

Version 2.1

Published board

Tests terminal-based work on the 89-task verified refresh using Terminus 2.

0.75281 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: Terminal-Bench v2.1 (AA) · 2.1 · Published board
Exact value: 0.752808988764045 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:d58b9ada-fd9d-4fff-a086-242034657963:terminalbenchV21

Coding

Coding: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
AA Coding Index

Version snapshot-2026-09-10 (unversioned)

Published board

Published AA index from the retained API snapshot. No verified semantic version was supplied.

66.4 pointsmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA Coding Index · snapshot-2026-09-10 (unversioned) · Published board
Exact value: 66.4 points
Observed: 2026-09-10 · publication date: not recorded
Observation id: legacy:aa_coding_index:claude-sonnet-5::non-reasoning-high
Protocol: inspect · file data/raw/artificialanalysis.json

Knowledge

Knowledge: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
Humanity's Last Exam (AA text-only)

Version snapshot-2026-09-10

Published board

Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.

0.19045 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: Humanity's Last Exam (AA text-only) · snapshot-2026-09-10 · Published board
Exact value: 0.190454124189064 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:d58b9ada-fd9d-4fff-a086-242034657963:hle
AA-Omniscience Index

Version snapshot-2026-09-10

Published board

Tests factual reliability while rewarding correct answers and penalizing hallucinations.

-0.65 pointsmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA-Omniscience Index · snapshot-2026-09-10 · Published board
Exact value: -0.65 points
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:d58b9ada-fd9d-4fff-a086-242034657963:omniscience

Long-context

Long-context: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
AA-LCR v1.1

Version 1.1

Published board

Tests reasoning across multiple long documents with corrected answer keys and grading.

0.7 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA-LCR v1.1 · 1.1 · Published board
Exact value: 0.7 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:d58b9ada-fd9d-4fff-a086-242034657963:lcr

Reasoning

Reasoning: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
AA Intelligence Index

Version snapshot-2026-09-10 (unversioned)

Published board

Published AA index from the retained API snapshot. No verified semantic version was supplied.

28.9 pointsmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA Intelligence Index · snapshot-2026-09-10 (unversioned) · Published board
Exact value: 28.9 points
Observed: 2026-09-10 · publication date: not recorded
Observation id: legacy:aa_intelligence_index:claude-sonnet-5::non-reasoning-high
Protocol: inspect · file data/raw/artificialanalysis.json

Science

Science: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
CritPt (AA)

Version snapshot-2026-09-10

Published board

Tests research-level physics reasoning with Python, symbolic and numerical answers.

0.01143 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: CritPt (AA) · snapshot-2026-09-10 · Published board
Exact value: 0.0114285714285714 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:d58b9ada-fd9d-4fff-a086-242034657963:critpt
GPQA Diamond (AA)

Version snapshot-2026-09-10

Published board

Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.

0.8 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: GPQA Diamond (AA) · snapshot-2026-09-10 · Published board
Exact value: 0.8 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:d58b9ada-fd9d-4fff-a086-242034657963:gpqa

Tool-use

Tool-use: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
τ³-Banking (AA)

Version 1.0.1

Published board

Tests banking support agents that retrieve policies and change account state through tools.

0.1567 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: τ³-Banking (AA) · 1.0.1 · Published board
Exact value: 0.156701030927835 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:d58b9ada-fd9d-4fff-a086-242034657963:tauBanking

Vision

Vision: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
MMMU Pro (AA)

Version snapshot-2026-09-10

Published board

Tests multimodal understanding using challenging ten-option questions.

0.71908 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: MMMU Pro (AA) · snapshot-2026-09-10 · Published board
Exact value: 0.71907514450867 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:d58b9ada-fd9d-4fff-a086-242034657963:mmmuPro
Missing coverage · 66 benchmark versions

No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.

Variants / reasoning settings

VariantCoding · snapshot 2026-09-10Intelligence · snapshot 2026-09-10
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)71.538.4
Claude Sonnet 5 (Non-reasoning, High Effort)66.428.9
Claude Sonnet 5 (Adaptive Reasoning, Medium Effort)28.4
Claude Sonnet 5 (Adaptive Reasoning, High Effort)
Claude Sonnet 5 (Adaptive Reasoning, Xhigh Effort)
Claude Sonnet 5 (Adaptive Reasoning, Low Effort)24.7

GitHub Copilot

Current usage-based billing · model token cost is converted to AI Credits at 1 credit = $0.01.

Input $2.00 / 1M
Cached input $0.200 / 1M
Cache write $2.50 / 1M
Output $10.00 / 1M
Status GA

Token offers by platform — Adjusted $/task

Adjusted costs are modeled USD per task: AA output tokens × OpenRouter usage I/O (Chutes global fallback). These are general usage and benchmark proxies for coding-agent work. Missing AA data assumes 1,000 output tokens/task; unknown cache hit assumes 0%; unmeasured additional cache writes assume 0 tokens. Click any underlined price for exact inputs, dates and assumptions. Raw list prices use the selected fixed input/output blend, in USD per million tokens.

14 offers within the active global filters; “—” means the catalog is active but no public token price is available.

Google Vertex AI (2)

Google Vertex AIglobal$2.00 raw in $/1M$10.00 raw out $/1M
Google Vertex AIeuEU$2.20 raw in $/1M$11.00 raw out $/1M

Anthropic (1)

Anthropicglobal$2.00 raw in $/1M$10.00 raw out $/1M

OpenRouter (9)

Claude Platform on AWSglobalclaude-on-aws$2.00 raw in $/1M$10.00 raw out $/1M
Azureglobalazure/us$2.00 raw in $/1M$10.00 raw out $/1M
Azureglobalazure/global$2.00 raw in $/1M$10.00 raw out $/1M
Googleglobalgoogle-vertex/global$2.00 raw in $/1M$10.00 raw out $/1M
Amazon Bedrockglobalamazon-bedrock/global$2.00 raw in $/1M$10.00 raw out $/1M
Anthropicglobalanthropic$2.00 raw in $/1M$10.00 raw out $/1M
Googleglobalgoogle-vertex/us$2.20 raw in $/1M$11.00 raw out $/1M
Googleeugoogle-vertex/europeEU$2.20 raw in $/1M$11.00 raw out $/1M
Amazon Bedrockglobalamazon-bedrock/us-east-1$2.20 raw in $/1M$11.00 raw out $/1M

AWS Bedrock (1)

AWS Bedrockeu-central-1 (EU cross-region inference profile)EU$2.20 raw in $/1M$11.00 raw out $/1M

T-Systems LLM Hub (1)

T-Systems LLM HubeuEU$3.45 raw in $/1M$17.26 raw out $/1M
Benchmark Heaven — Model benchmarks & costs