Benchmark Heaven
Price & provider filters · adjusted costs
Global
Applies to price views & model offers; benchmark evidence stays unfiltered
← All models

GPT-6 Astra (max)

★ featured
OpenAI · released 2026-09-03 · 6 recorded token offers

Top 2 cheapest providers (Adjusted $/task)

Within the active global provider, residency and confidentiality filters.

#ProviderPlatformRaw input $/1MRaw output $/1MAdjusted $/task
1OpenAIOpenRouter$10.00$50.00
2AzureOpenRouter$10.00$50.00

Benchmarks

Composite96.0
Composite evidence3/5
AA Coding · unversioned snapshot 2026-09-1076.9
AA Coding Agent · v1.4 · 2026-09-0967.0
AA Intelligence · unversioned snapshot 2026-09-1052.8
DesignArena Frontend · unversioned snapshot 2026-09-10
DesignArena Full-Stack · unversioned snapshot 2026-09-10
Output speed (t/s)53

MODEL EVIDENCE

Benchmark sheet

18 / 73 registered benchmark versions covered · 20 observations including existing index snapshots.

Compare this model ↗
Composite retains Coding Agent v1.4 · source 2026-09-09

The five Composite inputs remain unchanged. Its Coding Agent input is the median across complete harness results in the retained v1.4 snapshot from 2026-09-09. Artificial Analysis now publishes v1.5, with different components. Explore current v1.5 separately. Dated snapshot labels on other indices identify unversioned source captures, not a verified semantic version.

Profile signals

2 threshold-crossing signals flagged · 17 eligible benchmark families

How flags are calculated

Heuristic screen, not statistical significance: benchmark families are correlated and source uncertainty is unknown. Peer evidence needs ≥ 20 independently measured matched configurations from ≥ 10 distinct model families. A flag needs a directed population z-score of magnitude ≥ 1.5 and a gap of ≥ 1.5 from the leave-one-benchmark-family-out mean z in the same direction, over ≥ 5 other benchmark families.

  • unusually strong CritPt (AA) snapshot-2026-09-10
    Why
    Observed: 0.31714 fraction
    Peer mean 0.03942 · peer sd 0.0762 · n 521 · families 367
    Directed z 3.645 · baseline z 1.699 · gap 1.945 · profile n 16
    0.31714 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
    Evidence
    Axis: CritPt (AA) · snapshot-2026-09-10 · Published board
    Exact value: 0.317142857142857 fraction
    Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
    Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:critpt
  • unusually strong AA Intelligence Index snapshot-2026-09-10 (unversioned)
    Why
    Observed: 52.8 points
    Peer mean 15.78594 · peer sd 11.43677 · n 633 · families 473
    Directed z 3.236 · baseline z 1.725 · gap 1.512 · profile n 16
    52.8 pointsmeasuredobserved 2026-09-10artificialanalysis.ai
    Evidence
    Axis: AA Intelligence Index · snapshot-2026-09-10 (unversioned) · Published board
    Exact value: 52.8 points
    Observed: 2026-09-10 · publication date: not recorded
    Observation id: legacy:aa_intelligence_index:gpt-6-astra::max
    Protocol: inspect · file data/raw/artificialanalysis.json

Protocol-compatible measured/vendor divergences

No verified protocol-compatible vendor/measured pair is available for this model; agreement cannot be assessed.

Agentic

Agentic: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
AA-AnalystAgent

Version snapshot-2026-09-10

Published board

Tests analyst tasks using agentic Python execution across fourteen domains.

0.5125 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA-AnalystAgent · snapshot-2026-09-10 · Published board
Exact value: 0.5125 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:analystAgent
AA-Briefcase

Version snapshot-2026-09-10

Published board

Tests multi-week professional knowledge-work projects with linked tasks and large source collections.

1562.01 Elomeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA-Briefcase · snapshot-2026-09-10 · Published board
Exact value: 1562.01 Elo
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:briefcaseBreakdown.overall.elo
GDPval-AA v2

Version 2

Published board

Tests professional knowledge-work deliverables across occupations using AA's Stirrup harness.

1580.2 Elomeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: GDPval-AA v2 · 2 · Published board
Exact value: 1580.2 Elo
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:gdpval
Terminal-Bench v2.1 (AA)

Version 2.1

Published board

Tests terminal-based work on the 89-task verified refresh using Terminus 2.

0.8839 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: Terminal-Bench v2.1 (AA) · 2.1 · Published board
Exact value: 0.883895131086142 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:terminalbenchV21
Terminal-Bench v4.0 (AA)

Version 4.0

Published board

Tests terminal-based work on the 66-task release using mini-SWE-agent v2.4.6.

0.59091 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: Terminal-Bench v4.0 (AA) · 4.0 · Published board
Exact value: 0.590909090909091 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:terminalbenchV40

Coding

Coding: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
Artificial Analysis Coding Agent Index v1.4

Version 1.4

Codex

The retained AA Coding Agent Index measures coding-agent systems using the earlier three-component implementation.

0.66971 fractionmeasuredobserved 2026-09-09artificialanalysis.ai
Evidence
Axis: Artificial Analysis Coding Agent Index v1.4 · 1.4 · Codex
Exact value: 0.669713903153459 fraction
Observed: 2026-09-09 · publication date: not recorded
Observation id: aa-coding:1.4:36
Artificial Analysis Coding Agent Index v1.5

Version 1.5

Codex

Measures coding-agent systems on DeepSWE v1.1, Terminal-Bench 4.0 and SWE-Atlas-QnA.

0.61645 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: Artificial Analysis Coding Agent Index v1.5 · 1.5 · Codex
Exact value: 0.6164504498789397 fraction
Observed: 2026-09-10 · publication date: not recorded
Observation id: aa-coding:1.5:9e810ff3c6cce5ebaaff7c744c687a47
SciCode (AA subproblems)

Version 1.0.1

Published board

Tests scientific Python programming with scientist-annotated background information.

0.56481 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: SciCode (AA subproblems) · 1.0.1 · Published board
Exact value: 0.564814814814815 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:scicode
AA Coding Index

Version snapshot-2026-09-10 (unversioned)

Published board

Published AA index from the retained API snapshot. No verified semantic version was supplied.

76.9 pointsmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA Coding Index · snapshot-2026-09-10 (unversioned) · Published board
Exact value: 76.9 points
Observed: 2026-09-10 · publication date: not recorded
Observation id: legacy:aa_coding_index:gpt-6-astra::max
Protocol: inspect · file data/raw/artificialanalysis.json

Knowledge

Knowledge: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
Humanity's Last Exam (AA text-only)

Version snapshot-2026-09-10

Published board

Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.

0.5468 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: Humanity's Last Exam (AA text-only) · snapshot-2026-09-10 · Published board
Exact value: 0.546802594995366 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:hle
AA-Omniscience Index

Version snapshot-2026-09-10

Published board

Tests factual reliability while rewarding correct answers and penalizing hallucinations.

43.4 pointsmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA-Omniscience Index · snapshot-2026-09-10 · Published board
Exact value: 43.4 points
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:omniscience

Long-context

Long-context: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
GDP.pdf (AA)

Version snapshot-2026-09-10

Published board

Tests professional reasoning over long PDFs with AA document preparation and grading.

0.31 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: GDP.pdf (AA) · snapshot-2026-09-10 · Published board
Exact value: 0.31 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:gdpPdfAllPass
AA-LCR v1.1

Version 1.1

Published board

Tests reasoning across multiple long documents with corrected answer keys and grading.

0.80667 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA-LCR v1.1 · 1.1 · Published board
Exact value: 0.806666666666667 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:lcr
MLCR-AA

Version snapshot-2026-09-10

Published board

Tests medical-record synthesis and reasoning across long, fragmented case documents.

0.35 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: MLCR-AA · snapshot-2026-09-10 · Published board
Exact value: 0.35 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:mlcrOverall

Reasoning

Reasoning: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
AA Intelligence Index

Version snapshot-2026-09-10 (unversioned)

Published board

Published AA index from the retained API snapshot. No verified semantic version was supplied.

52.8 pointsmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA Intelligence Index · snapshot-2026-09-10 (unversioned) · Published board
Exact value: 52.8 points
Observed: 2026-09-10 · publication date: not recorded
Observation id: legacy:aa_intelligence_index:gpt-6-astra::max
Protocol: inspect · file data/raw/artificialanalysis.json

Science

Science: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
CritPt (AA)

Version snapshot-2026-09-10

Published board

Tests research-level physics reasoning with Python, symbolic and numerical answers.

0.31714 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: CritPt (AA) · snapshot-2026-09-10 · Published board
Exact value: 0.317142857142857 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:critpt
GPQA Diamond (AA)

Version snapshot-2026-09-10

Published board

Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.

0.96061 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: GPQA Diamond (AA) · snapshot-2026-09-10 · Published board
Exact value: 0.960606060606061 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:gpqa

Tool-use

Tool-use: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
AutomationBench-AA

Version 1.0.6

Published board

Tests multi-app SaaS workflows through REST tools on a held-out AutomationBench split.

0.68492 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AutomationBench-AA · 1.0.6 · Published board
Exact value: 0.6849174806688876 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:automationBenchPartialScore
τ³-Banking (AA)

Version 1.0.1

Published board

Tests banking support agents that retrieve policies and change account state through tools.

0.41443 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: τ³-Banking (AA) · 1.0.1 · Published board
Exact value: 0.414432989690722 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:tauBanking

Vision

Vision: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
MMMU Pro (AA)

Version snapshot-2026-09-10

Published board

Tests multimodal understanding using challenging ten-option questions.

0.86879 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: MMMU Pro (AA) · snapshot-2026-09-10 · Published board
Exact value: 0.86878612716763 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:2f339a97-9a0d-499a-9cb5-e0db665bfa25:mmmuPro
Missing coverage · 57 benchmark versions

No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.

Variants / reasoning settings

VariantCoding · snapshot 2026-09-10Intelligence · snapshot 2026-09-10
GPT-6 Astra (high)77.151.0
GPT-6 Astra (max)76.952.8
GPT-6 Astra (medium)76.749.7
GPT-6 Astra (Non-reasoning)76.245.2
GPT-6 Astra (xhigh)75.952.5
GPT-6 Astra (low)75.746.0

GitHub Copilot

Current usage-based billing · model token cost is converted to AI Credits at 1 credit = $0.01.

Input $10.00 / 1M
Cached input $1.00 / 1M
Cache write $12.50 / 1M
Output $50.00 / 1M
Status GA

Token offers by platform — Adjusted $/task

Adjusted costs are modeled USD per task: AA output tokens × OpenRouter usage I/O (Chutes global fallback). These are general usage and benchmark proxies for coding-agent work. Missing AA data assumes 1,000 output tokens/task; unknown cache hit assumes 0%; unmeasured additional cache writes assume 0 tokens. Click any underlined price for exact inputs, dates and assumptions. Raw list prices use the selected fixed input/output blend, in USD per million tokens.

6 offers within the active global filters; “—” means the catalog is active but no public token price is available.

OpenRouter (4)

OpenAIglobalopenai$10.00 raw in $/1M$50.00 raw out $/1M
Azureglobalazure$10.00 raw in $/1M$50.00 raw out $/1M
Azureglobalazure/us$11.00 raw in $/1M$55.00 raw out $/1M
OpenAIglobalopenai/fast$20.00 raw in $/1M$100 raw out $/1M

Azure AI Foundry (2)

Azure AI Foundryglobal raw in $/1M raw out $/1M
Azure AI FoundryeuEU raw in $/1M raw out $/1M
Benchmark Heaven — Model benchmarks & costs