GPT-4o (Aug '24)

deprecated by benchmark source

OpenAI · released 2024-08-06 · 2 offers

Context 128K tokens

Top 1 cheapest providers (Adjusted $/task)

Within the active global provider, residency and confidentiality filters.

#	Provider	Price channel	Raw input $/1M	Raw output $/1M	Adjusted $/task
1	Azurevia OpenRouter — Price via OpenRouter: OpenRouter's price for Azure's endpoint (https://openrouter.ai/openai/gpt-4o-2024-08-06/providers), collected 2026-11-03.	via OpenRouter — Price via OpenRouter: OpenRouter's price for Azure's endpoint (https://openrouter.ai/openai/gpt-4o-2024-08-06/providers), collected 2026-11-03.	$2.50	$10.00

Composite

1 of 7 inputs6 radar axes: DesignArena's two boards share one

5.9

Thin data · 1/7

dominance-adjusted from 8.0: a better-measured model that is at least as good on each of these inputs ranks above it

AA Coding v4.x —Coding Agent v1.4 —AA Intelligence (est.) 3.4AA Agentic —Epoch ECI —Software ECI —DesignArena —/—

Radar: percentile among all models measured on each input; a gap means not measured.

Benchmark sheet

13 of 319 registered benchmark versions · bars show the percentile among all models measured on each benchmark.

Compare this model →

Agentic

Terminal-Bench Hard (AA)428.3%2026-09-10
Terminal-Bench Hard (AA) pinned revision 74221fb → · Published board — Tests a pinned 44-task hard subset of terminal-based work using Terminus 2.
τ²-Bench Airline (OpenRouter run)1844.7%2026-09-15
τ²-Bench Airline (OpenRouter run) published 2026-09-15 → · Published board — Multi-turn service agents making tool calls under strict policy constraints. (OpenRouter's own reproducible run, as published on openrouter.ai/benchmarks.)

Efficiency

GPQA Diamond (OpenRouter run) — measured cost per task55$0.0182026-09-15
GPQA Diamond (OpenRouter run) — measured cost per task published 2026-09-15 → · Published board — Mean USD OpenRouter actually spent per task while running GPQA Diamond for this configuration.
τ²-Bench Airline (OpenRouter run) — measured cost per task21$0.212026-09-15
τ²-Bench Airline (OpenRouter run) — measured cost per task published 2026-09-15 → · Published board — Mean USD OpenRouter actually spent per task while running τ²-Bench Airline for this configuration.

Instruction-following

IFBench (AA single-turn)2836.0%2026-09-10
IFBench (AA single-turn) published 2026-09-10 → · Published board — Tests precise single-turn instructions with deterministic rule checks.

Knowledge

Humanity's Last Exam (AA text-only)02.3%2026-09-10
Humanity's Last Exam (AA text-only) published 2026-09-10 → · Published board — Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.
AA-Omniscience Index61-20.92026-09-10
AA-Omniscience Index published 2026-09-10 → · Published board — Tests factual reliability while rewarding correct answers and penalizing hallucinations.

Long-context

AA-LCR v1.13941.0%2026-09-10
AA-LCR v1.1 v1.1 → · Published board — Tests reasoning across multiple long documents with corrected answer keys and grading.

Science

CritPt (AA)240.0%2026-09-10
CritPt (AA) published 2026-09-10 → · Published board — Tests research-level physics reasoning with Python, symbolic and numerical answers.
GPQA Diamond (AA)2652.1%2026-09-10
GPQA Diamond (AA) published 2026-09-10 → · Published board — Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.
GPQA Diamond (OpenRouter run)1251.7%2026-09-15
GPQA Diamond (OpenRouter run) published 2026-09-15 → · Published board — Graduate-level science questions that resist retrieval and reward careful reasoning. (OpenRouter's own reproducible run, as published on openrouter.ai/benchmarks.)

Tool-use

τ²-Bench Telecom (AA)3628.9%2026-09-10
τ²-Bench Telecom (AA) published 2026-09-10 → · Published board — Tests dual-control telecom agents that coordinate tool use with a simulated user.

Vision

MMMU Pro (AA)2256.3%2026-09-10
MMMU Pro (AA) published 2026-09-10 → · Published board — Tests multimodal understanding using challenging ten-option questions.

Missing coverage · 306 benchmark versions

No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.

Token offers by platform · 1 offer (Adjusted $/task)

Click any underlined price to see how it is estimated and where each input comes from. How we calculate adjusted cost.

1 offer within the active global filters, 1 more outside them; “price n/a” means the provider serves the model but publishes no direct token price we could collect — no other channel's price is shown in its place.

OpenRouter (1)

Prices via OpenRouter — what OpenRouter charges for each provider's endpoint, not the provider's own direct price. Source: openrouter.ai/openai/gpt-4o-2024-08-06/providers, collected 2026-11-03.

Azure