GPT-4o (May '24)

deprecated by benchmark source

OpenAI · released 2024-05-13 · 1 offer

Context 128K tokens

Top 1 cheapest providers (Adjusted $/task)

Within the active global provider, residency and confidentiality filters.

#	Provider	Price channel	Raw input $/1M	Raw output $/1M	Adjusted $/task
1	Azurevia OpenRouter — Price via OpenRouter: OpenRouter's price for Azure's endpoint (https://openrouter.ai/openai/gpt-4o-2024-05-13/providers), collected 2026-11-03.	via OpenRouter — Price via OpenRouter: OpenRouter's price for Azure's endpoint (https://openrouter.ai/openai/gpt-4o-2024-05-13/providers), collected 2026-11-03.	$5.00	$15.00

Composite

2 of 7 inputs6 radar axes: DesignArena's two boards share one

11.1

Thin data · 2/7

AA Coding v4.x 24.2Coding Agent v1.4 —AA Intelligence (est.) 3.1AA Agentic —Epoch ECI —Software ECI —DesignArena —/—

Radar: percentile among all models measured on each input; a gap means not measured.

Benchmark sheet

7 of 319 registered benchmark versions · bars show the percentile among all models measured on each benchmark.

Compare this model →

Agentic

τ²-Bench Airline (OpenRouter run)940.0%2026-09-15
τ²-Bench Airline (OpenRouter run) published 2026-09-15 → · Published board — Multi-turn service agents making tool calls under strict policy constraints. (OpenRouter's own reproducible run, as published on openrouter.ai/benchmarks.)

Coding

AA Coding Index v4.x · frozen 2026-10-272924.22026-10-27
AA Coding Index v4.x · frozen 2026-10-27 → · Published board — Artificial Analysis withdrew the Coding Index with Intelligence Index v5.0 (2026-10-28). These are the last v4.x values, frozen with their own date (2026-10-27).

Efficiency

GPQA Diamond (OpenRouter run) — measured cost per task50$0.0242026-09-15
GPQA Diamond (OpenRouter run) — measured cost per task published 2026-09-15 → · Published board — Mean USD OpenRouter actually spent per task while running GPQA Diamond for this configuration.
τ²-Bench Airline (OpenRouter run) — measured cost per task1$1.132026-09-15
τ²-Bench Airline (OpenRouter run) — measured cost per task published 2026-09-15 → · Published board — Mean USD OpenRouter actually spent per task while running τ²-Bench Airline for this configuration.

Knowledge

Humanity's Last Exam (AA text-only)01.8%2026-09-10
Humanity's Last Exam (AA text-only) published 2026-09-10 → · Published board — Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.

Science

GPQA Diamond (AA)2752.6%2026-09-10
GPQA Diamond (AA) published 2026-09-10 → · Published board — Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.
GPQA Diamond (OpenRouter run)850.7%2026-09-15
GPQA Diamond (OpenRouter run) published 2026-09-15 → · Published board — Graduate-level science questions that resist retrieval and reward careful reasoning. (OpenRouter's own reproducible run, as published on openrouter.ai/benchmarks.)

Vision

CharXiv Reasoning val-v1.05747.1%2026-09-22
CharXiv Reasoning val-v1.0 → · validation — Can a multimodal model reason over the real, messy charts in scientific papers — combining values, trends and labels across a figure — rather than read off templated plots?

Unusual results

1 threshold-crossing signal flagged · 7 eligible benchmark families

How flags are calculated

Heuristic screen, not statistical significance: benchmark families are correlated and source uncertainty is unknown. Peer evidence needs ≥ 20 independently measured matched configurations from ≥ 10 distinct model families. A flag needs a directed population z-score of magnitude ≥ 1.5 and a gap of ≥ 1.5 from the leave-one-benchmark-family-out mean z in the same direction, over ≥ 5 other benchmark families.

unusually weak τ²-Bench Airline (OpenRouter run) — measured cost per task published 2026-09-15
Why
Observed: 1.13156 USD
Peer mean 0.14611 · peer sd 0.24997 · n 117 · families 117
Directed z -3.942 · baseline z -0.833 · gap -3.11 · profile n 6
1.13156 USDmeasured· 50 tasks· 1.13 USD per task (measured by OpenRouter)observed 2026-09-15openrouter.ai ↗
Evidence
Axis: τ²-Bench Airline (OpenRouter run) — measured cost per task · published 2026-09-15 · Published board
Exact value: 1.1315643 USD
Tasks evaluated: 50
Published mean cost: 1.1315643 USD per task (measured by OpenRouter) — measured by OpenRouter on τ²-Bench Airline (OpenRouter run) — measured cost per task
Observed: 2026-09-15T23:29:03.209Z · publication date: not recorded
Observation id: openrouter-cost:openai/gpt-4o-2024-05-13|tau_bench_verified_airline
Source: https://openrouter.ai/benchmarks
Exact observation and full protocol ↗

Missing coverage · 312 benchmark versions

No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.

Token offers by platform · 1 offer (Adjusted $/task)

Click any underlined price to see how it is estimated and where each input comes from. How we calculate adjusted cost.

1 offer within the active global filters; “price n/a” means the provider serves the model but publishes no direct token price we could collect — no other channel's price is shown in its place.

OpenRouter (1)

Prices via OpenRouter — what OpenRouter charges for each provider's endpoint, not the provider's own direct price. Source: openrouter.ai/openai/gpt-4o-2024-05-13/providers, collected 2026-11-03.

Azure