← All models

GPT-4o mini

deprecated by benchmark source
OpenAI · released 2024-07-18 · 5 offers

Context 128K tokens

Top 2 cheapest providers (Adjusted $/task)

The same list price can give a different adjusted $/task (caching, token efficiency) — click a price for its inputs.

Within the active global provider, residency and confidentiality filters.

#ProviderAdjusted $/task
1Azurevia OpenRouter — Price via OpenRouter: OpenRouter's price for Azure's endpoint (https://openrouter.ai/openai/gpt-4o-mini/providers), collected 2026-11-03.
2Azure AI Foundrydirect — Direct price: Azure AI Foundry's own price list (https://prices.azure.com/api/retail/prices), collected 2026-11-03.

Composite

4 of 7 inputs · 2 from the model family6 radar axes: DesignArena's two boards share one

4.5

AA Coding v4.xCoding Agent v1.4AA Intelligence (est.)AA AgenticEpoch ECISoftware ECIDesignArenaAA Coding v4.x: percentile 11AA Intelligence (est.): percentile 19Epoch ECI: percentile 5Software ECI: percentile 0

AA Coding v4.x 11.4Coding Agent v1.4 —AA Intelligence (est.) 2.8AA Agentic —Epoch ECI 126.5Software ECI 119.9DesignArena —/—

Radar: percentile among all models measured on each input; a gap means not measured.

Benchmark sheet

21 of 319 registered benchmark versions · bars show the percentile among all models measured on each benchmark.

1 of 22 values are OpenAI's own claims (†), not independent measurements; a matching independent result replaces a claim as soon as one exists.

Composite attachments (used in the score, not counted as exact benchmarks):
  • Epoch ECI · attached
  • Software ECI · attached
Compare this model →

Agentic

  • GDPval-AA v210188 Elo

    GDPval-AA v2 v2 → · Published board — Tests professional knowledge-work deliverables across occupations using AA's Stirrup harness.

  • Terminal-Bench v2.1 (AA)145.6%

    Terminal-Bench v2.1 (AA) v2.1 → · Published board — Tests terminal-based work on the 89-task verified refresh using Terminus 2.

  • Elimination Game Benchmark253

    Elimination Game Benchmark published 2026-09-10 → · Published board — Multi-player tournament where 8 LLM players converse, form alliances, and vote to eliminate each other, with final rankings scored via TrueSkill.

  • τ²-Bench Airline (OpenRouter run)327.0%

    τ²-Bench Airline (OpenRouter run) published 2026-09-15 → · Published board — Multi-turn service agents making tool calls under strict policy constraints. (OpenRouter's own reproducible run, as published on openrouter.ai/benchmarks.)

Coding

  • AA Coding Index v4.x · frozen 2026-10-271111.4

    AA Coding Index v4.x · frozen 2026-10-27 → · Published board — Artificial Analysis withdrew the Coding Index with Intelligence Index v5.0 (2026-10-28). These are the last v4.x values, frozen with their own date (2026-10-27).

Efficiency

Instruction-following

  • IFBench (AA single-turn)1531.0%

    IFBench (AA single-turn) published 2026-09-10 → · Published board — Tests precise single-turn instructions with deterministic rule checks.

  • LisanBench word chains, v0.2.0 (Lisan al Gaib)1892.7

    LisanBench word chains, v0.2.0 (Lisan al Gaib) v0.2.0 → · Published board — A model builds the longest chain of English words it can, each differing from the last by one letter, with no repeats and only dictionary words, from 50 starting words; any broken rule ends the chain.

Knowledge

Long-context

  • MLCR-AA10.0%

    MLCR-AA published 2026-09-10 → · Published board — Tests medical-record synthesis and reasoning across long, fragmented case documents.

Math

  • AIME 2025 (AA)1914.7%

    AIME 2025 (AA) v2025 → · Published board — Advanced mathematical problem solving on AIME I and II 2025.

Other

Reasoning

  • SimpleBench610.7%

    SimpleBench published 2026-09-10 → · Published board — A multiple-choice text benchmark of over 200 questions covering spatio-temporal reasoning, social intelligence, and linguistic adversarial robustness, on which a non-specialized human baseline outperforms every tested LLM.

  • SimpleBench610.7%

    SimpleBench published 2026-09-26 → · Published board — A multiple-choice text benchmark of over 200 questions covering spatio-temporal reasoning, social intelligence, and linguistic adversarial robustness, on which a non-specialized human baseline outperforms every tested LLM.

Safety/Alignment

Science

Tool-use

  • τ³-Banking (AA) v1.0.122.9%

    τ³-Banking (AA) v1.0.1 → · Published board — Tests banking support agents that retrieve policies and change account state through tools.

Vision

  • MMMU Pro (AA)741.5%

    MMMU Pro (AA) published 2026-09-10 → · Published board — Tests multimodal understanding using challenging ten-option questions.

  • MMMUdeveloper's claim59.4%† self-reported by the developer

    MMMU published 2026-09-10 → · validation — A multimodal benchmark of 11.5K college-level questions across six disciplines and 30 subjects, with 30 heterogeneous image types.

Writing

  • EQ-Bench Creative Writing v323871 Elo

    EQ-Bench Creative Writing v3 v3 → · Published board — A LLM-judged creative writing benchmark with vocabulary and GPT-slop controls.

Missing coverage · 298 benchmark versions

No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.

Token offers by platform · 4 offers (Adjusted $/task)

Click any underlined price to see how it is estimated and where each input comes from. How we calculate adjusted cost.

4 offers within the active global filters, 1 more outside them; “price n/a” means the provider serves the model but publishes no direct token price we could collect — no other channel's price is shown in its place.

OpenRouter (2)

Prices via OpenRouter — what OpenRouter charges for each provider's endpoint, not the provider's own direct price. Source: openrouter.ai/openai/gpt-4o-mini/providers, collected 2026-11-03.

Azure
Azure

Azure AI Foundry (2)

Direct prices from Azure AI Foundry's own price list. Source: prices.azure.com/api/retail/prices, collected 2026-11-03.

Azure AI Foundry
Azure AI Foundry
GPT-4o mini — benchmarks & cost | Benchmark Heaven