GPT 4O Mini 2024 07 18
Top 0 cheapest providers (Adjusted $/task)
Within the active global provider, residency and confidentiality filters.
No per-token pricing matches the active global filters.
Composite
0 of 7 inputs6 radar axes: DesignArena's two boards share one50.0
AA Coding —Coding Agent v1.4 —AA Intelligence —AA Agentic —Epoch ECI —Software ECI —DesignArena —/—
Radar: percentile among all models measured on each input; a gap means not measured.
Benchmark sheet
7 of 140 registered benchmark versions · bars show the percentile among all models measured on each benchmark.
Knowledge
SimpleQA Verified (run by Epoch AI)08.3%
SimpleQA Verified (run by Epoch AI) published 2026-09-16 ↗ · Published board — Short fact-seeking questions answered without tools, testing whether a model knows a fact rather than guessing; Google DeepMind's cleaned version of OpenAI's SimpleQA, run by Epoch AI.
Math
FrontierMath Tiers 1–3 v2 (Epoch AI)00.7%
FrontierMath Tiers 1–3 v2 (Epoch AI) v2 ↗ · Published board — Unpublished, expert-written mathematics problems from undergraduate to research level with automatically checkable answers, run by Epoch AI on its private v2 set.
Reasoning
Chess Puzzles (Epoch AI)30.0%
Chess Puzzles (Epoch AI) published 2026-09-18 ↗ · Published board — Best-move selection on 100 novel chess positions generated programmatically by Epoch AI, each with a single Stockfish-verified best move; probes spatial reasoning and planning.
Mystery Game Puzzles (Epoch AI)1212.0%
Mystery Game Puzzles (Epoch AI) published 2026-09-18 ↗ · Published board — Best-move selection on 100 mid-game positions of a well-known game whose identity Epoch deliberately keeps undisclosed, generated programmatically like Chess Puzzles.
Safety/Alignment
BullshitBench V1 (clear pushback)67.3%
BullshitBench V1 (clear pushback) published 2026-09-10 ↗ · Published board — Whether a model rejects the broken premise of 55 deliberately nonsensical prompts (V1 question set) instead of answering them confidently.
BullshitBench V2 (clear pushback)02.0%
BullshitBench V2 (clear pushback) published 2026-09-10 ↗ · Published board — Whether a model rejects the broken premise of 100 deliberately nonsensical prompts (V2 question set) instead of answering them confidently.
Science
GPQA Diamond (Epoch AI run)1337.7%
GPQA Diamond (Epoch AI run) published 2026-09-18 ↗ · Published board — Epoch AI's own inspect-ai runs of GPQA Diamond, the 198-question graduate-level science multiple-choice set.
Missing coverage · 138 benchmark versions
No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.
Token offers by platform · 0 offers (Adjusted $/task)
Click any underlined price to see how it is estimated and where each input comes from. How we calculate adjusted cost.
0 offers within the active global filters; “—” means the catalog is active but no public token price is available.
No token offers match the active global filters.