GPT-6 Sol (Max)

Terminal-Bench v4.0 (AA, upstream timeouts) 4.0-upstream-timeouts → · Published board — Tests terminal-based work on the 66-task release using AA's mini-swe-agent harness with the tasks' own timeouts.

EBR-bench (Earthborne Rangers, Epoch AI) published 2026-09-18 → · Published board — Learning-capability test: models repeatedly play the obscure campaign board game Earthborne Rangers with note-taking, and the score measures whether results improve across playthroughs.

Finance Agent v2 (Vals Index v2) v2 → · Published board — Multi-step financial reasoning tasks.

HLAB — Harvey's Legal Agent Benchmark (Vals Index v2) v2 → · Published board — Long-horizon legal work product creation. The index column is Harvey's Legal Agent Benchmark's own published standalone score, reported as accuracy — not comparable with Artificial Analysis' Harvey LAB-AA row.

Terminal-Bench 2.1 (Vals Index v2) v2 → · Published board — Command-line interface problem solving; the page states that each index column is that benchmark's own published standalone score, so the runner is not asserted here.

Vals Index v2 (Vals AI) v2 → · Published board — GDP-weighted average of agentic model performance across finance, coding and legal tasks.

AutomationBench 1.0.6 v1.0.6 → · Vendor-reported by OpenAI — AutomationBench 1.0.6 score OpenAI reports for its own GPT-6 models in the 2026-09-22 GPT-6 Sol and Luna launch post.

Agents' Last Exam V1 v1 → · Vendor-reported by OpenAI — Agents' Last Exam V1 score OpenAI reports for its own GPT-6 models in the 2026-09-22 GPT-6 Sol and Luna launch post.

OSWorld 2.0 offline (v2026.08.08 release) v2026.08.08 → · Vendor-reported by OpenAI — OSWorld 2.0 offline partial reward OpenAI reports for its own GPT-6 models in the 2026-09-22 GPT-6 Sol and Luna launch post.

Tax Agent Bench published 2026-09-23 → · Published board — Tax Agent Bench results published by Vals AI.

LMArena Agent Arena (overall net improvement) published 2026-09-26 → · Published board — Ranking of models as the orchestrator in LMArena’s Agent Mode, scored by the causal net improvement over the average model across behavioural signals from real sessions.

SciCode (AA subproblems) v1.0.1 → · Published board — Tests scientific Python programming with scientist-annotated background information.

FrontierCode 1.1 Main (Cognition) v1.1 → · Codex — Whether a maintainer would merge the agent's pull request, on tasks crafted by open-source maintainers and graded with tests, rubrics and verifiers.

Code Migration (Vals Index v2 subset) v2 → · Published board — Porting projects to another language, including COBOL modernization.

Vibe Code Bench (Vals Index v2) v2 → · Published board — End-to-end app-building tasks.

DeepSWE v1.1 v1.1 → · Vendor-reported by OpenAI — DeepSWE v1.1 score OpenAI reports for its own GPT-6 models in the 2026-09-22 GPT-6 Sol and Luna launch post.

Vibe Code Bench v1.1 v1.1 → · Published board — Vibe Code Bench v1.1 results published by Vals AI.

FrontierCode 1.1 Extended (Cognition) v1.1 → · Codex — Whether a maintainer would merge the agent's pull request, on the full 150-task FrontierCode set crafted by open-source maintainers and graded with tests, rubrics and verifiers.

ProgramBench published 2026-09-23 → · Published board — ProgramBench results published by Vals AI.

Code Migration (standalone Vals board, 2026-09-22 snapshot) published 2026-09-22 → · Published board — Standalone Code Migration results published by Vals AI, distinct from its Vals Index v2 subset.

LMArena WebDev (Code Arena, overall) published 2026-09-26 → · Codex harness — Community pairwise-vote ranking of models on front-end web development tasks, including agentic multi-step coding, published by LMArena as a Bradley-Terry rating.

FrontierCode 1.1 Main cost per rollout (Cognition) v1.1 → · Codex — Cognition's published mean USD spend per rollout for each FrontierCode 1.1 Main model and reasoning effort.

Vals Index v2 cost per test (Vals AI) v2 → · Published board — Vals AI's published USD cost per test for each model on the Vals Index v2.

AutomationBench 1.0.6 cost per task v1.0.6 → · Published board — USD cost per AutomationBench 1.0.6 task OpenAI reports for its own GPT-6 models in the 2026-09-22 GPT-6 Sol and Luna launch post.

Cost to run AA Intelligence Index (total) v4.3.2 → · Published board — Cost to run AA Intelligence Index (total) results published by Artificial Analysis.

Cost per AA Intelligence Index task v4.3.2 → · Published board — Cost per AA Intelligence Index task results published by Artificial Analysis.

FrontierCode 1.1 Extended cost per rollout (Cognition) v1.1 → · Codex — Cognition's published mean USD spend per rollout for each FrontierCode 1.1 Extended model and reasoning effort.

Agents' Last Exam V1 cost per task v1 → · Published board — USD cost per Agents' Last Exam V1 task OpenAI reports for its own GPT-6 models in the 2026-09-22 GPT-6 Sol and Luna launch post.

DeepSWE v1.1 cost per task v1.1 → · Published board — USD cost per DeepSWE v1.1 task OpenAI reports for its own GPT-6 models in the 2026-09-22 GPT-6 Sol and Luna launch post.

OSWorld 2.0 offline (v2026.08.08 release) cost per task v2026.08.08 → · Published board — USD cost per OSWorld 2.0 offline (v2026.08.08 release) task OpenAI reports for its own GPT-6 models in the 2026-09-22 GPT-6 Sol and Luna launch post.

Humanity's Last Exam (AA text-only) published 2026-09-10 → · Published board — Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.

AA-Omniscience Index published 2026-09-10 → · Published board — Tests factual reliability while rewarding correct answers and penalizing hallucinations.

Legal Research Bench (Vals Index v2) v2 → · Published board — Case and statute research with citation-backed answers.

Public Benefits Bench v1.1 v1.1 → · Published board — Public Benefits Bench v1.1 results published by Vals AI.

MedScribe published 2026-09-22 → · Published board — MedScribe results published by Vals AI.

MedCode published 2026-09-22 → · Published board — MedCode results published by Vals AI.

AA-LCR v1.1 v1.1 → · Published board — Tests reasoning across multiple long documents with corrected answer keys and grading.

ArXivMath 06/2026 (MathArena) 2026-06 → · Published board — Research-level math problems with a checkable final answer, drawn from arXiv papers submitted in June 2026; each edition is restricted to papers published within the last month to reduce training-data contamination.

ArXivMath 08/2026 (MathArena) 2026-08 → · Published board — Research-level math problems with a checkable final answer, drawn from arXiv papers submitted in August 2026; each edition is restricted to papers published within the last month to reduce training-data contamination.

BrokenArXiv 06/2026 (MathArena) 2026-06 → · Published board — Plausible but false proof statements taken from June 2026 arXiv papers; a model scores by refusing to prove them and saying the statement is false as written.

BrokenArXiv 08/2026 (MathArena) 2026-08 → · Published board — Plausible but false statements taken from August 2026 arXiv papers; a model scores by refusing to prove them and saying the statement is false as written.

ProofBench v1.1 v1.1 → · Published board — ProofBench v1.1 results published by Vals AI.

IOI published 2026-09-23 → · Published board — IOI results published by Vals AI.

SAGE published 2026-09-22 → · Published board — SAGE results published by Vals AI.

LiveBench 2026-06-25 → · Published board — A periodically refreshed suite of objectively graded tasks with separate category scores and an overall category mean.

AA Intelligence Index v5.0.1 · snapshot-2026-11-04 → · Published board — Artificial Analysis Intelligence Index v5.0.1. Models AA has not rescored on v5.0.1 are listed as estimates from their frozen v4.x value (isotonic fit over the models measured on both versions), never as measurements.

CritPt (AA) published 2026-09-10 → · Published board — Tests research-level physics reasoning with Python, symbolic and numerical answers.

BioMysteryBench published 2026-09-22 → · Published board — BioMysteryBench results published by Vals AI.

AutomationBench-AA v1.0.6 → · Published board — Tests multi-app SaaS workflows through REST tools on a held-out AutomationBench split.

Excel Modeling Benchmark (Vals Index v2) v2 → · Published board — Building and editing financial models in spreadsheets.

Excel Modeling Benchmark (standalone Vals board, 2026-09-22 snapshot) published 2026-09-22 → · Published board — Standalone Excel Modeling Benchmark results published by Vals AI, distinct from its Vals Index v2 subset.

MMMU Pro (AA) published 2026-09-10 → · Published board — Tests multimodal understanding using challenging ten-option questions.

Chartography 100-tasks → · Published board — Can a model read the charts professionals rely on — Kaplan-Meier curves, candlesticks, contour maps, Sankey diagrams, Bode plots, wind roses — from the image alone, to an expert-set precision?

GDP.pdf 100-tasks → · Published board — Can a model answer real professional questions about the PDFs work runs on — manuals, wiring diagrams, filings, forms — so that every rubric criterion an expert wrote is met?

Furniture Assembly Benchmark (Epoch AI) published 2026-09-26 → · Published board — Spatial-reasoning test by Epoch AI: given a photo of a partly or fully assembled IKEA product and its official manual, the model must say whether the build is correct and, if not, name the step with the mistake.