o1-mini

WeirdML v2 → · Published board — Presents LLMs with unusual machine-learning tasks where they must write, run, and iteratively improve PyTorch code under fixed compute and time limits.

Humanity's Last Exam (AA text-only) published 2026-09-10 → · Published board — Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.

LLM Divergent Thinking Creativity Benchmark published 2026-09-10 → · Published board — Models generate 25 words maximally distinct from each other and from 50 seed words under starting-letter constraints, scored by LLM-judged word divergence.

ARC-AGI-1 v1 → · Published board — The first-generation ARC-AGI benchmark measuring passive fluid intelligence, with leaderboard score plotted against cost-per-task.

ARC-AGI-2 v2 → · Published board — The second-generation ARC-AGI benchmark of passive fluid intelligence, with leaderboard score plotted against cost-per-task.

SimpleBench published 2026-09-10 → · Published board — A multiple-choice text benchmark of over 200 questions covering spatio-temporal reasoning, social intelligence, and linguistic adversarial robustness, on which a non-specialized human baseline outperforms every tested LLM.

SimpleBench published 2026-09-26 → · Published board — A multiple-choice text benchmark of over 200 questions covering spatio-temporal reasoning, social intelligence, and linguistic adversarial robustness, on which a non-specialized human baseline outperforms every tested LLM.

GPQA Diamond (AA) published 2026-09-10 → · Published board — Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.

BuzzBench published 2026-09-10 → · Published board — An LLM-judged evaluation of humour explanation and predicted audience response to Never Mind the Buzzcocks introductions.