DeepSeek R1 0528 Qwen3 8B
Context 33K tokens
Providers
No provider publishes an API price for this model yet, so no cost can be modeled.
Composite
1 of 7 inputs6 radar axes: DesignArena's two boards share one5.9
Thin data · 1/7Based on only 1 of 7 Composite inputs — treat this rank as uncertaindominance-adjusted from 9.0: a better-measured model that is at least as good on each of these inputs ranks above it
AA Coding v4.x —Coding Agent v1.4 —AA Intelligence (est.) 3.6AA Agentic —Epoch ECI —Software ECI —DesignArena —/—
Radar: percentile among all models measured on each input; a gap means not measured.
Benchmark sheet
11 of 319 registered benchmark versions · bars show the percentile among all models measured on each benchmark.
Agentic
Terminal-Bench Hard (AA)161.5%
Terminal-Bench Hard (AA) pinned revision 74221fb → · Published board — Tests a pinned 44-task hard subset of terminal-based work using Terminus 2.
Instruction-following
IFBench (AA single-turn)219.9%
IFBench (AA single-turn) published 2026-09-10 → · Published board — Tests precise single-turn instructions with deterministic rule checks.
Knowledge
Humanity's Last Exam (AA text-only)375.9%
Humanity's Last Exam (AA text-only) published 2026-09-10 → · Published board — Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.
AA-Omniscience Index13-63.6
AA-Omniscience Index published 2026-09-10 → · Published board — Tests factual reliability while rewarding correct answers and penalizing hallucinations.
Long-context
AA-LCR v1.11915.0%
AA-LCR v1.1 v1.1 → · Published board — Tests reasoning across multiple long documents with corrected answer keys and grading.
Math
AIME 2025 (AA)6063.7%
AIME 2025 (AA) v2025 → · Published board — Advanced mathematical problem solving on AIME I and II 2025.
Reasoning
Chess Puzzles (Epoch AI)153.0%
Chess Puzzles (Epoch AI) published 2026-09-18 → · Published board — Best-move selection on 100 novel chess positions generated programmatically by Epoch AI, each with a single Stockfish-verified best move; probes spatial reasoning and planning.
Science
CritPt (AA)240.0%
CritPt (AA) published 2026-09-10 → · Published board — Tests research-level physics reasoning with Python, symbolic and numerical answers.
GPQA Diamond (AA)3661.2%
GPQA Diamond (AA) published 2026-09-10 → · Published board — Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.
GPQA Diamond (Epoch AI run)09.3%
GPQA Diamond (Epoch AI run) published 2026-09-18 → · Published board — Epoch AI's own inspect-ai runs of GPQA Diamond, the 198-question graduate-level science multiple-choice set.
Tool-use
τ²-Bench Telecom (AA)30.0%
τ²-Bench Telecom (AA) published 2026-09-10 → · Published board — Tests dual-control telecom agents that coordinate tool use with a simulated user.
Unusual results
1 threshold-crossing signal flagged · 11 eligible benchmark families
How flags are calculated
Heuristic screen, not statistical significance: benchmark families are correlated and source uncertainty is unknown. Peer evidence needs ≥ 20 independently measured matched configurations from ≥ 10 distinct model families. A flag needs a directed population z-score of magnitude ≥ 1.5 and a gap of ≥ 1.5 from the leave-one-benchmark-family-out mean z in the same direction, over ≥ 5 other benchmark families.
- unusually weak GPQA Diamond (Epoch AI run) published 2026-09-18
Why
Observed: 0.0928 fractionPeer mean 0.76508 · peer sd 0.23551 · n 63 · families 49Directed z -2.855 · baseline z -0.885 · gap -1.969 · profile n 100.0928 fractionmeasuredobserved 2026-09-18epoch.ai ↗Evidence
Axis: GPQA Diamond (Epoch AI run) · published 2026-09-18 · Published boardExact value:0.0928030303030303fractionObserved: 2026-09-18T23:49:00Z · publication date: not recordedObservation id:public:340c76070a29b7a2454f34d0
Missing coverage · 308 benchmark versions
No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.