Gemini 3 Pro Preview (High)
Context 1M tokens
Providers
No provider publishes an API price for this model yet, so no cost can be modeled.
Composite
3 of 7 inputs · 2 from the model family6 radar axes: DesignArena's two boards share one36.9
AA Coding v4.x —Coding Agent v1.4 —AA Intelligence (est.) 17.6AA Agentic —Epoch ECI —Software ECI —DesignArena 1101/1074
Radar: percentile among all models measured on each input; a gap means not measured.
Benchmark sheet
13 of 319 registered benchmark versions · bars show the percentile among all models measured on each benchmark.
- DesignArena Web Apps (agentic) · attached
- DesignArena Full-Stack · attached
Agentic
Terminal-Bench Hard (AA)8841.7%
Terminal-Bench Hard (AA) pinned revision 74221fb → · Published board — Tests a pinned 44-task hard subset of terminal-based work using Terminus 2.
Coding
DesignArena Web Apps (agentic)151,101 Elo
DesignArena Web Apps (agentic) published 2026-11-03 → · Published board — Published Elo. Exact source attachment is retained; fewer than 200 battles excludes a row from radar normalization and anomaly peers.
DesignArena Full-Stack271,074 Elo
DesignArena Full-Stack published 2026-11-03 → · Published board — Published Elo. Exact source attachment is retained; fewer than 200 battles excludes a row from radar normalization and anomaly peers.
Instruction-following
IFBench (AA single-turn)8570.4%
IFBench (AA single-turn) published 2026-09-10 → · Published board — Tests precise single-turn instructions with deterministic rule checks.
LisanBench word chains, v0.2.0 (Lisan al Gaib)844,677
LisanBench word chains, v0.2.0 (Lisan al Gaib) v0.2.0 → · Published board — A model builds the longest chain of English words it can, each differing from the last by one letter, with no repeats and only dictionary words, from 50 starting words; any broken rule ends the chain.
Knowledge
Humanity's Last Exam (AA text-only)9039.7%
Humanity's Last Exam (AA text-only) published 2026-09-10 → · Published board — Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.
AA-Omniscience Index8915.3
AA-Omniscience Index published 2026-09-10 → · Published board — Tests factual reliability while rewarding correct answers and penalizing hallucinations.
Long-context
AA-LCR v1.17776.0%
AA-LCR v1.1 v1.1 → · Published board — Tests reasoning across multiple long documents with corrected answer keys and grading.
Math
AIME 2025 (AA)9895.7%
AIME 2025 (AA) v2025 → · Published board — Advanced mathematical problem solving on AIME I and II 2025.
Safety/Alignment
BullshitBench V1 (clear pushback)4323.6%
BullshitBench V1 (clear pushback) published 2026-09-10 → · Published board — Whether a model rejects the broken premise of 55 deliberately nonsensical prompts (V1 question set) instead of answering them confidently.
BullshitBench V2 (clear pushback)4536.0%
BullshitBench V2 (clear pushback) published 2026-09-10 → · Published board — Whether a model rejects the broken premise of 100 deliberately nonsensical prompts (V2 question set) instead of answering them confidently.
Science
CritPt (AA)829.1%
CritPt (AA) published 2026-09-10 → · Published board — Tests research-level physics reasoning with Python, symbolic and numerical answers.
GPQA Diamond (AA)9190.8%
GPQA Diamond (AA) published 2026-09-10 → · Published board — Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.
Tool-use
τ²-Bench Telecom (AA)8187.1%
τ²-Bench Telecom (AA) published 2026-09-10 → · Published board — Tests dual-control telecom agents that coordinate tool use with a simulated user.
Vision
MMMU Pro (AA)8580.2%
MMMU Pro (AA) published 2026-09-10 → · Published board — Tests multimodal understanding using challenging ten-option questions.
Missing coverage · 306 benchmark versions
No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.
Variants / reasoning settings
Artificial Analysis snapshot 2026-11-03 · Intelligence Index v5.0 (est. = estimated from v4, not measured) · Coding Index v4.x frozen 2026-10-27 · Data: Artificial Analysis · Data: Epoch AI (CC BY)
| Variant | AA Coding | AA Intelligence |
|---|---|---|
| Gemini 3 Pro Preview (High) | — | 17.6est. |
| Gemini 3 Pro Preview (Low) | — | 11.7est. |