Gemini 3.5 Flash-Lite
Output 402 tokens/sFirst token 4.9 sContext 1M tokens
Top 2 cheapest providers (Adjusted $/task)
The same list price can give a different adjusted $/task (caching, token efficiency) — click a price for its inputs.
Within the active global provider, residency and confidentiality filters.
| # | Provider | Price channel | Raw input $/1M | Raw output $/1M | Adjusted $/task |
|---|---|---|---|---|---|
| 1 | Googlevia OpenRouter — Price via OpenRouter: OpenRouter's price for Google's endpoint (https://openrouter.ai/google/gemini-3.5-flash-lite/providers), collected 2026-11-03. | via OpenRouter — Price via OpenRouter: OpenRouter's price for Google's endpoint (https://openrouter.ai/google/gemini-3.5-flash-lite/providers), collected 2026-11-03. | $0.300 | $2.50 | |
| 2 | Google Vertex AIdirect — Direct price: Google Vertex AI's own price list (https://cloud.google.com/vertex-ai/generative-ai/pricing), collected 2026-11-03. | direct — Direct price: Google Vertex AI's own price list (https://cloud.google.com/vertex-ai/generative-ai/pricing), collected 2026-11-03. | $0.300 | $2.50 |
Composite
3 of 7 inputs · 1 from the model family6 radar axes: DesignArena's two boards share one15.7
includes −10.2 for its Benchmaxxing signal (from 25.8; why, switch off in Options)
dominance-adjusted from 26.9: a better-measured model that is at least as good on each of these inputs ranks above it
Benchmaxxing signal +10.2, medium Benchmaxxing tag, uncertain: Based on only 7 comparisons and the 80 % interval reaches below zero — treat this tag as uncertain · medium report →Based on only 7 comparisons and the 80 % interval reaches below zero — treat this tag as uncertain.
AA Coding v4.x 49.3Coding Agent v1.4 —AA Intelligence 11.7AA Agentic 15.9Epoch ECI 145.0Software ECI —DesignArena —/—
Radar: percentile among all models measured on each input; a gap means not measured.
Benchmark sheet
21 of 319 registered benchmark versions · bars show the percentile among all models measured on each benchmark.
- Epoch ECI · attached
Agentic
AA-Briefcase29645 Elo
AA-Briefcase published 2026-09-10 → · Published board — Tests multi-week professional knowledge-work projects with linked tasks and large source collections.
GDPval-AA v2521,063 Elo
GDPval-AA v2 v2 → · Published board — Tests professional knowledge-work deliverables across occupations using AA's Stirrup harness.
Terminal-Bench v2.1 (AA)5353.6%
Terminal-Bench v2.1 (AA) v2.1 → · Published board — Tests terminal-based work on the 89-task verified refresh using Terminus 2.
Terminal-Bench v4.0 (AA)471.0%
Terminal-Bench v4.0 (AA) v4.0 → · Published board — Tests terminal-based work on the 66-task release using mini-SWE-agent v2.4.6.
τ²-Bench Airline (OpenRouter run)7875.7%
τ²-Bench Airline (OpenRouter run) published 2026-09-15 → · Published board — Multi-turn service agents making tool calls under strict policy constraints. (OpenRouter's own reproducible run, as published on openrouter.ai/benchmarks.)
AA Agentic Index5015.9
AA Agentic Index published 2026-09-18 → · Published board — Artificial Analysis publishes one Agentic Index per model, measured on its primary configuration and relayed by OpenRouter's Benchmarks API; the value is attached at family scope on the deterministic representative. Artificial Analysis publishes this board without a version number; we keep the date each result was retained.
Coding
SciCode (AA subproblems) v1.0.12941.3%
SciCode (AA subproblems) v1.0.1 → · Published board — Tests scientific Python programming with scientist-annotated background information.
AA Coding Index v4.x · frozen 2026-10-275649.3
AA Coding Index v4.x · frozen 2026-10-27 → · Published board — Artificial Analysis withdrew the Coding Index with Intelligence Index v5.0 (2026-10-28). These are the last v4.x values, frozen with their own date (2026-10-27).
Efficiency
GPQA Diamond (OpenRouter run) — measured cost per task40$0.037
GPQA Diamond (OpenRouter run) — measured cost per task published 2026-09-15 → · Published board — Mean USD OpenRouter actually spent per task while running GPQA Diamond for this configuration.
τ²-Bench Airline (OpenRouter run) — measured cost per task29$0.11
τ²-Bench Airline (OpenRouter run) — measured cost per task published 2026-09-15 → · Published board — Mean USD OpenRouter actually spent per task while running τ²-Bench Airline for this configuration.
Knowledge
Humanity's Last Exam (AA text-only)6918.8%
Humanity's Last Exam (AA text-only) published 2026-09-10 → · Published board — Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.
AA-Omniscience Index855.23
AA-Omniscience Index published 2026-09-10 → · Published board — Tests factual reliability while rewarding correct answers and penalizing hallucinations.
Long-context
GDP.pdf (AA)6113.6%
GDP.pdf (AA) published 2026-09-10 → · Published board — Tests professional reasoning over long PDFs with AA document preparation and grading.
AA-LCR v1.17776.0%
AA-LCR v1.1 v1.1 → · Published board — Tests reasoning across multiple long documents with corrected answer keys and grading.
MLCR-AA267.2%
MLCR-AA published 2026-09-10 → · Published board — Tests medical-record synthesis and reasoning across long, fragmented case documents.
Reasoning
AA Intelligence Index v5.0 · snapshot-2026-11-031111.7
AA Intelligence Index v5.0 · snapshot-2026-11-03 → · Published board — Artificial Analysis Intelligence Index v5.0. Models AA has not rescored on v5.0 are listed as estimates from their frozen v4.x value (isotonic fit over the models measured on both versions), never as measurements.
Science
CritPt (AA)240.0%
CritPt (AA) published 2026-09-10 → · Published board — Tests research-level physics reasoning with Python, symbolic and numerical answers.
GPQA Diamond (AA)7483.8%
GPQA Diamond (AA) published 2026-09-10 → · Published board — Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.
GPQA Diamond (OpenRouter run)6383.5%
GPQA Diamond (OpenRouter run) published 2026-09-15 → · Published board — Graduate-level science questions that resist retrieval and reward careful reasoning. (OpenRouter's own reproducible run, as published on openrouter.ai/benchmarks.)
Tool-use
AutomationBench-AA v1.0.64825.0%
AutomationBench-AA v1.0.6 → · Published board — Tests multi-app SaaS workflows through REST tools on a held-out AutomationBench split.
EnterpriseOps-Gym-AA5742.3%
EnterpriseOps-Gym-AA published 2026-09-10 → · Published board — Tests enterprise workflows through MCP tools against resettable application environments.
τ³-Banking (AA) v1.0.14917.5%
τ³-Banking (AA) v1.0.1 → · Published board — Tests banking support agents that retrieve policies and change account state through tools.
Vision
MMMU Pro (AA)8179.0%
MMMU Pro (AA) published 2026-09-10 → · Published board — Tests multimodal understanding using challenging ten-option questions.
Writing
EQ-Bench Creative Writing v3841,559 Elo
EQ-Bench Creative Writing v3 v3 → · Published board — A LLM-judged creative writing benchmark with vocabulary and GPT-slop controls.
Missing coverage · 298 benchmark versions
No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.
Token offers by platform · 5 offers (Adjusted $/task)
Click any underlined price to see how it is estimated and where each input comes from. How we calculate adjusted cost.
5 offers within the active global filters, 1 more outside them; “price n/a” means the provider serves the model but publishes no direct token price we could collect — no other channel's price is shown in its place.
OpenRouter (3)
Prices via OpenRouter — what OpenRouter charges for each provider's endpoint, not the provider's own direct price. Source: openrouter.ai/google/gemini-3.5-flash-lite/providers, collected 2026-11-03.
| globalgoogle-vertex/global | $0.300 raw in $/1M | $2.50 raw out $/1M | ||
| eugoogle-vertex/euEU | $0.330 raw in $/1M | $2.75 raw out $/1M | ||
| globalgoogle-vertex/us | $0.330 raw in $/1M | $2.75 raw out $/1M |
Google Vertex AI (2)
Direct prices from Google Vertex AI's own price list. Source: cloud.google.com/vertex-ai/generative-ai/pricing, collected 2026-11-03.
| Google Vertex AI | global | $0.300 raw in $/1M | $2.50 raw out $/1M | |
| Google Vertex AI | euEU | $0.330 raw in $/1M | $2.75 raw out $/1M |