Benchmark Heaven
Price & provider filters · adjusted costs
Global
Applies to price views & model offers; benchmark evidence stays unfiltered
← All models

MiMo-V2.5-Pro

open weights★ featured
Xiaomi · released 2026-04-22 · 7 recorded token offers

Top 5 cheapest providers (Adjusted $/task)

Within the active global provider, residency and confidentiality filters.

#ProviderPlatformRaw input $/1MRaw output $/1MAdjusted $/task
1GMICloudOpenRouter$0.304$0.609
2DeepInfraOpenRouter$0.390$1.17
3DigitalOceanOpenRouter$0.400$1.50
4AtlasCloudOpenRouter$0.435$0.870
5NovitaOpenRouter$0.480$0.960

Benchmarks

Composite60.1
Mean-imputed base69.2
Dominance adjustment-9.1
Composite evidence2/5
AA Coding · unversioned snapshot 2026-09-1060.2
AA Coding Agent · v1.4 · 2026-09-09
AA Intelligence · unversioned snapshot 2026-09-1026.4
DesignArena Frontend · unversioned snapshot 2026-09-10
DesignArena Full-Stack · unversioned snapshot 2026-09-10
Output speed (t/s)39

MODEL EVIDENCE

Benchmark sheet

21 / 73 registered benchmark versions covered · 23 observations including existing index snapshots.

Compare this model ↗
Composite retains Coding Agent v1.4 · source 2026-09-09

The five Composite inputs remain unchanged. Its Coding Agent input is the median across complete harness results in the retained v1.4 snapshot from 2026-09-09. Artificial Analysis now publishes v1.5, with different components. Explore current v1.5 separately. Dated snapshot labels on other indices identify unversioned source captures, not a verified semantic version.

Profile signals

2 threshold-crossing signals flagged · 22 eligible benchmark families

How flags are calculated

Heuristic screen, not statistical significance: benchmark families are correlated and source uncertainty is unknown. Peer evidence needs ≥ 20 independently measured matched configurations from ≥ 10 distinct model families. A flag needs a directed population z-score of magnitude ≥ 1.5 and a gap of ≥ 1.5 from the leave-one-benchmark-family-out mean z in the same direction, over ≥ 5 other benchmark families.

  • unusually weak APEX-Agents-AA snapshot-2026-09-10
    Why
    Observed: 0.02434 fraction
    Peer mean 0.22694 · peer sd 0.12479 · n 30 · families 30
    Directed z -1.624 · baseline z 0.416 · gap -2.039 · profile n 21
    0.02434 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
    Evidence
    Axis: APEX-Agents-AA · snapshot-2026-09-10 · Published board
    Exact value: 0.0243362831858407 fraction
    Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
    Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:apexAgents
  • unusually strong IFBench (AA single-turn) snapshot-2026-09-10
    Why
    Observed: 0.79864 fraction
    Peer mean 0.48006 · peer sd 0.17139 · n 450 · families 331
    Directed z 1.859 · baseline z 0.25 · gap 1.609 · profile n 21
    0.79864 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
    Evidence
    Axis: IFBench (AA single-turn) · snapshot-2026-09-10 · Published board
    Exact value: 0.798639455782313 fraction
    Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
    Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:ifbench

Protocol-compatible measured/vendor divergences

No verified protocol-compatible vendor/measured pair is available for this model; agreement cannot be assessed.

Agentic

Agentic: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
AA-AnalystAgent

Version snapshot-2026-09-10

Published board

Tests analyst tasks using agentic Python execution across fourteen domains.

0.2 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA-AnalystAgent · snapshot-2026-09-10 · Published board
Exact value: 0.2 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:analystAgent
APEX-Agents-AA

Version snapshot-2026-09-10

Published board

Tests professional-service tasks that require agents to produce locally graded deliverables.

0.02434 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: APEX-Agents-AA · snapshot-2026-09-10 · Published board
Exact value: 0.0243362831858407 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:apexAgents
AA-Briefcase

Version snapshot-2026-09-10

Published board

Tests multi-week professional knowledge-work projects with linked tasks and large source collections.

883.43 Elomeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA-Briefcase · snapshot-2026-09-10 · Published board
Exact value: 883.43 Elo
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:briefcaseBreakdown.overall.elo
GDPval-AA v2

Version 2

Published board

Tests professional knowledge-work deliverables across occupations using AA's Stirrup harness.

1186.32 Elomeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: GDPval-AA v2 · 2 · Published board
Exact value: 1186.32 Elo
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:gdpval
Harvey LAB-AA

Version snapshot-2026-09-10

Published board

Tests legal-work deliverables across practice areas on Harvey's private task set.

0.73252 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: Harvey LAB-AA · snapshot-2026-09-10 · Published board
Exact value: 0.732522796352584 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:harveyLab
ITBench-AA

Version snapshot-2026-09-10

Published board

Tests root-cause diagnosis from offline Kubernetes incident snapshots.

0.3823 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: ITBench-AA · snapshot-2026-09-10 · Published board
Exact value: 0.382297551789077 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:itBenchSre
Terminal-Bench Hard (AA)

Version 74221fb

Published board

Tests a pinned 44-task hard subset of terminal-based work using Terminus 2.

0.43182 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: Terminal-Bench Hard (AA) · 74221fb · Published board
Exact value: 0.431818181818182 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:terminalbenchHard
Terminal-Bench v2.1 (AA)

Version 2.1

Published board

Tests terminal-based work on the 89-task verified refresh using Terminus 2.

0.65169 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: Terminal-Bench v2.1 (AA) · 2.1 · Published board
Exact value: 0.651685393258427 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:terminalbenchV21
Terminal-Bench v4.0 (AA)

Version 4.0

Published board

Tests terminal-based work on the 66-task release using mini-SWE-agent v2.4.6.

0 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: Terminal-Bench v4.0 (AA) · 4.0 · Published board
Exact value: 0 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:terminalbenchV40

Coding

Coding: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
SciCode (AA subproblems)

Version 1.0.1

Published board

Tests scientific Python programming with scientist-annotated background information.

0.50579 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: SciCode (AA subproblems) · 1.0.1 · Published board
Exact value: 0.505787037037037 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:scicode
AA Coding Index

Version snapshot-2026-09-10 (unversioned)

Published board

Published AA index from the retained API snapshot. No verified semantic version was supplied.

60.2 pointsmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA Coding Index · snapshot-2026-09-10 (unversioned) · Published board
Exact value: 60.2 points
Observed: 2026-09-10 · publication date: not recorded
Observation id: legacy:aa_coding_index:mimo-v2.5-pro::default
Protocol: inspect · file data/raw/artificialanalysis.json

Instruction-following

Instruction-following: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
IFBench (AA single-turn)

Version snapshot-2026-09-10

Published board

Tests precise single-turn instructions with deterministic rule checks.

0.79864 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: IFBench (AA single-turn) · snapshot-2026-09-10 · Published board
Exact value: 0.798639455782313 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:ifbench

Knowledge

Knowledge: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
Humanity's Last Exam (AA text-only)

Version snapshot-2026-09-10

Published board

Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.

0.35681 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: Humanity's Last Exam (AA text-only) · snapshot-2026-09-10 · Published board
Exact value: 0.356811862835959 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:hle
AA-Omniscience Index

Version snapshot-2026-09-10

Published board

Tests factual reliability while rewarding correct answers and penalizing hallucinations.

3.25 pointsmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA-Omniscience Index · snapshot-2026-09-10 · Published board
Exact value: 3.25 points
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:omniscience

Long-context

Long-context: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
GDP.pdf (AA)

Version snapshot-2026-09-10

Published board

Tests professional reasoning over long PDFs with AA document preparation and grading.

0.04 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: GDP.pdf (AA) · snapshot-2026-09-10 · Published board
Exact value: 0.04 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:gdpPdfAllPass
AA-LCR v1.1

Version 1.1

Published board

Tests reasoning across multiple long documents with corrected answer keys and grading.

0.79667 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA-LCR v1.1 · 1.1 · Published board
Exact value: 0.796666666666667 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:lcr
MLCR-AA

Version snapshot-2026-09-10

Published board

Tests medical-record synthesis and reasoning across long, fragmented case documents.

0.09444 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: MLCR-AA · snapshot-2026-09-10 · Published board
Exact value: 0.0944444444444444 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:mlcrOverall

Reasoning

Reasoning: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
AA Intelligence Index

Version snapshot-2026-09-10 (unversioned)

Published board

Published AA index from the retained API snapshot. No verified semantic version was supplied.

26.4 pointsmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AA Intelligence Index · snapshot-2026-09-10 (unversioned) · Published board
Exact value: 26.4 points
Observed: 2026-09-10 · publication date: not recorded
Observation id: legacy:aa_intelligence_index:mimo-v2.5-pro::default
Protocol: inspect · file data/raw/artificialanalysis.json

Science

Science: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
CritPt (AA)

Version snapshot-2026-09-10

Published board

Tests research-level physics reasoning with Python, symbolic and numerical answers.

0.04 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: CritPt (AA) · snapshot-2026-09-10 · Published board
Exact value: 0.04 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:critpt
GPQA Diamond (AA)

Version snapshot-2026-09-10

Published board

Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.

0.86566 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: GPQA Diamond (AA) · snapshot-2026-09-10 · Published board
Exact value: 0.865656565656566 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:gpqa

Tool-use

Tool-use: every observation for this exact model configuration
Benchmark / versionEvaluation groupScore / provenance
AutomationBench-AA

Version 1.0.6

Published board

Tests multi-app SaaS workflows through REST tools on a held-out AutomationBench split.

0.13704 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: AutomationBench-AA · 1.0.6 · Published board
Exact value: 0.13703616508004313 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:automationBenchPartialScore
τ²-Bench Telecom (AA)

Version snapshot-2026-09-10

Published board

Tests dual-control telecom agents that coordinate tool use with a simulated user.

0.94152 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: τ²-Bench Telecom (AA) · snapshot-2026-09-10 · Published board
Exact value: 0.941520467836257 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:tau2
τ³-Banking (AA)

Version 1.0.1

Published board

Tests banking support agents that retrieve policies and change account state through tools.

0.09897 fractionmeasuredobserved 2026-09-10artificialanalysis.ai
Evidence
Axis: τ³-Banking (AA) · 1.0.1 · Published board
Exact value: 0.0989690721649484 fraction
Observed: 2026-09-10T21:47:16.627Z · publication date: not recorded
Observation id: aa:00f1248e-78e3-4230-8dc8-5e13ba8645e2:tauBanking
Missing coverage · 54 benchmark versions

No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.

Variants / reasoning settings

VariantCoding · snapshot 2026-09-10Intelligence · snapshot 2026-09-10
MiMo-V2.5-Pro60.226.4
MiMo-V2.5-Pro (Non-reasoning)18.3

Token offers by platform — Adjusted $/task

Adjusted costs are modeled USD per task: AA output tokens × OpenRouter usage I/O (Chutes global fallback). These are general usage and benchmark proxies for coding-agent work. Missing AA data assumes 1,000 output tokens/task; unknown cache hit assumes 0%; unmeasured additional cache writes assume 0 tokens. Click any underlined price for exact inputs, dates and assumptions. Raw list prices use the selected fixed input/output blend, in USD per million tokens.

5 offers within the active global filters; “—” means the catalog is active but no public token price is available.

OpenRouter (5)

GMICloudglobalgmicloud/bf16$0.304 raw in $/1M$0.609 raw out $/1M
DeepInfraglobaldeepinfra/fp8$0.390 raw in $/1M$1.17 raw out $/1M
DigitalOceanglobaldigitalocean$0.400 raw in $/1M$1.50 raw out $/1M
Novitaglobalnovita$0.480 raw in $/1M$0.960 raw out $/1M
AtlasCloudglobalatlas-cloud/fp8$0.435 raw in $/1M$0.870 raw out $/1M
Benchmark Heaven — Model benchmarks & costs