Devstral Medium
Context 256K tokens
Providers
No provider publishes an API price for this model yet, so no cost can be modeled.
Composite
1 of 7 inputs6 radar axes: DesignArena's two boards share one9.0
Thin data · 1/7Based on only 1 of 7 Composite inputs — treat this rank as uncertaindominance-adjusted from 11.6: a better-measured model that is at least as good on each of these inputs ranks above it
AA Coding v4.x —Coding Agent v1.4 —AA Intelligence (est.) 4.1AA Agentic —Epoch ECI —Software ECI —DesignArena —/—
Radar: percentile among all models measured on each input; a gap means not measured.
Benchmark sheet
10 of 319 registered benchmark versions · bars show the percentile among all models measured on each benchmark.
Agentic
Terminal-Bench Hard (AA)439.1%
Terminal-Bench Hard (AA) pinned revision 74221fb → · Published board — Tests a pinned 44-task hard subset of terminal-based work using Terminus 2.
Instruction-following
IFBench (AA single-turn)1429.9%
IFBench (AA single-turn) published 2026-09-10 → · Published board — Tests precise single-turn instructions with deterministic rule checks.
LisanBench word chains, v0.2.0 (Lisan al Gaib)37180.3
LisanBench word chains, v0.2.0 (Lisan al Gaib) v0.2.0 → · Published board — A model builds the longest chain of English words it can, each differing from the last by one letter, with no repeats and only dictionary words, from 50 starting words; any broken rule ends the chain.
Knowledge
Humanity's Last Exam (AA text-only)93.8%
Humanity's Last Exam (AA text-only) published 2026-09-10 → · Published board — Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.
AA-Omniscience Index53-31.6
AA-Omniscience Index published 2026-09-10 → · Published board — Tests factual reliability while rewarding correct answers and penalizing hallucinations.
Long-context
AA-LCR v1.13232.0%
AA-LCR v1.1 v1.1 → · Published board — Tests reasoning across multiple long documents with corrected answer keys and grading.
Math
AIME 2025 (AA)84.7%
AIME 2025 (AA) v2025 → · Published board — Advanced mathematical problem solving on AIME I and II 2025.
Science
CritPt (AA)240.0%
CritPt (AA) published 2026-09-10 → · Published board — Tests research-level physics reasoning with Python, symbolic and numerical answers.
GPQA Diamond (AA)2349.2%
GPQA Diamond (AA) published 2026-09-10 → · Published board — Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.
Tool-use
τ²-Bench Telecom (AA)1919.9%
τ²-Bench Telecom (AA) published 2026-09-10 → · Published board — Tests dual-control telecom agents that coordinate tool use with a simulated user.
Missing coverage · 309 benchmark versions
No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.