Mistral Large 2 (Nov '24)
Context 128K tokens
Providers
No provider publishes an API price for this model yet, so no cost can be modeled.
Composite
1 of 7 inputs6 radar axes: DesignArena's two boards share one4.9
Thin data · 1/7Based on only 1 of 7 Composite inputs — treat this rank as uncertaindominance-adjusted from 7.5: a better-measured model that is at least as good on each of these inputs ranks above it
AA Coding v4.x —Coding Agent v1.4 —AA Intelligence (est.) 3.3AA Agentic —Epoch ECI —Software ECI —DesignArena —/—
Radar: percentile among all models measured on each input; a gap means not measured.
Benchmark sheet
13 of 319 registered benchmark versions · bars show the percentile among all models measured on each benchmark.
Agentic
Terminal-Bench Hard (AA)346.1%
Terminal-Bench Hard (AA) pinned revision 74221fb → · Published board — Tests a pinned 44-task hard subset of terminal-based work using Terminus 2.
Instruction-following
IFBench (AA single-turn)1631.2%
IFBench (AA single-turn) published 2026-09-10 → · Published board — Tests precise single-turn instructions with deterministic rule checks.
Knowledge
Humanity's Last Exam (AA text-only)43.3%
Humanity's Last Exam (AA text-only) published 2026-09-10 → · Published board — Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.
AA-Omniscience Index51-34.4
AA-Omniscience Index published 2026-09-10 → · Published board — Tests factual reliability while rewarding correct answers and penalizing hallucinations.
UGI NatInt6536.2
UGI NatInt published 2026-09-10 → · Published board — A private-question evaluation of general knowledge and reasoning across textbook, popular-culture and world-model topics.
Math
AIME 2025 (AA)1714.0%
AIME 2025 (AA) v2025 → · Published board — Advanced mathematical problem solving on AIME I and II 2025.
Science
CritPt (AA)240.0%
CritPt (AA) published 2026-09-10 → · Published board — Tests research-level physics reasoning with Python, symbolic and numerical answers.
GPQA Diamond (AA)2348.6%
GPQA Diamond (AA) published 2026-09-10 → · Published board — Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.
Tool-use
τ²-Bench Telecom (AA)3830.7%
τ²-Bench Telecom (AA) published 2026-09-10 → · Published board — Tests dual-control telecom agents that coordinate tool use with a simulated user.
Uncensored
UGI Willingness997.50
UGI Willingness published 2026-09-10 → · Published board — A private-question evaluation of how far a model follows challenging instructions before refusing or deviating.
UGI9759.2
UGI published 2026-09-10 → · Published board — A private-question suite combining sensitive-topic knowledge with willingness to follow controversial instructions.
Writing
BuzzBench6047.5
BuzzBench published 2026-09-10 → · Published board — An LLM-judged evaluation of humour explanation and predicted audience response to Never Mind the Buzzcocks introductions.
UGI Writing5737.8
UGI Writing published 2026-09-10 → · Published board — A maintainer-owned writing evaluation considering intelligence, style, repetition and length adherence, informed by human preferences.
Unusual results
2 threshold-crossing signals flagged · 12 eligible benchmark families
How flags are calculated
Heuristic screen, not statistical significance: benchmark families are correlated and source uncertainty is unknown. Peer evidence needs ≥ 20 independently measured matched configurations from ≥ 10 distinct model families. A flag needs a directed population z-score of magnitude ≥ 1.5 and a gap of ≥ 1.5 from the leave-one-benchmark-family-out mean z in the same direction, over ≥ 5 other benchmark families.
- unusually strong UGI Willingness published 2026-09-10
Why
Observed: 7.5 scorePeer mean 3.508 · peer sd 1.7212 · n 100 · families 84Directed z 2.319 · baseline z -0.382 · gap 2.702 · profile n 117.5 scoremeasuredobserved 2026-09-10huggingface.co ↗Evidence
Axis: UGI Willingness · published 2026-09-10 · Published boardExact value:7.5scoreObserved: 2026-09-10T22:04:13Z · publication date: not recordedObservation id:public:fdb351ab0607844ad19b022a - unusually strong UGI published 2026-09-10
Why
Observed: 59.23 scorePeer mean 35.1234 · peer sd 14.30074 · n 100 · families 84Directed z 1.686 · baseline z -0.325 · gap 2.01 · profile n 1159.23 scoremeasuredobserved 2026-09-10huggingface.co ↗Evidence
Axis: UGI · published 2026-09-10 · Published boardExact value:59.23scoreObserved: 2026-09-10T22:04:13Z · publication date: not recordedObservation id:public:f3755fde6338cdeafe3032c6
Missing coverage · 306 benchmark versions
No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.