Mistral Small 3

open weightsdeprecated by benchmark source

Mistral · released 2025-01-30 · 1 offer

Context 32K tokens

Top 1 cheapest providers (Adjusted $/task)

Within the active global provider, residency and confidentiality filters.

#	Provider	Price channel	Raw input $/1M	Raw output $/1M	Adjusted $/task
1	DeepInfravia OpenRouter — Price via OpenRouter: OpenRouter's price for DeepInfra's endpoint (https://openrouter.ai/mistralai/mistral-small-24b-instruct-2501/providers), collected 2026-11-03.	via OpenRouter — Price via OpenRouter: OpenRouter's price for DeepInfra's endpoint (https://openrouter.ai/mistralai/mistral-small-24b-instruct-2501/providers), collected 2026-11-03.	$0.050	$0.080

Composite

1 of 7 inputs6 radar axes: DesignArena's two boards share one

2.7

Thin data · 1/7

dominance-adjusted from 5.0: a better-measured model that is at least as good on each of these inputs ranks above it

AA Coding v4.x —Coding Agent v1.4 —AA Intelligence (est.) 2.8AA Agentic —Epoch ECI —Software ECI —DesignArena —/—

Radar: percentile among all models measured on each input; a gap means not measured.

Benchmark sheet

12 of 319 registered benchmark versions · bars show the percentile among all models measured on each benchmark.

Compare this model →

Agentic

Elimination Game Benchmark3332026-09-10
Elimination Game Benchmark published 2026-09-10 → · Published board — Multi-player tournament where 8 LLM players converse, form alliances, and vote to eliminate each other, with final rankings scored via TrueSkill.

Instruction-following

IFBench (AA single-turn)926.4%2026-09-10
IFBench (AA single-turn) published 2026-09-10 → · Published board — Tests precise single-turn instructions with deterministic rule checks.

Knowledge

Humanity's Last Exam (AA text-only)103.8%2026-09-10
Humanity's Last Exam (AA text-only) published 2026-09-10 → · Published board — Tests expert-level knowledge on AA's text-only Humanity's Last Exam subset.
UGI NatInt4425.92026-09-10
UGI NatInt published 2026-09-10 → · Published board — A private-question evaluation of general knowledge and reasoning across textbook, popular-culture and world-model topics.

Long-context

AA-LCR v1.160.0%2026-09-10
AA-LCR v1.1 v1.1 → · Published board — Tests reasoning across multiple long documents with corrected answer keys and grading.

Math

AIME 2025 (AA)74.3%2026-09-10
AIME 2025 (AA) v2025 → · Published board — Advanced mathematical problem solving on AIME I and II 2025.

Science

GPQA Diamond (AA)2046.2%2026-09-10
GPQA Diamond (AA) published 2026-09-10 → · Published board — Tests graduate-level biology, physics and chemistry knowledge on the Diamond subset.

Tool-use

τ²-Bench Telecom (AA)1819.6%2026-09-10
τ²-Bench Telecom (AA) published 2026-09-10 → · Published board — Tests dual-control telecom agents that coordinate tool use with a simulated user.

Uncensored

UGI Willingness936.502026-09-10
UGI Willingness published 2026-09-10 → · Published board — A private-question evaluation of how far a model follows challenging instructions before refusing or deviating.
UGI5939.02026-09-10
UGI published 2026-09-10 → · Published board — A private-question suite combining sensitive-topic knowledge with willingness to follow controversial instructions.

Writing

EQ-Bench Creative Writing v37705 Elo2026-10-26
EQ-Bench Creative Writing v3 v3 → · Published board — A LLM-judged creative writing benchmark with vocabulary and GPT-slop controls.
UGI Writing4633.92026-09-10
UGI Writing published 2026-09-10 → · Published board — A maintainer-owned writing evaluation considering intelligence, style, repetition and length adherence, informed by human preferences.

Unusual results

1 threshold-crossing signal flagged · 11 eligible benchmark families

How flags are calculated

Heuristic screen, not statistical significance: benchmark families are correlated and source uncertainty is unknown. Peer evidence needs ≥ 20 independently measured matched configurations from ≥ 10 distinct model families. A flag needs a directed population z-score of magnitude ≥ 1.5 and a gap of ≥ 1.5 from the leave-one-benchmark-family-out mean z in the same direction, over ≥ 5 other benchmark families.

unusually strong UGI Willingness published 2026-09-10
Why
Observed: 6.5 score
Peer mean 3.508 · peer sd 1.7212 · n 100 · families 84
Directed z 1.738 · baseline z -0.904 · gap 2.642 · profile n 10
6.5 scoremeasuredobserved 2026-09-10huggingface.co ↗
Evidence
Axis: UGI Willingness · published 2026-09-10 · Published board
Exact value: 6.5 score
Observed: 2026-09-10T22:04:13Z · publication date: not recorded
Observation id: public:ce59f910e91d546d06cb48d4
Source: https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard/raw/main/ugi-leaderboard-data.csv
Exact observation and full protocol ↗

Missing coverage · 307 benchmark versions

No result does not mean a zero, or that the model was never tested. Collection failures and disputed versions retain their distinct status.

Token offers by platform · 1 offer (Adjusted $/task)

Click any underlined price to see how it is estimated and where each input comes from. How we calculate adjusted cost.

1 offer within the active global filters; “price n/a” means the provider serves the model but publishes no direct token price we could collect — no other channel's price is shown in its place.

OpenRouter (1)

Prices via OpenRouter — what OpenRouter charges for each provider's endpoint, not the provider's own direct price. Source: openrouter.ai/mistralai/mistral-small-24b-instruct-2501/providers, collected 2026-11-03.

DeepInfra