Microsoft-Decision-1 (Azure Foundry)

Data: JevBench v1.6.1, published 2026-10-06

Capability 70.8 · API offering, ranked on the API leaderboard · Capability rank #7 of 14 within the Jev-class caps

Measured 2026-10-10 on the full v1.6.1 set (1500 items), scored like the other full-set API rows, not equated.

Licence not stated

Base model: Qwen3.5-9Bsource · Base model disclosed by Microsoft; the Decision-1 endpoint is evaluated as a hosted API offering.

intelligence

57.2

calibration

84.4

speed

81.5

cost

61.5

Composite (secondary)

69.1 · Composite rank #6 of 27 on the API leaderboard

Cost and measurement conditions

$0.019 per 1,000 decisions (public tariff)

Advertised Azure Foundry tariff .042/M input, output free; genuine native usage, billed invoice unknown

p50 latency: 0.5 s

none (API)

Breakdowns (not part of the score)

Chance-corrected competence (0 = chance, 100 = perfect) on the full set (1500 items). Raw values, not equated. Category cells use S1200+P300+L1+L2+L3; full native Foundry union; per-type/tier cells use the original basis above. Radars against Jev.

Request typeOpenSealed
choice82.465.8
noul51.537.6
score62.745.6

Capability by subject topic

Rules, policy & law53.2n=1600
Coding & software57.4n=277
Math & numbers20.7n=459
Finance & commerce56.3n=236
Support & operations56.3n=167
Everyday language75.1n=152
Safety & security53.6n=114

Use cases (TypeSafe categories)

Model routing64.3n=400
Legal & compliance63.4n=471
Customer support60.4n=249
E-commerce52.6n=114
Insurance claims42.8n=107
Risk assessment51.2n=126
Financial crime29.0n=116
Feature extraction36.9n=96
Lead generation63.9n=114
Recruiting29.7n=98
Knowledge graphs35.5n=98
LLM guardrails69.7n=101
Moderation67.2n=98
Code linting19.8n=96
Search & retrieval85.3n=97
Science36.9n=97
Advertising37.0n=107
Gaming25.1n=90
Demand forecasting0.0n=88

Cells need at least 15 answered items; † fewer than 30 (indicative only, listed below the radar in the compare view).

Published source