wity-1 (Wity, reasoning always)v1.7 · 10 s rule

Data: JevBench v1.8.18, published 2026-11-20 · method v1.7 (10 s rule), re-scored from the recorded per-decision times

Capability 77.1 · API offering, listed but not ranked on the API leaderboard

registry ranked=false or no composite

Last measured: 2026-10-06 · measurement release: v1.6.1

proprietary hosted API

Base model: undisclosed

intelligence

67.1

calibration

87.1

speed

68.5

cost

58.8

Composite (secondary)

69.0 · Not ranked on this board

Cost and measurement conditions

$0.024 per 1,000 decisions (public list price)

Wity's stated API tariff USD 0.042 per 1M input tokens, output free; measured on the v1.6.1 common cost basis (all items except those outside the Jev reference input range) from this run's token usage

p50 latency: 1.9 s

none (API)

operator's hosted production API, measured as is; API default is off, our request sets reasoning=always; labelled configuration variant.

Measured latency over 1,500 decisions: p50 1.907 s · p95 7.387 s

36 decisions over 10 s (36 of them answered without error, counted as wrong).

A decision that takes longer than 10 seconds (measured time) counts as a wrong answer and as zero calibration for that item: each type's calibration is multiplied by the share of its decisions answered within 10 s. The limit uses the measured time (raw). The displayed adjusted time for self-hosted rows (2 × + 0.15 s) is an assumption and is not used for the limit.

Breakdowns (not part of the score)

Chance-corrected competence (0 = chance, 100 = perfect) by category on S+P+L1+L2+L3. Raw values, not equated; the same cells feed the compare view.

Capability by subject topic

Rules, policy & law50.2n=1616
Coding & software67.6n=382
Math & numbers48.3n=370
Finance & commerce51.9n=223
Support & operations41.1n=160
Everyday language86.1n=145
Safety & security62.6n=109

Use cases (TypeSafe categories)

Model routing72.2n=524
Legal & compliance66.9n=515
Customer support55.4n=240
E-commerce45.2n=119
Insurance claims48.8n=119
Risk assessment70.7n=118
Financial crime48.5n=101
Feature extraction53.9n=99
Lead generation50.6n=95
Recruiting21.9n=94
Knowledge graphs10.3n=94
LLM guardrails34.0n=93
Moderation58.2n=93
Code linting39.6n=90
Search & retrieval72.0n=90
Science22.2n=90
Advertising34.2n=88
Gaming11.6n=86
Demand forecasting50.4n=83

Cells need at least 30 answered items; † fewer than 30 (indicative only; drawn as hollow, lighter points on the compare radars).

JevBench v1.6.43 values (method v1.6, before the 10 s rule)

Capability 79.25 · Composite 70.56

intelligence 69.25 · calibration 89.25 · speed 71.20 · cost 58.83

v1.6 speed basis (124 items): p50 1.689 s · p95 4.489 s

These figures are kept for comparison. The current figures above are re-scored under the 10 s rule from the recorded per-decision times and replace them.

Published source