SubQ Snap 1.2v1.7 · 10 s rule

Data: JevBench v1.8.18, published 2026-11-20 · method v1.7 (10 s rule), measured under the rule

Capability 83.8 · API offering, ranked on the API leaderboard

Last measured: 2026-11-12 · measurement release: v1.8.17

Proprietary hosted API (no weights release)

Base model: undisclosed

intelligence

75.5

calibration

92.2

speed

87.0

cost

64.8

Composite (secondary)

78.4 · Not ranked on this board

Cost and measurement conditions

$0.015 per 1,000 decisions (estimated)

SubQ's published launch tariff, USD 0.04 per million input tokens and free output (https://subq.ai/pricing, read 12 Nov 2026). Counted under the frozen I-1 launch-list-price rule, excluding promotional credits. The common 1,489-item basis uses 555,139 measured input tokens and yields USD 0.0149130691739422 per 1,000 decisions. The full 1,500-item run used 952,081 input tokens and yields USD 0.0253888266666667 per 1,000 decisions. Both figures use zero output tokens.

p50 latency: 0.4 s

none (API)

SubQ /v1/systemone API (api.subq.ai), one item per request, native probabilities; latency measured from our server in Germany.

Measured latency over 1,500 decisions: p50 0.436 s · p95 0.453 s

— decisions over 10 s.

A decision that takes longer than 10 seconds (measured time) counts as a wrong answer and as zero calibration for that item: each type's calibration is multiplied by the share of its decisions answered within 10 s. The limit uses the measured time (raw). The displayed adjusted time for self-hosted rows (2 × + 0.15 s) is an assumption and is not used for the limit.

Breakdowns (not part of the score)

Chance-corrected competence (0 = chance, 100 = perfect) by category on open+sealed. Raw values, not equated; the same cells feed the compare view.

Capability by subject topic

subject topics: not labelled for this draw yet (top-up pending)

Use cases (TypeSafe categories)

Model routing83.0n=148
Legal & compliance78.6n=56
Customer support73.4n=66
E-commerce75.3n=62
Insurance claims71.3n=62
Risk assessment71.1n=48
Financial crime64.1n=63
Feature extraction81.8n=72
Lead generation88.5n=75
Recruiting96.3n=65
Knowledge graphs94.8n=67
LLM guardrails95.2n=71
Moderation94.8n=59
Code linting91.9n=69
Search & retrieval99.4n=67
Science54.7n=42
Advertising60.8n=48
Gaming73.8n=58
Demand forecasting16.0n=66

Cells need at least 30 answered items; † fewer than 30 (indicative only; drawn as hollow, lighter points on the compare radars).

Model and serving disclosure

Measured through the SubQ hosted API on the full 27 Oct draw. Hosting implementation and deployed weights were not independently inspected. Failed or unanswered requests count as wrong answers. The hosted API returned native probabilities for all three question types and reported zero output tokens.

Published source