Strike-1v1.7 · 10 s rule
Data: JevBench v1.7.23, published 2026-10-29 · method v1.7 (10 s rule), measured under the rule
Capability 68.4 · API offering, listed but not ranked on the API leaderboard
Measured on the 27 Oct 2026 draw, which is not yet equated to the reference scale; stronger anchor runs for that draw are being measured. Shown unranked until then.
Last measured: 2026-10-28 · measurement release: v1.7.16
Licence not stated
intelligence
45.3
calibration
91.4
speed
83.3
cost
54.1
Composite (secondary)
51.8 · Not ranked on this board
Cost and measurement conditions
$0.034 per 1,000 decisions (estimated)
ESTIMATE (*est.), hosted API without a counted list price: the vendor's stated base Qwen/Qwen3.5-4B at its market reference deepinfra:Qwen/Qwen3.5-4B, USD 0.03 per million input tokens and USD 0.15 per million output tokens (frozen pricing module sha256 645fd82eac728d597048bec0995ecd3ac896566e269fb6c9a1fdb84c171a9ac4), x the vendor-reported usage: 1,687,022 input tokens and 0 output tokens on the 1,489 common items (output 0 as reported: no text is generated). COST FIGURES: USD 0.033990 per 1,000 decisions, 0.53x the official cost cap USD 0.064595. Cost on the 1,489 items every row on this draw answered (same-items rule); all-items cost USD 0.033853 per 1,000 decisions. Estimated model tariff, not charged usage or a host quote; the vendor reported no charge for these requests.
p50 latency: 0.5 s
none (API)
Vendor-hosted API in the EU (OVH Gravelines, France), native /v1/systemone; latency measured from our server in Germany. 1,495 of 1,500 requests answered (HTTP 200, served model strike-1 on every answer); 5 were refused by the server because the input exceeded its limit (8,192 tokens or 32,000 characters) and are scored as misses; no decision took longer than 10 s.
Measured latency over 1,500 decisions: p50 0.475 s · p95 0.987 s
0 decisions over 10 s.
A decision that takes longer than 10 seconds (measured time) counts as a wrong answer and as zero calibration for that item: each type's calibration is multiplied by the share of its decisions answered within 10 s. The limit uses the measured time (raw). The displayed adjusted time for self-hosted rows (2 × + 0.15 s) is an assumption and is not used for the limit.