JevBench v1.5.6 · individual system

Vansa-3.4 (Vansa, hosted System One API)

Closed decision API · by Vansa · Marked closed

Base model: Qwen3.5-4B (self-reported) · Developer-reported to Benchmark Heaven (private correspondence, 1 Oct 2026): built on Qwen3.5-4B via an open decision fine-tune, with Vansa's own adapters; the intermediate fine-tune is not named. Not publicly documented or independently verified.

v1.5 roster addendum A7

proprietary hosted API

JevBench v1.5.6 score

71.591

Option A: rank #5 of 110 ranked systems.

The three option scores and ranks are published independently; the headline is Option A.

Published JevBench option scores and ranks
OptionScoreRank
A · headline71.591#5 of 110
B68.396#5 of 110
C66.985#6 of 110

Published axes

intelligence
58.0
calibration
87.6
speed
91.3
cost
61.4

Bands use the published 0–100 axis values; the marked reference is Jev 1.13.0 when that axis is available.

Run and cost evidence

Run status
complete · 1,624 decisions · 0 missing
Cost
$0.019 per 1,000 decisions · estimate · Developer's own stated API price: USD 0.034 per 1M input tokens, no output-token charge (docs.vansa.org/pricing, read 1 Oct 2026), x measured input tokens (921,181 over 1,624 decisions). Standard launch list price counted from day 1 (interpretation I-1); the closed-beta 'no charges today' is a promotion and is not used. API model with a developer-reported base: ranked at its own API price (1 Oct 2026 rule); the striped bar shows the Qwen3.5-4B base-model reference.
Median latency
0.144 seconds, adjusted · none (hosted API, measured as is)
Endpoint condition
the operator's hosted API (api.vansa.org, closed beta), paid fast-lane evaluation; production endpoint measured as is
API exposure
The endpoint received sealed item text · API measurement: the operator's endpoint received sealed item text, without answers.
Published source
https://vansa.org
Model and serving disclosure

Developer-reported (private correspondence with Benchmark Heaven, 1 Oct 2026; not independently verified): built on Qwen3.5-4B via an open decision fine-tune, with Vansa's own adapters. The intermediate fine-tune is not named. Closed-beta hosted API; no immutable model artifact is externally verifiable, so the row pins model ID vansa-3.4 at api.vansa.org/v1/systemone as served on 1 Oct 2026.

Values come from the public v1.5.6 aggregate. Scores and ranks may change in a later release.

Read the full leaderboard, the v1.5.6 release page, and the published method.