Decision-4B (Eval Engine / Chromia)
system-one-open · by Eval Engine / Chromia · Code and weights marked open
Base model: Qwen/Qwen3.5-4Bsourcev1.5 roster addendum A4
Not independently recorded
JevBench v1.5.4 score
—
unranked in Option A — PARTIAL / UNRANKED: 1,550 of 1,624 valid answers; 74 context overflows in our evaluator at 2,048 tokens. No official score or rank..
The three option scores and ranks are published independently; the headline is Option A.
| Option | Score | Rank |
|---|---|---|
| A · headline | — | — |
| B | — | — |
| C | — | — |
Published axes
- intelligence
- —
- calibration
- —
- speed
- —
- cost
- —
Bands use the published 0–100 axis values; the marked reference is Jev 1.13.0 when that axis is available.
Run and cost evidence
- Run status
- partial · 1,624 decisions · 0 missing
- Cost
- $0.014 per 1,000 decisions · estimate · ESTIMATE: documented hosted-model estimate; reference deepinfra:Qwen/Qwen3.5-4B frozen at the 25 Sep cut-off, already marked deprecated at that cutoff (replaced by Qwen/Qwen3.5-9B); re-score if it changes (I-3). Frozen market reference deepinfra:Qwen/Qwen3.5-4B.
- Median latency
- 0.233 seconds, adjusted · x2 + 0.15 s (assumption, not measured)
- Endpoint condition
- evaluator-owned H100 GPU
- Published source
- https://huggingface.co/evalengine/decision-4b
Model and serving disclosure
Eval Engine / Chromia; unrelated to FlyMyJev Decision-4B. Adapter @ facac5a59ae44c94edc8d75e135a4fd278c85dc9; author GGUF @ 08859d1d8307f7b7ea452549e303b7805c35e350, Q8_0 SHA-256 f2519bcdc945291974c81a37ff92417b22df27154c9df2564420d08576b907ce. Our H100 llama.cpp evaluator used a 2,048-token context setting based on the model card, not a submitted server limit. 74 items overflowed (69 open/hard, 2 open/judge, 1 sealed/judge, 2 sealed/hard). This is incomplete evidence: no official score, axis comparison or rank is published.
Values come from the public v1.5.4 aggregate. Scores and ranks may change in a later release.
Read the full leaderboard, the v1.5.4 release page, and the published method.