Standard One 8B SH (Standard Thinking)

Data: JevBench v1.6.40, published 2026-10-22

Capability 60.0 · Not ranked in the current release

cost 2.4× Jev (v1.5 reference)

Last measured: 2026-10-10 · measurement release: v1.6.5

Apache-2.0 (merged weights, schema head and reference server; base Ministral 3 8B Apache-2.0)

Base model: undisclosed

intelligence

34.5

calibration

85.5

speed

84.3

cost

43.2

Composite (secondary)

18.7 · Composite rank #102

Cost and measurement conditions

$0.078 per 1,000 decisions (estimated)

v1.5-M2 base-model reference: model card base_model StandardThinking/StandardOne-8B, built on mistralai/Ministral-3-8B-Instruct-2512 (not listed on OpenRouter as Standard One). OpenRouter mistralai/ministral-8b-2512 list price USD 0.15/M input and USD 0.15/M output, read 2026-10-10T08:43Z from https://openrouter.ai/api/v1/models. Schema head generates no text: 0 output tokens.

Measured p50 latency: 0.061 s (on-GPU, no network, loopback; not directly comparable with API latency, which we time end to end from our measuring host, network included)

Ranking and cap use: 0.27 s (est. incl. network (2x + 150 ms))

Self-hosted model: measured p50 0.061 s on-GPU, no network (timed on our GPU over loopback). Not directly comparable with API latency, which we time end to end from our measuring host, network included. The ranking and latency cap use the same estimate for every self-hosted row: 2 × measured + 150 ms = 0.27 s. Model authors can ask us to time a hosted endpoint instead (on request).

x2 + 0.15 s (assumption, not measured)

evaluator-owned Lium GPU pod (H100 80GB), offline read-only container (--network none); author's reference server code/serve_head.py, unchanged defaults

Published source