Quyet-1.0-Large (Chinh Nguyen, Gemma-4-31B decoder, option-letter logits)
Data: JevBench v1.6.1, published 2026-10-06
Capability 81.7 · rank #1 of 64
Last measured: 2026-10-04 · measurement release: v1.6.1
apache-2.0
intelligence
73.4
calibration
90.0
speed
86.9
cost
50.5
Composite (secondary)
71.4 · Composite rank #3
Cost and measurement conditions
$0.045 per 1,000 decisions (estimated)
v1.5.8 fast-lane delivery row (combined v1.5.8 preview, not yet published) cost per 1,000 decisions carried (pricing rules unchanged; v1.6 item lengths differ): ESTIMATE (v1.5-M2 base-model reference; self-hosted open weights, no public tariff): OpenRouter google/gemma-4-31b-it list price $0.09/M input, $0.34/M output (the exact base model google/gemma-4-31B-it; listed since Apr 2026), read 2026-10-04 x the package's own measured usage.input_tokens; one forward pass, nothing generated; run in process on 1x H100 80GB (Lium), quyet 1.0.0; estimated, not charged
p50 latency: 0.4 s
x2 + 0.15 s (assumption, not measured)
evaluator-owned Lium GPU pod, 1x NVIDIA H100 80GB, weights fetched in a separate model-only container, scored run inside docker --network none (loopback only, no secrets, label-free inputs); pod destroyed afterwards; paid public fast-lane evaluation, 4 Oct 2026 (order 3643732b)