Nagi-HUGE 12B (nagisanzenin, Gemma-4-12B LoRA)
Data: JevBench v1.6.39, published 2026-10-22
Capability 64.0 · Not ranked in the current release
unpriced: google/gemma-4-12B-it is in the frozen module's UNLISTED_BASE_MODELS (no eligible base-model price); one listing decision would make the row rankable.
Last measured: 2026-10-16 · measurement release: v1.6.26
Apache-2.0
intelligence
54.8
calibration
73.3
speed
88.6
cost
—
Composite (secondary)
— · Not ranked on this board
Cost and measurement conditions
not published (not published)
UNPRICED. The frozen pricing_v15 module (sha256 3948e3f1..., and the later re-freezes, which only add or re-price hosted-API launch-list keys) has no market-listing decision for the declared base google/gemma-4-12B-it (the module lists it in UNLISTED_BASE_MODELS, so reference() returns no price); no price is invented here. Axes only: Intelligence, Calibration and Speed are computed; Cost, composite and rank are void. Tokens as reported by the evaluator's wrapper (attention-mask ones over every forward pass: input 764,280, output_tokens 0).
Measured p50 latency: 0.098 s (on-GPU, no network, loopback; not directly comparable with API latency, which we time end to end from our measuring host, network included)
Ranking and cap use: 0.35 s (est. incl. network (2x + 150 ms))
Self-hosted model: measured p50 0.098 s on-GPU, no network (timed on our GPU over loopback). Not directly comparable with API latency, which we time end to end from our measuring host, network included. The ranking and latency cap use the same estimate for every self-hosted row: 2 × measured + 150 ms = 0.35 s. Model authors can ask us to time a hosted endpoint instead (on request).
x2 + 0.15 s (assumption, not measured)
Evaluator-owned rented Lium GPU pod (measurement receipts on file), 1x NVIDIA H100 80 GB HBM3 (sm_90, driver 580.178.04, United States node, pre-registration Amendments 1-2) - the card most of these systems were first evaluated on, but a different pod, stack and pin set from the earlier runs, so Speed is as measured on this card and probabilities may differ from the earlier runs in the last digits. Python packaging: uv venv from a hashed lock at the old pins, dependencies resolved as of the old build time where the old freeze is lost (declared deviation, UNVERIFIED where noted). Isolation: author server started inside a network namespace with loopback only, the cut proven before and after the sealed input was staged, synthetic smoke gate passed in between; runner unchanged (run_v15.py --resume --resume-keep-failures); one use of input-selfhosted-1500 (custody #20324, under the pre-registration). Published Speed uses the standing x2 + 0.15 s self-hosted adjustment. Author's SDK loaded in-process (nagi.load_huge) behind the evaluator's wrapper.