Nagi-ENORMOUS 27B (nagisanzenin, Qwen3.8-27B LoRA)
Data: JevBench v1.6.40, published 2026-10-22
Capability 73.8 · Not ranked in the current release
cost 6.7× Jev (v1.5 reference)
Last measured: 2026-10-16 · measurement release: v1.6.26
Apache-2.0
intelligence
62.4
calibration
85.1
speed
86.2
cost
30.0
Composite (secondary)
19.8 · Composite rank #96
Cost and measurement conditions
$0.216 per 1,000 decisions (estimated)
ESTIMATE (*est.), base-model market reference through the frozen pricing_v15 module: declared base Qwen/Qwen3.8-27B -> qwen/qwen3.8-27b USD 0.42/M input, USD 3.0/M output (frozen at the 25 Sep cut-off, I-3). Estimated, not charged, not a quote from the author or any host. Frozen pricing_v15: base-model references unchanged since sha256 dcfcecb0...2835 (the later re-freezes only add or re-price hosted-API launch-list keys; this row was first priced with 3948e3f1...d0), USD per 1,000 decisions over the common 1,485-item cost basis (the 15 very long items are left out of cost for every row; refused or failed items cost nothing and still count as wrong answers). Tokens as reported by the evaluator's wrapper (input = attention-mask ones over every forward pass, output_tokens 0). OVER THE OFFICIAL COST CAP, DISCLOSED: USD 0.215638 per 1,000 decisions on the common basis (USD 0.213482 over all 1,500 items) is 3.338x the official cap USD 0.064595; the row is ranked (v1.6.16 vllm-sr-d3 and v1.6.24 imajev-9b precedent) and falls outside the official-caps board views by construction. COMMON COST BASIS (v1.6.30): cost per 1,000 decisions is computed on the common 1,485 items of this draw, leaving out the 15 very long items (at least 76,358 input tokens as counted by the rows that answered them). They are the 15 items the Jev reference refused with max_tokens_exceeded, which the other rows that did not answer them refused or failed on; their tokens count for no row, whether the row refused or answered them, and a refused item still counts as a wrong answer for Intelligence. This row: USD 0.215638 per 1,000 decisions (3.338x the official cost cap USD 0.064595), against USD 0.213482 over all 1,500 items (v1.6.29).
Measured p50 latency: 0.151 s (on-GPU, no network, loopback; not directly comparable with API latency, which we time end to end from our measuring host, network included)
Ranking and cap use: 0.45 s (est. incl. network (2x + 150 ms))
Self-hosted model: measured p50 0.151 s on-GPU, no network (timed on our GPU over loopback). Not directly comparable with API latency, which we time end to end from our measuring host, network included. The ranking and latency cap use the same estimate for every self-hosted row: 2 × measured + 150 ms = 0.45 s. Model authors can ask us to time a hosted endpoint instead (on request).
x2 + 0.15 s (assumption, not measured)
Evaluator-owned rented Lium GPU pod (measurement receipts on file), 1x NVIDIA H100 80 GB HBM3 (sm_90, driver 580.178.04, United States node, pre-registration Amendments 1-2) - the card most of these systems were first evaluated on, but a different pod, stack and pin set from the earlier runs, so Speed is as measured on this card and probabilities may differ from the earlier runs in the last digits. Python packaging: uv venv from a hashed lock at the old pins, dependencies resolved as of the old build time where the old freeze is lost (declared deviation, UNVERIFIED where noted). Isolation: author server started inside a network namespace with loopback only, the cut proven before and after the sealed input was staged, synthetic smoke gate passed in between; runner unchanged (run_v15.py --resume --resume-keep-failures); one use of input-selfhosted-1500 (custody #20324, under the pre-registration). Published Speed uses the standing x2 + 0.15 s self-hosted adjustment. Author's SDK loaded in-process (nagi.load_enormous) behind the evaluator's wrapper.