Xor 26B-A4B (Juspay, Gemma-4-26B-A4B, bf16)
Data: JevBench v1.6.1, published 2026-10-06
Capability 72.4 · rank #4 of 66 on the open-weights board
Last measured: 2026-10-06 · measurement release: v1.6.1
apache-2.0
intelligence
58.7
calibration
86.1
speed
91.0
cost
50.7
Composite (secondary)
67.4 · Composite rank #7
Cost and measurement conditions
$0.044 per 1,000 decisions (estimated)
ESTIMATE (base-model reference; self-hosted open weights, no public tariff): OpenRouter google/gemma-4-26b-a4b-it in the frozen 25 Sep snapshot, the M2 reference of the published surogate-rune-26b-a4b-v3 row (the frozen module has no explicit listing-decision line for this base: release-lane line), USD 0.09 per 1M input and USD 0.3 per 1M output x this row's own measured tokens. Estimated, not charged
p50 latency: 0.3 s
x2 + 0.15 s (assumption, not measured)
evaluator-owned Lium GPU pod, 1x NVIDIA RTX PRO 6000 Blackwell 96GB (the author's card class), the author's own serving bundle (SGLang image pinned by digest + their compatibility server, single GPU via their documented switch), offline (all credentials unset), driven over loopback only by the JevBench client with its loopback guard; label-free inputs; pod destroyed afterwards; HF Jev Decision Index intake, 6-7 Oct 2026