JevBench by Benchmark Heaven · released v1.8.7
How to choose a Jev-class model
Start with the use case, then read the metric behind each recommendation. The guide uses the latest published JevBench artifact; it does not treat the overall composite as raw accuracy.
Data: JevBench v1.8.7, published 2026-11-03 · method v1.7 (10 s rule), re-scored from the recorded per-decision times
Most accurate (Intelligence axis)
H2O-Lightning-31B v1.0.7 (H2O.ai, Gemma-4-31B-it fine-tune, vLLM + h2oai overlay, one-engine FP8 profile, self-hosted)
79.3
Published Intelligence axis in v1.8.7. The JevBench Score is a separate composite.
Fastest (Speed axis)
Quyet-1.0-Tiny (Chinh Nguyen, mmBERT-small encoder (16 layers kept) with fixed heads)
95.1of 100
This is the published Speed axis. Use the row’s latency conditions when estimating real performance; it is not a universal wall-clock guarantee.
Cheapest per decision (Cost axis)
verdict-small (Manavarya09, multilingual-e5-small 118M)
100.0of 100
Published cost: $0.0009 per 1,000 decisions (estimated)
Cost axis is a comparison score. The row’s cost basis distinguishes measured, estimated and announced values.
Self-hosting evidence
Use rows with public openness, license and repository evidence
The list below is ordered by the published JevBench rank. The openness status and license terms are copied from each public aggregate row.
Systems with explicit self-hosting evidence
Perplexity Decider v1.1 27B (Qwen3.8-27B, noncausal decision readout) · open-weights rank 5
Weights marked open in the published row · apache-2.0
Quyet-1.0-Large (Chinh Nguyen, Gemma-4-31B decoder, option-letter logits) · open-weights rank 13
Weights marked open in the published row · apache-2.0
torchcast-decision-27b (Torchcast AI, Qwen3.8-27B fine-tune) · open-weights rank 20
Weights marked open in the published row · cc-by-nc-4.0
Kev 27B (Kev 1.0, Qwen3.8-27B) · open-weights rank 25
Weights marked open in the published row · apache-2.0
René-1 31B FP8 (salfatigroup, Gemma 4 31B full fine-tune, one-pass option readout) · open-weights rank 36
Weights marked open in the published row · apache-2.0
Clef (Cloudflare, Qwen3.8-27B post-train with a joint schema head, multimodal, measured on text) · open-weights rank 38
Weights marked open in the published row · apache-2.0
H2O-Lightning-4B v1.1 (H2O.ai, Qwen3.5-4B fine-tune, stock vLLM + open shim) · open-weights rank 39
Weights marked open in the published row · apache-2.0
JEV-27B (AutoTrust, Qwen3.8-27B) · open-weights rank 40
Weights marked open in the published row · apache-2.0
Rows without explicit openness, license or repository evidence are left unclassified. Confirm each model’s terms and requirements before using it in production.
Keep the measures separate
Arithmetic mean of Intelligence and Calibration; ranked models within both official caps Accuracy, speed, cost and the composite answer different questions. Review the full live board and its row disclosures before making a deployment choice.
Frequently asked questions
- Which Jev-class model has the highest published Intelligence?
- H2O-Lightning-31B v1.0.7 (H2O.ai, Gemma-4-31B-it fine-tune, vLLM + h2oai overlay, one-engine FP8 profile, self-hosted) has the highest Intelligence axis among the open-weights ranked rows of v1.8.7 (79.3). This is a separate measure from the composite JevBench Score.
- Which Jev-class model is fastest?
- Quyet-1.0-Tiny (Chinh Nguyen, mmBERT-small encoder (16 layers kept) with fixed heads) has the highest published Speed axis score (95.1). The axis is a benchmark score; it does not promise the same wall-clock latency on every host or workload.
- Which Jev-class model is cheapest?
- verdict-small (Manavarya09, multilingual-e5-small 118M) has the highest Cost axis score (100.0). Its published cost is estimated at $0.0009 per 1,000 decisions; check the board’s row disclosure for the basis before comparing bills.
- How do I find a self-hostable Jev alternative?
- Use only systems marked open or open weights in the published row, with a license note and public repository link. This page leaves absent openness, license or repository evidence unclassified; review the linked terms before deployment.