JevBench v1.8.2: four unranked rows on the 27 Oct draw
Added four rows measured on the 27 Oct regular draw (oenogarum, Amber 4B, Piccolo 4B, Piccolo 9B), shown unranked until that draw is equated to the reference scale. Clarified earlier row descriptions without changing their scores.
Aggregate results JSON · SHA-256 6468462911beeac46335b9729b115bfde22b96c65bc1cbf2af36a8c056c40e34 · Previous v1.8.1
JevBench v1.8.2 · headline
JevBench Capability Score
Capability ranking of Jev-class systems
Capability Score averages Intelligence and Calibration. kettei-fat leads the Jev-class systems with 86.3.
Jev-class means at most 2× the cost and median latency of Jev (v1.5 reference). How we choose ↘
Adjust cost / latency caps · 2× official
ScoreCCost
ScoreCap.Capability
Score$/1k$/1k decisions
- 1kettei-fatAPIv1.6.43 drawv1.7 · 10 s rule79.857.486.3$0.026*
- 2Super DeciderAPIv1.7.0 drawv1.7 · 10 s rule80.056.485.9$0.028
- 3baselabs mammoth-1v1.7.0 drawv1.7 · 10 s rule76.257.285.2$0.027*
- 4KnowLine 31B-Gen1v1.7.0 drawv1.7 · 10 s rule77.446.585.2$0.061*
- 5Fastino GLiDE 1.2v1.7.0 drawv1.7 · 10 s rule76.458.184.9$0.025*
- 6Super DeciderAPIv1.7.0 drawv1.7 · 10 s rule78.964.384.9$0.016
- 7Fastino GLiDEAPIv1.6.43 drawv1.7 · 10 s rule76.159.184.5$0.023
- 8H2O-Lightning-31B v1.0.7v1.6.43 drawv1.7 · 10 s rule79.356.084.3$0.029*
- 9Drex MaxAPIv1.6.43 drawv1.7 · 10 s rule78.955.384.2$0.031
- 10Perplexity Decider v1.1 27Bv1.7 · 10 s rule75.657.382.7$0.026*
Show all 251 Jev-class systems (241 more)
- 11vLLM-SR d3-turbov1.6.43 drawv1.7 · 10 s rule74.857.382.6$0.027*
- 12StartLux-Decision v1.1 27B Instantv1.6.43 drawv1.7 · 10 s rule73.257.982.6$0.025*
- 13vLLM-SR d3v1.6.43 drawv1.7 · 10 s rule72.957.382.1$0.027*
- 14basal-omni-1.0-ultrav1.6.43 drawv1.7 · 10 s rule74.155.982.1$0.029*
- 15DOPEST 1.0 31Bv1.7.4 drawv1.7 · 10 s rule73.952.682.0$0.038*
- 16SubQ Snap 1.1APIv1.6.43 drawv1.7 · 10 s rule75.860.781.9$0.020*
- 17Jeff-1.1-Mediumv1.7.8 drawv1.7 · 10 s rule74.566.281.9$0.013*
- 18Arcbright Elf 1 31Bv1.7.0 drawv1.7 · 10 s rule71.955.181.8$0.031*
- 19Quyet-1.0-Largev1.7 · 10 s rule73.455.981.7$0.030*
- 20Jeffan-31b-1710v1.7.0 drawv1.7 · 10 s rule71.651.481.7$0.042*
- 21Jeff-1.0-Largev1.6.4 drawv1.7 · 10 s rule71.954.581.5$0.033*
- 22SubQ SnapAPIv1.6.43 drawv1.7 · 10 s rule72.357.781.5$0.026*
- 23Nimble-v4-maxv1.7.0 drawv1.7 · 10 s rule71.057.581.2$0.026*
- 24Sieve-31B-v2v1.7.5 drawv1.7 · 10 s rule68.756.281.1$0.029*
- 25Turion Jev 31Bv1.7.1 drawv1.7 · 10 s rule70.946.680.9$0.060*
- 26pplx-decider-v1.2v1.6.43 drawv1.7 · 10 s rule71.757.480.8$0.026*
- 27d1-ultraAPIv1.6.43 drawv1.7 · 10 s rule69.762.380.5$0.018*
- 28torchcast-decision-27bv1.7 · 10 s rule70.457.780.2$0.026*
- 29Lychee-27Bv1.7.20 drawv1.7 · 10 s rule74.357.379.8$0.026*
- 30Bespoke Nimble-v4-maxAPIv1.6.43 drawv1.7 · 10 s rule68.260.779.7$0.020*
- 31metask-jev-rain-31B-trained service v3v1.6.43 drawv1.7 · 10 s rule72.655.479.6$0.031*
- 32decisio v0.8.0 on gemma-4-31B-itv1.7 · 10 s rule70.455.079.6$0.032*
- 33Vera Largev1.7.0 drawv1.7 · 10 s rule67.855.979.6$0.029*
- 34Kev 27Bv1.7 · 10 s rule64.256.278.9$0.029*
- 35metask-jev-rain-31B-trainedv1.6.43 drawv1.7 · 10 s rule70.756.178.9$0.029*
- 36Myles-G 31BAPIv1.6.43 drawv1.7 · 10 s rule73.651.178.8$0.043*
- 37StartLux-Decision v1.1 27B AutoThinkv1.6.43 drawv1.7 · 10 s rule66.756.678.8$0.028*
- 38Sage 1.3.0APIv1.7 · 10 s rule65.658.278.6$0.025*
- 39Bobcat 1.3v1.7.0 drawv1.7 · 10 s rule68.155.277.9$0.031*
- 40deck-31Bv1.7 · 10 s rule73.055.077.6$0.032*
- 41Torchcast Decision 4Bv1.6.43 drawv1.7 · 10 s rule67.179.477.5$0.0049*
- 42KnowLine 26B-A4B-Gen2.5v1.7.18 drawv1.7 · 10 s rule65.262.377.3$0.018*
- 43Eikos-27Bv1.7 · 10 s rule64.456.177.2$0.029*
- 44Jev 1.13.0APIv1.7 · 10 s rule63.654.777.1$0.032
- 45metask-jev-rain-12B-trainedv1.6.43 drawv1.7 · 10 s rule66.565.276.9$0.014*
- 46Wald 26B-A4Bv1.7.0 drawv1.7 · 10 s rule65.571.076.8$0.0093*
- 47KnowLine 35B-A3B-Gen1.5v1.7.0 drawv1.7 · 10 s rule60.363.676.7$0.016*
- 48René-1 31B FP8v1.7 · 10 s rule61.751.376.0$0.042*
- 49Decisio 12B tuned commitv1.7.6 drawv1.7 · 10 s rule62.867.075.7$0.013*
- 50Clefv1.7 · 10 s rule59.155.575.3$0.030*
- 51Jev 1.14.0APIv1.6.43 drawv1.7 · 10 s rule59.954.875.0$0.032*
- 52H2O-Lightning-4B v1.1v1.6.43 drawv1.7 · 10 s rule60.078.675.0$0.0052*
- 53d1APIv1.7 · 10 s rule62.162.874.4$0.017
- 54SPX-CD FlashAPIv1.7 · 10 s rule58.452.174.3$0.039*
- 55JEV-27Bv1.7 · 10 s rule56.858.673.9$0.024*
- 56Nagi-ENORMOUS 27Bv1.6.43 drawv1.7 · 10 s rule62.457.473.8$0.026*
- 57Mercury DecideAPIv1.7 · 10 s rule65.962.173.6$0.018*
- 58Celeris-1 DecisionAPIv1.6.43 drawv1.7 · 10 s rule58.960.473.6$0.021*
- 59OpenAI DecisionsAPIv1.7 · 10 s rule56.948.673.5$0.052
- 60Surogate Rune 26B-A4B v3v1.7 · 10 s rule56.171.073.5$0.0092*
- 61RSI-Jev v6.1-VL 27Bv1.6.9 drawv1.7 · 10 s rule61.658.773.5$0.024*
- 62kettei-chubAPIv1.6.43 drawv1.7 · 10 s rule62.262.773.1$0.018*
- 63Bobcat Flash 1.2v1.7 · 10 s rule65.671.173.0$0.0092*
- 64Torchcast Decision 4Bv1.6.43 drawv1.7 · 10 s rule60.379.472.6$0.0049*
- 65swanOnev1.7 · 10 s rule56.271.472.4$0.0090*
- 66FrontiersMind Lumma-fev-27Bv1.7.0 drawv1.7 · 10 s rule55.554.872.3$0.032*
- –Microsoft-Decision-1APIv1.6.43 drawv1.7 · 10 s rule59.262.272.0$0.018PRELIMINARY — API supplement A2 (300 sealed + 300 public), not the S1200 full set; equating pool 4 of 6
- 67torchcast-decision-12bv1.7 · 10 s rule60.556.471.7$0.028*
- 68AutoJev-27Bv1.7 · 10 s rule55.656.771.6$0.028*
- 69decider-12b v2v1.7 · 10 s rule61.968.271.3$0.012*
- 70Decision 2.0 Vega 27Bv1.7 · 10 s rule60.457.071.3$0.027*
- 71Jev-Omniv1.7 · 10 s rule55.566.571.3$0.013*
- 72Winnow-12B Q8v1.7 · 10 s rule59.567.071.2$0.013*
- 73Xor 26B-A4Bv1.7 · 10 s rule57.572.171.2$0.0085*
- 74decider-12b v1, stock Gemma-4-12B-itv1.7 · 10 s rule59.668.271.0$0.012*
- 75Cygnetv1.7 · 10 s rule54.866.870.9$0.013*
- 76Microsoft-Decision-1APIv1.7 · 10 s rule57.261.570.8$0.019
- 77decisio v0.8.0 on gemma-4-12B-itv1.7 · 10 s rule52.367.770.7$0.012*
- 78JPT-35B-A3Bv1.7 · 10 s rule51.472.570.7$0.0083*
- 79Myles-G 12BAPIv1.6.43 drawv1.7 · 10 s rule57.399.470.7$0.0011*
- 80InstinctAPIv1.7 · 10 s rule47.864.470.5$0.015
- 81decider chat on Gemma-4-31B-itv1.7 · 10 s rule58.556.170.4$0.029*
- 82baselabs elephant-1v1.7.0 drawv1.7 · 10 s rule55.868.170.2$0.012*
- 83Jebadiah 27Bv1.7 · 10 s rule57.557.570.2$0.026*
- 84GEV-26B-Decidev1.7 · 10 s rule49.872.670.1$0.0082*
- 85Chon-1.0-12B-Fastv1.7.1 drawv1.7 · 10 s rule60.369.170.1$0.011*
- 86decisio v0.9.0 on gemma-4-12B-itv1.7 · 10 s rule52.367.770.0$0.012*
- 87Blink v0.3 26B-A4Bv1.6.9 drawv1.7 · 10 s rule49.271.169.9$0.0092*
- 88NInfer Qwen3.8-Flash-Next mixedv1.7 · 10 s rule49.071.869.7$0.0087*
- 89attest-31B-v1.0APIv1.6.43 drawv1.7 · 10 s rule65.250.769.5$0.044*
- 90Respan Span-02v1.6.43 drawv1.7 · 10 s rule60.953.569.3$0.035*
- 91Philly Decider v2v1.7.10 drawv1.7 · 10 s rule56.179.169.3$0.0050*
- 92Wald 4B v2.1v1.6.9 drawv1.7 · 10 s rule52.060.869.3$0.020*
- 93JevOnev1.7 · 10 s rule46.072.868.9$0.0081*
- 94vLLM-SR d3-miniv1.7.0 drawv1.7 · 10 s rule50.878.868.8$0.0051*
- 95Torchcast Decision 4Bv1.6.43 drawv1.7 · 10 s rule54.279.468.7$0.0049*
- 96iota-decide-4b-v0.3v1.7.10 drawv1.7 · 10 s rule52.578.968.6$0.0051*
- 97Xevn-4Bv1.7.0 drawv1.7 · 10 s rule52.180.568.6$0.0045*
- 98Chon-1.0-E4Bv1.7.3 drawv1.7 · 10 s rule55.583.568.5$0.0035*
- 99Hopper 12B trainedv1.7 · 10 s rule51.766.668.1$0.013*
- 100SPX-CD-Omniv1.7 · 10 s rule48.868.768.1$0.011*
- 101NInfer Qwen3.8-27B NVFP4v1.7 · 10 s rule51.856.568.0$0.028*
- 102Aplomb 1v1.7 · 10 s rule45.272.467.1$0.0083*
- 103Bespoke Nimble 9B v3v1.7 · 10 s rule56.565.866.8$0.014*
- 104Amazon Strands Decider 26B-A4Bv1.7.1 drawv1.7 · 10 s rule46.771.966.7$0.0086*
- 105Tern-35B-A3Bv1.7.0 drawv1.7 · 10 s rule44.171.366.4$0.0090*
- 106KnowLine 4B-Gen5.5v1.7.18 drawv1.7 · 10 s rule46.469.866.2$0.010*
- 107decider-35b-a3bv1.7 · 10 s rule48.773.266.2$0.0078*
- 108Metask rain 4Bv1.6.4 drawv1.7 · 10 s rule51.169.566.0$0.010*
- 109shisa-de-1v1.6.43 drawv1.7 · 10 s rule49.971.165.5$0.0092*
- 110Plumb-4Bv1.7 · 10 s rule42.877.665.3$0.0056*
- 111Arcbright Elf 1 12Bv1.6.43 drawv1.7 · 10 s rule43.867.865.0$0.012*
- 112decider-4b v2v1.7 · 10 s rule40.179.164.9$0.0050*
- 113Seb-9B-v2v1.7.0 drawv1.7 · 10 s rule46.168.664.8$0.011*
- 114HS1 0.1.2APIv1.6.43 drawv1.7 · 10 s rule52.949.164.3$0.050*
- 115JevK5 v0.3v1.7 · 10 s rule38.577.664.2$0.0056*
- 116Bespoke Nimble-v4APIv1.6.43 drawv1.7 · 10 s rule41.460.764.0$0.020*
- 117Jeffan-4B-2010v1.7.0 drawv1.7 · 10 s rule40.178.764.0$0.0051*
- 118Clef-Flashv1.7 · 10 s rule42.266.563.8$0.013*
- 119JPT-4Bv1.6.43 drawv1.7 · 10 s rule40.878.963.8$0.0051*
- 120Vansa-3.4APIv1.7 · 10 s rule40.961.963.7$0.019
- 121deck-4B v1.0v1.7 · 10 s rule38.678.063.6$0.0054*
- 122Jebadiah 9B v2.1v1.6.43 drawv1.7 · 10 s rule37.268.563.4$0.011*
- 123GLiClass v4 9Bv1.7.9 drawv1.7 · 10 s rule39.670.963.2$0.0093*
- 124Seb-9Bv1.6.43 drawv1.7 · 10 s rule38.368.663.1$0.011*
- 125janus 4Bv1.7 · 10 s rule37.679.062.9$0.0050*
- 126Amos 1 mediumAPIv1.6.43 drawv1.7 · 10 s rule38.148.762.9$0.051*
- 127JevK5 v0.2.0v1.7 · 10 s rule36.377.662.8$0.0056*
- 128Messier One v0.4v1.6.43 drawv1.7 · 10 s rule52.075.762.4$0.0065*
- 129Imajev-9Bv1.6.43 drawv1.7 · 10 s rule36.750.562.4$0.045*
- 130Imajev-4Bv1.7 · 10 s rule34.677.861.9$0.0055*
- 131jqvv1.7 · 10 s rule33.954.761.9$0.032*
- 132metask-jev-4bv1.7 · 10 s rule39.276.061.8$0.0063*
- 133Kahn1 4Bv1.6.43 drawv1.7 · 10 s rule39.764.761.7$0.015*
- 134pplx-decider-flash-v1.2v1.6.43 drawv1.7 · 10 s rule45.579.061.7$0.0050*
- 135levv1.7 · 10 s rule41.176.361.7$0.0061*
- 136Decision 2.0 Lux 9Bv1.6.43 drawv1.7 · 10 s rule35.868.161.6$0.012*
- 137JEB-35B-A3Bv1.6.43 drawv1.7 · 10 s rule33.272.361.6$0.0084*
- 138Decisio v0.9.0 on Qwen3.6-35B-A3Bv1.7.10 drawv1.7 · 10 s rule34.061.761.5$0.019*
- 139blink-4bv1.6.43 drawv1.7 · 10 s rule35.078.161.4$0.0054*
- 140Hopperv1.7 · 10 s rule33.676.861.2$0.0059*
- 141Malkuth-4Bv1.7 · 10 s rule33.877.561.1$0.0056*
- 142Qwen3.5-9B Jev-like data-mix v2v1.7 · 10 s rule41.965.460.9$0.014*
- 143Decision 4B v1.2v1.7 · 10 s rule32.477.660.4$0.0056*
- 144jiwo 4bv1.6.9 drawv1.7 · 10 s rule34.878.660.2$0.0052*
- 145Verdin-4Bv1.7.0 drawv1.7 · 10 s rule35.476.759.6$0.0060*
- 146Wald 4Bv1.6.4 drawv1.7 · 10 s rule41.070.559.6$0.0096*
- 147Quyet-1.0-Mediumv1.7 · 10 s rule41.778.059.2$0.0054*
- 148Decision-4Bv1.7 · 10 s rule37.980.459.1$0.0045*
- 149Clef-omniv1.6.9 drawv1.7 · 10 s rule34.556.058.3$0.029*
- 150Manchego v2.1v1.7 · 10 s rule32.578.958.3$0.0051*
- 151Messier One v0.2v1.7 · 10 s rule42.479.458.1$0.0048
- 152Diffusion Jevv1.7 · 10 s rule54.971.258.1$0.0091*
- 153jev-localv1.7 · 10 s rule41.978.557.5$0.0052*
- 154Instinct Dual 4BAPIv1.7 · 10 s rule28.375.057.2$0.0068
- 155Decision 4B v1.1v1.7 · 10 s rule29.177.657.2$0.0056*
- 156JEV Qwen3.5-9B Base NVFP4v1.7 · 10 s rule29.347.657.1$0.056*
- 157iota-decide-4bv1.6.43 drawv1.7 · 10 s rule29.477.557.1$0.0056*
- 158Uniphore-4B-Deciderv1.6.43 drawv1.7 · 10 s rule34.279.157.1$0.0050*
- 159Jebadiah 9B v2v1.6.43 drawv1.7 · 10 s rule30.668.556.9$0.011*
- 160CoCo-Decision-4Bv1.7 · 10 s rule32.779.756.9$0.0047*
- 161APUS-OpenJev-v1-9Bv1.7 · 10 s rule47.268.456.9$0.011*
- 162Decider-4Bv1.6.43 drawv1.7 · 10 s rule27.180.756.8$0.0044*
- 163typecastlmv1.7 · 10 s rule29.878.556.5$0.0052*
- 164Bespoke Nimble 9Bv1.7 · 10 s rule43.156.456.5$0.028*
- 165pjev-2bv1.7.0 drawv1.7 · 10 s rule28.863.556.5$0.016*
- 166TypeCastLM 1.4.0v1.7 · 10 s rule35.479.356.4$0.0049*
- 167RYOTIDE-Qwenv1.6.43 drawv1.7 · 10 s rule25.276.756.3$0.0060*
- 168Compass 0.2.0v1.6.43 drawv1.7 · 10 s rule28.972.156.1$0.0085*
- 169Standard One 3B SH v4v1.7.0 drawv1.7 · 10 s rule34.448.656.0$0.052*
- 170Standard One 3B SHv1.6.43 drawv1.7 · 10 s rule32.848.655.6$0.052*
- 171SemIfv1.7 · 10 s rule27.177.655.4$0.0056*
- 172ArseneLupin v1.1v1.6.43 drawv1.7 · 10 s rule28.075.255.1$0.0067*
- 173local-jev Qwen3.5-4Bv1.7 · 10 s rule24.177.555.0$0.0056*
- 174Decision 2Bv1.7 · 10 s rule22.966.454.8$0.013*
- 175Jez-large-1.0.0v1.7.0 drawv1.7 · 10 s rule25.683.354.4$0.0036*
- 176Nomav1.6.43 drawv1.7 · 10 s rule25.176.554.3$0.0061*
- 177spark-s1-4b-v6v1.7 · 10 s rule43.275.054.0$0.0068*
- 178Imajev-2Bv1.6.43 drawv1.7 · 10 s rule21.267.354.0$0.012*
- 179RYOTIDE-Qwen9v1.6.4 drawv1.7 · 10 s rule27.666.152.5$0.013*
- 180classify-1APIv1.7.3 drawv1.7 · 10 s rule21.850.852.3$0.044
- 181Arbiter-4Bv1.6.43 drawv1.7 · 10 s rule27.480.752.3$0.0044*
- 182DecisionNode Edge 0.9.2v1.7.0 drawv1.7 · 10 s rule26.886.852.1$0.0028*
- 183system-one-openAPIv1.7 · 10 s rule27.968.351.9$0.011*
- 184D1A on Gemma 4 E4Bv1.7.7 drawv1.7 · 10 s rule19.981.251.1$0.0042*
- 185ClassOne Qwen 3.5 9Bv1.7 · 10 s rule42.269.050.5$0.011*
- 186kev 8Bv1.7 · 10 s rule29.368.950.0$0.011*
- 187Liquid AI d1-3Bv1.6.9 drawv1.7 · 10 s rule22.150.649.5$0.044*
- 188ZeroEntropy zerank-2v1.7 · 10 s rule15.660.649.4$0.021*
- 189JADEv1.7 · 10 s rule47.961.149.2$0.020*
- 190open-alternative-jevv1.7 · 10 s rule22.363.349.1$0.017*
- 191OpenSourceJevv1.7 · 10 s rule23.283.848.6$0.0035*
- 192Open-Jev 2Bv1.7 · 10 s rule21.869.647.7$0.010*
- 193EXAONE-4.0-1.2B-JEV v0.3v1.7 · 10 s rule14.857.947.7$0.025*
- 194Malkuth-2Bv1.7 · 10 s rule15.983.847.6$0.0035*
- 195DecisionNode Edge Mini 0.9.2v1.7.0 drawv1.7 · 10 s rule17.686.847.6$0.0028*
- 196Nemotron Diffusion 8Bv1.7 · 10 s rule20.455.547.5$0.030*
- 197jiwo 0.8bv1.6.9 drawv1.7 · 10 s rule15.985.047.2$0.0032*
- 198decision-machine-1APIv1.7 · 10 s rule13.158.346.1$0.024
- 199decisor-4bv1.6.4 drawv1.7 · 10 s rule39.678.745.7$0.0051*
- 200D1A on Gemma 4 E2Bv1.7.7 drawv1.7 · 10 s rule8.984.045.5$0.0034*
- 201Qwen3-Reranker-4Bv1.7 · 10 s rule16.360.644.7$0.021*
- 202decider-2bv1.7 · 10 s rule20.785.844.6$0.0030*
- 203BAAI bge-reranker-v2-m3v1.7 · 10 s rule0.159.344.1$0.023*
- 204kev 4Bv1.7 · 10 s rule19.577.944.0$0.0055*
- 205Mixedbread mxbai-rerank-base-v2v1.7 · 10 s rule1.160.343.9$0.021*
- 206lev-350mv1.7 · 10 s rule4.880.043.3$0.0046*
- 207Jez-small-1.0.0v1.7.0 drawv1.7 · 10 s rule4.686.243.2$0.0029*
- 208Certo v1v1.7 · 10 s rule0.296.943.2$0.0013*
- 209PurpleMIST-Mini-1.0v1.7.0 drawv1.7 · 10 s rule8.486.343.0$0.0029*
- 210Chon-1.0-12Bv1.6.43 drawv1.7 · 10 s rule27.364.943.0$0.015*
- 211smalljev semantic-v9v1.7 · 10 s rule8.760.843.0$0.020*
- 212Vega-Uv1.7.0 drawv1.7 · 10 s rule8.579.442.6$0.0048*
- 213jul fastv1.7 · 10 s rule7.569.042.6$0.011*
- 214Krino-2Bv1.6.43 drawv1.7 · 10 s rule22.084.242.4$0.0034*
- 215Alibaba GTE Reranker ModernBERT-basev1.7 · 10 s rule0.069.341.7$0.011*
- 216Jeetu Decider 2Bv1.7.2 drawv1.7 · 10 s rule10.285.941.7$0.0030*
- 217watt-flash-0.1v1.7 · 10 s rule3.889.041.6$0.0023
- 218Decision Fastv1.7 · 10 s rule6.186.640.6$0.0028*
- 219openJev Verdict 1.4v1.7 · 10 s rule5.086.640.4$0.0028*
- 220Quyet-1.0-Small-ENv1.7 · 10 s rule6.189.139.5$0.0023*
- 221ClassOne Gemma 4 E4Bv1.6.9 drawv1.7 · 10 s rule28.282.138.4$0.0040*
- 222ClassOne Qwen 3.5 4Bv1.6.9 drawv1.7 · 10 s rule27.379.538.1$0.0048*
- 223OpenDecisionv1.7 · 10 s rule7.479.138.0$0.0050*
- 224verdict-smallv1.7 · 10 s rule2.3100.037.6$0.00087*
- 225kev 0.6Bv1.7 · 10 s rule7.684.236.9$0.0034*
- 226Vega 4Bv1.6.9 drawv1.7 · 10 s rule15.761.736.6$0.019*
- 227WaterSheepv1.7 · 10 s rule5.368.735.5$0.011*
- 228Raw Phi-4 mini direct logitsv1.7 · 10 s rule13.753.235.3$0.036*
- 229Fastino GLiNER-2.5-DecideAPIv1.7 · 10 s rule7.045.834.6$0.064
- 230Raw Qwen3 4B Instruct 2507 direct logitsv1.7 · 10 s rule34.077.934.6$0.0055*
- 231Vega 0.8Bv1.6.9 drawv1.7 · 10 s rule3.168.033.0$0.012*
- 232kev 0.5Bv1.7 · 10 s rule4.684.232.9$0.0034*
- 233Liquid AI d1-omni-600Mv1.6.9 drawv1.7 · 10 s rule3.373.132.8$0.0079*
- 234Quyet-1.0-Smallv1.7 · 10 s rule4.079.632.5$0.0048*
- 235Quyet-1.0-Tinyv1.7 · 10 s rule3.788.431.1$0.0024*
- 236Open Jev JSON Canvasv1.7 · 10 s rule61.270.730.6$0.0095*
- 237Phocinae-Largha-150M-v1v1.6.43 drawv1.7 · 10 s rule3.695.330.2$0.0014*
- 238Raw Qwen3 8B direct logitsv1.7 · 10 s rule26.568.830.1$0.011*
- 239system-onev1.7 · 10 s rule29.368.329.7$0.011*
- 240JevActAPIv1.7 · 10 s rule10.168.628.8$0.011*
- 241openJev Verdictv1.7 · 10 s rule4.186.626.6$0.0028*
- 242Tacet Sonatav1.7 · 10 s rule2.289.024.2$0.0023*
- 243CLM-8Bv1.7 · 10 s rule0.173.720.1$0.0075*
- 244ClassOne Qwen 3.5 2Bv1.6.9 drawv1.7 · 10 s rule5.885.819.2$0.0030*
- 245Deem 0.8B v1v1.7 · 10 s rule6.586.818.1$0.0027*
- 246Laya multilingualv1.7 · 10 s rule0.382.217.0$0.0039*
- 247ClassOne Gemma 4 E2Bv1.7 · 10 s rule7.885.815.2$0.0030*
- 248Julia-1v1.6.43 drawv1.7 · 10 s rule2.489.79.9$0.0022*
- 249Raw Qwen3 1.7B direct logitsv1.7 · 10 s rule5.184.18.3$0.0034*
- 250Raw Qwen3 0.6B direct logitsv1.7 · 10 s rule5.684.18.2$0.0034*
Wide coloured bar = Capability Score (0–100). Thin bars: cost above, median latency below; shared log ratio scale 0.25× … 64× Jev (v1.5 reference), ticks at 1× and 2× (cap). Shorter is cheaper or faster. * = est. (estimated cost). # counts ranked Jev-class systems; “–” marks unranked or outside systems. Tap ⓘ or hover a row or thin bar for details.
Cost and latency correlate here (Spearman ρ = 0.26, n = 288).
- Jev — reference (TypeSafe, closed) (2)
- Closed API (weights not public) (32)
- Open weights · LLM decoder (214)
- Open weights · diffusion LM (6)
- Open weights · encoder / classifier (21)
- Open weights · reranker (5)
- Base model control (no decision fine-tune, raw logits) (5)
- System (router / cascade / ensemble) (3)
- green: ≤ reference
- amber: ≤ cap (2× reference)
- red: > cap
Show general-purpose LLMs and other systems outside the limits
Sorted by Capability Score, not numbered. Each row says which limit it misses, measured against Jev ($0.032 per 1,000 decisions, median 0.62 s).
- –GPT-6 Luna (medium)APIv1.7 · 10 s rule96.938.498.4$0.11Outside: cost 3.5× Jev (v1.5 reference), latency 3.1× Jev (v1.5 reference)
- –GPT-6 Luna (low)APIv1.7 · 10 s rule95.739.097.1$0.11Outside: cost 3.3× Jev (v1.5 reference), latency 3.1× Jev (v1.5 reference)
- –GPT-5.6 LunaAPIv1.7 · 10 s rule93.030.293.6$0.21Outside: cost 6.6× Jev (v1.5 reference), latency 2.6× Jev (v1.5 reference)
- –DeepSeek V4.1 FlashAPIv1.7 · 10 s rule84.519.689.6$0.48Outside: cost 14.9× Jev (v1.5 reference), latency 3.6× Jev (v1.5 reference)
- –AJev lm6qv1.7.0 drawv1.7 · 10 s rule71.544.281.4$0.073*Outside: cost 2.2× Jev (v1.5 reference)
- –SPX-CD ProAPIv1.7 · 10 s rule64.643.178.5$0.079*Outside: cost 2.4× Jev (v1.5 reference)
- –Amos 1 largeAPIv1.6.43 drawv1.7 · 10 s rule68.230.078.0$0.21*Outside: cost 6.6× Jev (v1.5 reference)
- –Fastino GLiDEAPIv1.7 · 10 s rule66.135.977.0$0.14Outside: cost 4.3× Jev (v1.5 reference)
- –wity-1APIv1.7 · 10 s rule67.958.876.9$0.024Outside: latency 3.0× Jev (v1.5 reference)API price · eligibility checked at the developer's list price; at base-model pricing it would exceed the cost cap (2.70× Jev)
- –Aleria Judge 1.1.1v1.7.0 drawv1.7 · 10 s rule68.041.176.9$0.092*Outside: cost 2.8× Jev (v1.5 reference)
- –OpenJevv1.7 · 10 s rule70.254.975.8$0.032*Outside: latency 3.1× Jev (v1.5 reference)
- –SimpleJev Qwen3.8-27Bv1.7 · 10 s rule57.942.574.9$0.083*Outside: cost 2.6× Jev (v1.5 reference), latency 2.3× Jev (v1.5 reference)
- –Sage 1.4APIv1.6.43 drawv1.7 · 10 s rule63.759.573.3$0.022*Outside: latency 2.8× Jev (v1.5 reference)
- –Autoloops – Gemma 4 31B ITAPIv1.7 · 10 s rule58.140.572.7$0.096Outside: cost 3.0× Jev (v1.5 reference)
- –SimpleJev Qwen3.8-27BAPIv1.7 · 10 s rule52.914.971.6$0.69*Outside: cost 21.3× Jev (v1.5 reference), latency 2.1× Jev (v1.5 reference)
- –SimpleJev Qwen3.6-35B-A3BAPIv1.7 · 10 s rule56.335.168.3$0.15*Outside: cost 4.5× Jev (v1.5 reference), latency 2.1× Jev (v1.5 reference)
- –Open-Jev 27B v1.1v1.7 · 10 s rule52.541.768.0$0.088*Outside: cost 2.7× Jev (v1.5 reference), latency 2.9× Jev (v1.5 reference)
- –LitJevv1.7 · 10 s rule43.355.766.6$0.030*Outside: latency 5.1× Jev (v1.5 reference)
- –Bev / Bonsai 27Bv1.7 · 10 s rule43.855.766.1$0.030*Outside: latency 3.5× Jev (v1.5 reference)
- –Open-Jev 9Bv1.7 · 10 s rule43.952.761.8$0.038*Outside: latency 2.3× Jev (v1.5 reference)
- –Standard One 8B SHv1.6.9 drawv1.7 · 10 s rule34.543.260.0$0.078*Outside: cost 2.4× Jev (v1.5 reference)
- –Gemini 3.1 Flash-LiteAPIv1.7 · 10 s rule58.629.259.8$0.23Outside: cost 7.1× Jev (v1.5 reference)
- –reflex 4Bv1.7 · 10 s rule30.877.758.9$0.0055*Outside: latency 4.7× Jev (v1.5 reference)
- –openjev-sglangAPIv1.7 · 10 s rule38.835.658.7$0.14*Outside: cost 4.3× Jev (v1.5 reference), latency 2.1× Jev (v1.5 reference)
- –Standard One 8Bv1.7 · 10 s rule32.843.358.4$0.078*Outside: cost 2.4× Jev (v1.5 reference)
- –Nev-2Bv1.6.43 drawv1.6 · re-measure pending20.286.649.9$0.0028*Outside: latency 20.8× Jev (v1.5 reference)
- –Qwen3.8 27BAPIv1.7 · 10 s rule33.40.048.6$2.18*Outside: cost 67.4× Jev (v1.5 reference), latency 13.5× Jev (v1.5 reference)
- –Laya typed-decisionsv1.7 · 10 s rule5.582.544.2$0.0038*Outside: latency 3.5× Jev (v1.5 reference)
- –Qwen3.5-0.8B Decision Modelv1.6 · re-measure pending7.386.142.6$0.0029*Outside: latency 18.3× Jev (v1.5 reference)
- –Gutsy 0.8B v0.3v1.6.9 drawv1.7 · 10 s rule8.684.942.2$0.0032*Outside: latency 3.1× Jev (v1.5 reference)
- –Reflex Instinct 0.6Bv1.6.43 drawv1.6 · re-measure pending4.086.438.6$0.0028*Outside: latency 6.3× Jev (v1.5 reference)
- –Vega-Uv1.6.43 drawv1.7 · 10 s rule5.385.836.1$0.0030*Outside: latency 2.6× Jev (v1.5 reference)
- –open-jev-deberta-v3-largev1.7 · 10 s rule2.877.635.4$0.0056*Outside: latency 5.7× Jev (v1.5 reference)
- –modernbert-jev v2v1.6.9 drawv1.6 · re-measure pending2.670.434.6$0.0097*Outside: latency 8.7× Jev (v1.5 reference)
- –Layav1.7 · 10 s rule1.884.932.5$0.0032*Outside: latency 3.3× Jev (v1.5 reference)
- –SimpleJevv1.7 · 10 s rule12.776.931.1$0.0059*Outside: latency 14.9× Jev (v1.5 reference)
- –Mirrorv1.7 · 10 s rule0.089.325.8$0.0023*Outside: latency 2.1× Jev (v1.5 reference)
Jev-class = cost per decision at most 2× Jev's (≤ $0.065 per 1,000 decisions) and median latency at most 2× Jev's (≤ 1.23 s), the adjusted p50 — the same median the speed chart plots, not the four-axis Speed score. 251 of 288 systems qualify; the other 37, including the general-purpose LLMs, are listed below the divider in the ranking. The charts below show speed and cost beside Capability Score; the official JevBench Score weighs all four axes.
Capability against cost and speed
Jev-class systems are shown by default. Bubble size follows the official JevBench Score; official rank stays unchanged. The five most capable Jev-class systems are labelled.
Capability vs cost
Upper right is best: more capable and cheaper. Cost is USD per 1,000 decisions on a log scale. The dashed line is 2× Jev’s cost.
Capability vs speed
Upper right is best: more capable and faster. Speed here is the median-latency speed — the same adjusted median (p50) latency the Jev-class limit uses — a log scale, so each 20 points is 10× faster (median under the numbers). Self-hosted systems are plotted at the est. incl. network latency (2x measured + 150 ms); their measured loopback p50 (on-GPU, no network; not directly comparable with API latency) is in the tooltip. The dashed line is 2× Jev’s median latency.
- Jev — reference (TypeSafe, closed) (2)
- Closed API (weights not public) (31)
- Open weights · LLM decoder (214)
- Open weights · diffusion LM (6)
- Open weights · encoder / classifier (21)
- Open weights · reranker (5)
- Base model control (no decision fine-tune, raw logits) (5)
- System (router / cascade / ensemble) (3)
- faint = outside Jev-class
Model kind
Jev-class
Release
No system in this release reports an exact parameter count.
JevBench v1.8.2
JevBench Composite Score: 283 ranked systems
Official· four axes 0–100, equal-weight harmonic mean · Method notes ↓
Adjust weights ↓
The official order weighs Intelligence, Calibration, Speed and Cost equally. Each button re-sorts the same systems by one axis, and the column headings sort too.
Greener = stronger within its column.
288 of 288 systems, sorted by official rank, #1 first.
- 1Torchcast Decision 4B (v1.3)fine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource80.5I 67C 88S 92K 79est.$0.0049
- 2Super DeciderAPIfine-tune · 26B-A4B · NVFP4Base model: undisclosed78.5I 79C 91S 85K 64$0.016
- 3Myles-G 12BAPIClosed APIBase model: google/gemma-4-12B-it (self-reported)*178.2I 57C 84S 85K 99est.$0.0011
- 4H2O-Lightning-4B v1.1fine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource77.9I 60C 90S 92K 79est.$0.0052
- 5kettei-fatAPIClosed APIBase model: undisclosed77.7I 80C 93S 93K 57est.$0.026
- 6Wald 26B-A4Bfine-tune · 26B-A4B · bf16Base model: google/gemma-4-26B-A4B-itsource77.5I 66C 88S 92K 71est.$0.0093
- 7Torchcast Decision 4B (v1.2)fine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource77.0I 60C 85S 91K 79est.$0.0049
- 8Fastino GLiDE (hosted API, 22 Oct 2026)APIClosed APIBase model: undisclosed*276.4I 76C 93S 87K 59$0.023
- 9d1-ultraAPIClosed APIBase model: undisclosed76.0I 70C 91S 89K 62est.$0.018
- 10Fastino GLiDE 1.2fine-tune · 27B · bf16Base model: undisclosed75.9I 76C 93S 85K 58est.$0.025
- 11Bobcat Flash 1.2fine-tune · 26B / 4B active · FP8 on loadBase model: google/gemma-4-26B-A4B-itsource75.8I 66C 81S 91K 71est.$0.0092
- 12SubQ Snap 1.1APIClosed APIBase model: undisclosed75.7I 76C 88S 85K 61est.$0.020
- 13H2O-Lightning-31B v1.0.7fine-tune · 31BBase model: google/gemma-4-31B-itsource75.7I 79C 89S 90K 56est.$0.029
- 14StartLux-Decision v1.1 27B Instantfine-tune · 27BBase model: undisclosed75.6I 73C 92S 90K 58est.$0.025
- 15Drex MaxAPIClosed APIBase model: undisclosed*375.4I 79C 90S 90K 55$0.031
- 16baselabs mammoth-1fine-tune · 27B · bf16Base model: Qwen/Qwen3.5-27Bsource75.4I 76C 94S 84K 57est.$0.027
- 17Decisio 12B tuned commitmerge · 12B · BF16Base model: google/gemma-4-12B-itsource75.2I 63C 89S 90K 67est.$0.013
- 18Jeff-1.1-Mediumfine-tune · 12B · BF16Base model: google/gemma-4-12B-itsource75.1I 74C 89S 74K 66est.$0.013
- 19Philly Decider v2fine-tune · 4B · BF16Base model: h2oai/h2o-lightning-4bsource75.0I 56C 83S 93K 79est.$0.0050
- 20Perplexity Decider v1.1 27Bfine-tune · 27BBase model: Qwen/Qwen3.8-27Bsource74.9I 76C 90S 86K 57est.$0.026
Show all 288 systems (263 more ranked, 5 more not ranked)
- 21Bespoke Nimble-v4-maxAPIClosed APIBase model: undisclosed74.8I 68C 91S 88K 61est.$0.020
- 22Chon-1.0-E4Bfine-tune · 4BBase model: google/gemma-4-E4B-itsource74.7I 55C 82S 89K 84est.$0.0035
- 23vLLM-SR d3-turbofine-tune · 27BBase model: undisclosed74.7I 75C 90S 86K 57est.$0.027
- 24vLLM-SR d3fine-tune · 26BBase model: Qwen/Qwen3.8-27Bsource74.6I 73C 91S 87K 57est.$0.027
- 25Super Decider (thinking)APIfine-tune · 26B-A4B · NVFP4Base model: undisclosed74.5I 80C 92S 80K 56$0.028
- 26KnowLine 26B-A4B-Gen2.5fine-tune · 26B-A4BBase model: google/gemma-4-26B-A4B-itsource74.4I 65C 89S 89K 62est.$0.018
- 27Torchcast Decision 4B (v1.1)fine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource74.4I 54C 83S 94K 79est.$0.0049
- 28SubQ SnapAPIClosed APIBase model: undisclosed74.4I 72C 91S 86K 58est.$0.026
- 29KnowLine 35B-A3B-Gen1.5fine-tune · 35B-A3B · fp8Base model: Qwen/Qwen3.5-35B-A3Bsource74.1I 60C 93S 92K 64est.$0.016
- 30basal-omni-1.0-ultramerge · 31BBase model: google/gemma-4-31B-itsource74.1I 74C 90S 87K 56est.$0.029
- 31Xor 26B-A4Bmerge · 26B-A4BBase model: google/gemma-4-26B-A4B-itsource74.0I 57C 85S 91K 72est.$0.0085
- 32torchcast-decision-27bmerge · 27BBase model: startlux-models/StartLux-Decision-27Bsource 1source 2*474.0I 70C 90S 88K 58est.$0.026
- 33Arcbright Elf 1 31Bfine-tune · 31B · bf16Base model: google/gemma-4-31B-itsource74.0I 72C 92S 90K 55est.$0.031
- 34pplx-decider-v1.2fine-tune · 27BBase model: Qwen/Qwen3.8-27Bsource73.9I 72C 90S 86K 57est.$0.026
- 35Quyet-1.0-Largeadapter · 31BBase model: google/gemma-4-31B-itsource73.8I 73C 90S 86K 56est.$0.030
- 36Nimble-v4-maxfine-tune · 27BBase model: Qwen/Qwen3.8-27Bsource73.8I 71C 91S 85K 57est.$0.026
- 37Sage 1.3.0APIClosed APIBase model: undisclosed73.7I 66C 92S 92K 58est.$0.025
- 38decider-12b v2fine-tune · 12BBase model: google/gemma-4-12B-itsource73.7I 62C 81S 90K 68est.$0.012
- 39Xevn-4Bfine-tune · 4B · bf16Base model: Qwen/Qwen3.5-4Bsource73.7I 52C 85S 92K 81est.$0.0045
- 40kettei-chubAPIClosed APIBase model: undisclosed73.4I 62C 84S 95K 63est.$0.018
- 41Surogate Rune 26B-A4B v326B-A4BBase model: google/gemma-4-26B-A4B-itsource*573.4I 56C 91S 87K 71est.$0.0092
- 42Jeff-1.0-Largefine-tune · 31BBase model: google/gemma-4-31B-itsource73.4I 72C 91S 88K 55est.$0.033
- 43Lychee-27Bfine-tune · 27B · bf16Base model: Qwen/Qwen3.8-27Bsource73.3I 74C 85S 84K 57est.$0.026
- 44decisio v0.8.0 on gemma-4-31B-it31B · FP8 on loadBase model: google/gemma-4-31B-itsource73.2I 70C 89S 91K 55est.$0.032
- 45decider-12b v1, stock Gemma-4-12B-it12BBase model: google/gemma-4-12B-itsource73.2I 60C 83S 90K 68est.$0.012
- 46vLLM-SR d3-minifine-tune · 4B · bf16Base model: Qwen/Qwen3.5-4Bsource73.2I 51C 87S 93K 79est.$0.0051
- 47Sieve-31B-v2fine-tune · 31B · BF16Base model: google/gemma-4-31B-itsource73.1I 69C 93S 86K 56est.$0.029
- 48d1APIClosed APIBase model: undisclosed72.8I 62C 87S 88K 63$0.017
- 49Vera Largefine-tune · 27B · bf16Base model: Qwen/Qwen3.8-27Bsource72.8I 68C 91S 88K 56est.$0.029
- 50iota-decide-4b-v0.3fine-tune · 4B · BF16Base model: Qwen/Qwen3.5-4Bsource72.8I 53C 85S 87K 79est.$0.0051
- 51swanOneNVFP4Base model: Mia-AiLab/Qwen3.8-Flash-Next-NVFP4source72.5I 56C 89S 83K 71est.$0.0090
- 52Mercury DecideAPISystemBase model: undisclosedsource72.2I 66C 81S 85K 62est.$0.018
- 53Winnow-12B Q8merge · 12B · GGUF Q8_0Base model: google/gemma-4-12B-itsource72.2I 60C 83S 86K 67est.$0.013
- 54Bobcat 1.3fine-tune · 31B · fp8Base model: google/gemma-4-31B-itsource72.2I 68C 88S 89K 55est.$0.031
- 55JPT-35B-A3Bmerge · 35B-A3BBase model: Qwen/Qwen3.5-35B-A3Bsource72.2I 51C 90S 90K 72est.$0.0083
- 56Chon-1.0-12B-Fastadapter · 12B · bf16Base model: google/gemma-4-12B-itsource72.0I 60C 80S 84K 69est.$0.011
- 57baselabs elephant-1fine-tune · 9B · bf16Base model: Qwen/Qwen3.5-9Bsource72.0I 56C 85S 90K 68est.$0.012
- 58metask-jev-rain-31B-trainedadapter · 31B · W4A16 INT4Base model: google/gemma-4-31B-itsource72.0I 71C 87S 82K 56est.$0.029
- 59deck-31B31B · FP8Base model: google/gemma-4-31B-itsource71.9I 73C 82S 86K 55est.$0.032
- 60Cygnet12BBase model: google/gemma-4-12B-itsource71.9I 55C 87S 91K 67est.$0.013
- 61metask-jev-rain-12B-trainedadapter · 12B · W4A16 INT4Base model: google/gemma-4-12B-it-qat-q4_0-unquantizedsource71.7I 66C 87S 72K 65est.$0.014
- 62DOPEST 1.0 31Bfine-tune · 31B · BF16Base model: google/gemma-4-31B-itsource71.7I 74C 90S 82K 53est.$0.038
- 63Eikos-27Badapter · 27BBase model: Qwen/Qwen3.8-27Bsource71.6I 64C 90S 88K 56est.$0.029
- 64Jev 1.13.0APIJev referenceBase model: undisclosed71.4I 64C 91S 91K 55$0.032
- Microsoft-Decision-1 (Azure Foundry) — A2 re-run (preliminary)APIPRELIMINARY — API supplement A2 (300 sealed + 300 public), not the S1200 full set; equating pool 4 of 6Closed APIBase model: Qwen3.5-9Bsource · Base model disclosed by Microsoft; the Decision-1 endpoint is evaluated as a hosted API offering.71.4I 59C 85S 89K 62$0.018
- 65Jeffan-31b-1710fine-tune · 31B · bf16Base model: google/gemma-4-31B-itsource71.3I 72C 92S 85K 51est.$0.042
- 66Kev 27Bfine-tune · 27BBase model: Qwen/Qwen3.8-27Bsource71.3I 64C 94S 83K 56est.$0.029
- 67Jev-Omnifine-tuneBase model: google/gemma-4-12B-itsource71.0I 56C 87S 85K 66est.$0.013
- 68Celeris-1 DecisionAPIClosed APIBase model: undisclosed71.0I 59C 88S 87K 60est.$0.021
- 69GEV-26B-Decidedistilled · 26B-A4BBase model: google/gemma-4-26B-A4B-itsource70.8I 50C 90S 90K 73est.$0.0082
- 70decisio v0.8.0 on gemma-4-12B-it12BBase model: google/gemma-4-12B-itsource70.6I 52C 89S 86K 68est.$0.012
- 71Myles-G 31BAPIClosed APIBase model: google/gemma-4-31B-it (self-reported)*670.6I 74C 84S 86K 51est.$0.043
- 72RSI-Jev v6.1-VL 27Bmerge · 27BBase model: Qwen/Qwen3.8-27Bsource70.4I 62C 85S 85K 59est.$0.024
- 73Nagi-ENORMOUS 27Badapter · 27BBase model: Qwen/Qwen3.8-27Bsource70.3I 62C 85S 86K 57est.$0.026
- 74StartLux-Decision v1.1 27B AutoThinkfine-tune · 27BBase model: undisclosed70.2I 67C 91S 75K 57est.$0.028
- 75Jev 1.14.0APIJev referenceBase model: undisclosed70.2I 60C 90S 91K 55est.$0.032
- 76metask-jev-rain-31B-trained service v3adapter · 31B · W4A16 INT4Base model: google/gemma-4-31B-itsource70.2I 73C 87S 73K 55est.$0.031
- 77decisio v0.9.0 on gemma-4-12B-it12BBase model: google/gemma-4-12B-itsource70.1I 52C 88S 85K 68est.$0.012
- 78Bespoke Nimble 9B v3adapter · 9BBase model: Qwen/Qwen3.5-9Bsource70.0I 57C 77S 89K 66est.$0.014
- 79JEV-27Bdistilled · 27BBase model: Qwen/Qwen3.8-27Bsource69.9I 57C 91S 86K 59est.$0.024
- 80torchcast-decision-12badapter · 12BBase model: google/gemma-4-12B-itsource69.8I 61C 83S 91K 56est.$0.028
- 81Messier One v0.4fine-tune · 4BBase model: undisclosed69.8I 52C 73S 89K 76est.$0.0065
- 82shisa-de-1fine-tune · 26B-A4BBase model: google/gemma-4-26B-A4B-itsource69.7I 50C 81S 93K 71est.$0.0092
- 83Microsoft-Decision-1 (Azure Foundry)APIClosed APIBase model: Qwen3.5-9Bsource*769.1I 57C 84S 81K 61$0.019
- 84Cleffine-tuneBase model: Qwen/Qwen3.8-27BsourceWorkers AI price scenario (latency unmeasured): 29.4 (would be #167)69.0I 59C 92S 83K 55est.$0.030
- 85wity-1APIClosed APIBase model: undisclosedBase-model reference price (base undisclosed at the author's request): 43.0 (would be #140)69.0I 68C 86S 68K 59$0.024
- 86Wald 4B v2.1fine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource68.9I 52C 87S 93K 61est.$0.020
- 87Hopper 12B trainedfine-tune · 12BBase model: google/gemma-4-12B-itsource68.8I 52C 85S 84K 67est.$0.013
- 88Blink v0.3 26B-A4Bfine-tune · 26B-A4B · NVFP4Base model: google/gemma-4-26B-A4B-itsource68.7I 49C 91S 91K 71est.$0.0092
- 89Decision 2.0 Vega 27Badapter · 27BBase model: Qwen/Qwen3.8-27Bsource 1source 268.7I 60C 82S 83K 57est.$0.027
- 90René-1 31B FP8fine-tune · 31B · FP8Base model: google/gemma-4-31B-itsource68.6I 62C 90S 87K 51est.$0.042
- 91AutoJev-27Bfine-tune · 27BBase model: Qwen/Qwen3.8-27Bsource68.6I 56C 88S 88K 57est.$0.028
- 92OpenJev26B-A4BBase model: google/diffusiongemma-26B-A4B-itsource 1source 268.4I 70C 81S 73K 55est.$0.032
- 93Jebadiah 27Bmerge · 27BBase model: Qwen/Qwen3.8-27Bsource68.3I 57C 83S 85K 57est.$0.026
- 94decider chat on Gemma-4-31B-it31BBase model: google/gemma-4-31B-itsource68.1I 59C 82S 86K 56est.$0.029
- 95attest-31B-v1.0APIbase · 31BBase model: undisclosed67.9I 65C 74S 96K 51est.$0.044
- 96NInfer Qwen3.8-Flash-Next mixedLLM decoderBase model: Qwen3.8-Flash-Nextsource67.8I 49C 90S 89K 72est.$0.0087
- 97Metask rain 4Bfine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource67.7I 51C 81S 78K 70est.$0.010
- 98Sage 1.4APIClosed APIBase model: undisclosed67.7I 64C 83S 69K 59est.$0.022
- 99FrontiersMind Lumma-fev-27Bfine-tune · 27B · bf16Base model: Qwen/Qwen3.8-27Bsource67.6I 55C 89S 85K 55est.$0.032
- 100Respan Span-02LLM decoderBase model: google/gemma-4-26B-A4B-itsource67.1I 61C 78S 86K 54est.$0.035
- 101NInfer Qwen3.8-27B NVFP427BBase model: Qwen3.8-27Bsource66.7I 52C 84S 90K 56est.$0.028
- 102SPX-CD FlashAPISystemBase model: undisclosedsource66.6I 58C 90S 79K 52est.$0.039
- 103decider-35b-a3bfine-tune · 35B-A3BBase model: Qwen/Qwen3.5-35B-A3B-Basesource66.5I 49C 84S 91K 73est.$0.0078
- 104Diffusion Jev26B / 4B activeBase model: google/diffusiongemma-26B-A4B-itsource66.5I 55C 61S 86K 71est.$0.0091
- 105SPX-CD-Omnifine-tune · 12BBase model: google/gemma-4-12B-itsource66.0I 49C 87S 89K 69est.$0.011
- 106OpenAI DecisionsAPIClosed APIBase model: undisclosed62.4I 57C 90S 88K 49$0.052
- 107InstinctAPIClosed APIBase model: Qwen3.8-27Bsource*862.2I 48C 93S 87K 64$0.015
- 108HS1 0.1.2APIClosed APIBase model: google/gemma-4-26B-A4B-it (self-reported)*961.1I 53C 76S 94K 49est.$0.050
- 109KnowLine 31B-Gen1fine-tune · 31B · bf16Base model: google/gemma-4-31B-itsource60.2I 77C 93S 81K 46est.$0.061
- 110Amazon Strands Decider 26B-A4Badapter · 26B-A4B · bf16Base model: google/gemma-4-26B-A4B-itsource60.0I 47C 87S 88K 72est.$0.0086
- 111Turion Jev 31Bfine-tune · 31B · fp8Base model: google/gemma-4-31B-itsource59.6I 71C 91S 86K 47est.$0.060
- 112KnowLine 4B-Gen5.5fine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource59.2I 46C 86S 93K 70est.$0.010
- 113JevOneadapterBase model: Qwen/Qwen3.6-35B-A3Bsource58.7I 46C 92S 90K 73est.$0.0081
- 114Seb-9B-v2fine-tune · 9B · bf16Base model: Qwen/Qwen3.5-9Bsource57.6I 46C 84S 92K 69est.$0.011
- 115pplx-decider-flash-v1.2fine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource56.7I 45C 78S 91K 79est.$0.0050
- 116APUS-OpenJev-v1-9Bfine-tune · 9BBase model: Qwen/Qwen3.5-9Bsource56.6I 47C 67S 82K 68est.$0.011
- 117Aplomb 1fine-tune · 5.3BBase model: Qwen/Qwen3.5-4Bsource56.0I 45C 89S 89K 72est.$0.0083
- 118JADEadapter · 27BBase model: Qwen/Qwen3.8-27Bsource53.5I 48C 51S 85K 61est.$0.020
- 119Tern-35B-A3Bfine-tune · 35B-A3B · bf16Base model: Qwen/Qwen3.6-35B-A3Bsource52.7I 44C 89S 91K 71est.$0.0090
- 120AJev lm6qadapter · 31B · bf16Base model: google/gemma-4-31B-itsource52.3I 71C 91S 82K 44est.$0.073
- 121Arcbright Elf 1 12Bfine-tune · 12B · bf16Base model: google/gemma-4-12B-itsource51.0I 44C 86S 92K 68est.$0.012
- 122Plumb-4Bfine-tune · 4BBase model: alibiserikbay/JevK5source50.4I 43C 88S 94K 78est.$0.0056
- 123SPX-CD ProAPISystemBase model: undisclosedsource47.6I 65C 92S 77K 43est.$0.079
- 124Messier One v0.2fine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource47.4I 42C 74S 93K 79$0.0048
- 125spark-s1-4b-v6adapter · 4BBase model: Qwen3.5-4Bsource47.1I 43C 65S 86K 75est.$0.0068
- 126Bev / Bonsai 27B27B · GGUF PQ2_0Base model: Qwen/Qwen3.8-27Bsource46.6I 44C 89S 73K 56est.$0.030
- 127Clef-Flashfine-tuneBase model: Qwen/Qwen3.5-9BsourceWorkers AI price scenario (latency unmeasured): 39.1 (would be #150)46.1I 42C 85S 88K 66est.$0.013
- 128Quyet-1.0-Mediumadapter · 4BBase model: Qwen/Qwen3.5-4Bsource45.7I 42C 77S 89K 78est.$0.0054
- 129Open-Jev 9Badapter · 9BBase model: Qwen/Qwen3.5-9Bsource45.5I 44C 80S 74K 53est.$0.038
- 130LitJev27BBase model: Qwen/Qwen3.8-27Bsource44.8I 43C 90S 68K 56est.$0.030
- 131Bespoke Nimble 9Badapter · 9BBase model: Qwen3.5-9Bsource44.5I 43C 70S 86K 56est.$0.028
- 132SimpleJev Qwen3.8-27B (self-hosted, v1.6 pool)27BBase model: Qwen/Qwen3.8-27Bsource44.5I 58C 92S 76K 42est.$0.083
- 133Qwen3.5-9B Jev-like data-mix v2adapter · 9BBase model: Qwen/Qwen3.5-9Bsource44.4I 42C 80S 85K 65est.$0.014
- 134levadapter · 4BBase model: Qwen/Qwen3.5-4Bsource44.3I 41C 82S 88K 76est.$0.0061
- 135JPT-4Bmerge · 4BBase model: Qwen/Qwen3.5-4Bsource44.2I 41C 87S 88K 79est.$0.0051
- 136jev-local9BBase model: Qwen/Qwen3.5-9Bsource43.8I 42C 73S 73K 79est.$0.0052
- 137Aleria Judge 1.1.131B · bf16Base model: undisclosed43.5I 68C 86S 86K 41est.$0.092
- 138Bespoke Nimble-v4APIClosed APIBase model: undisclosed43.2I 41C 87S 89K 61est.$0.020
- 139decider-4b v2adapter · 4BBase model: Qwen/Qwen3.5-4B-Basesource43.1I 40C 90S 90K 79est.$0.0050
- 140Jeffan-4B-2010fine-tune · 4B · bf16Base model: Qwen/Qwen3.5-4Bsource43.0I 40C 88S 93K 79est.$0.0051
- 141ClassOne Qwen 3.5 9B9BBase model: Qwen/Qwen3.5-9Bsource43.0I 42C 59S 90K 69est.$0.011
- 142Vansa-3.4APIClosed APIBase model: Qwen3.5-4B (self-reported)*1042.6I 41C 87S 95K 62$0.019
- 143Wald 4Bfine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource42.4I 41C 78S 82K 71est.$0.0096
- 144Open-Jev 27B v1.1adapter · 27BBase model: Qwen/Qwen3.8-27Bsource40.5I 52C 83S 72K 42est.$0.088
- 145GPT-6 Luna (low reasoning effort)APIClosed APIBase model: undisclosed40.4I 96C 98S 72K 39$0.108
- 146GLiClass v4 9Bfine-tune · 9B · BF16Base model: Qwen/Qwen3.5-9Bsource40.2I 40C 87S 86K 71est.$0.0093
- 147Autoloops – Gemma 4 31B ITAPIClosed APIBase model: undisclosed40.2I 58C 87S 84K 40$0.096
- 148metask-jev-4b4BBase model: Qwen3.5-4Bsource39.9I 39C 84S 90K 76est.$0.0063
- 149Kahn1 4Bfine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource39.6I 40C 84S 89K 65est.$0.015
- 150JevK5 v0.3adapterBase model: Qwen/Qwen3.5-4Bsource39.2I 39C 90S 94K 78est.$0.0056
- 151GPT-6 Luna (default medium reasoning effort)APIClosed APIBase model: undisclosed39.1I 97C 100S 71K 38$0.113
- 152deck-4B v1.0adapter · FP8Base model: alibiserikbay/JevK5 (built on Qwen/Qwen3.5-4B)source 1source 239.0I 39C 89S 90K 78est.$0.0054
- 153Seb-9Bfine-tune · 9B · bf16Base model: Qwen/Qwen3.5-9Bsource37.2I 38C 88S 91K 69est.$0.011
- 154Decision-4BadapterBase model: Qwen/Qwen3.5-4Bsource37.0I 38C 80S 91K 80est.$0.0045
- 155decisor-4bfine-tune · 4B · FP8Base model: Qwen/Qwen3.5-4Bsource36.8I 40C 52S 92K 79est.$0.0051
- 156janus 4Bfine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource36.8I 38C 88S 93K 79est.$0.0050
- 157Jebadiah 9B v2.1merge · 9BBase model: Qwen/Qwen3.5-9Bsource34.7I 37C 90S 91K 69est.$0.011
- 158JevK5 v0.2.0adapter · 4BBase model: Qwen3.5-4Bsource33.6I 36C 89S 91K 78est.$0.0056
- 159Amos 1 mediumAPI9BBase model: undisclosed31.6I 38C 88S 86K 49est.$0.051
- 160Decision 2.0 Lux 9BLLM decoderBase model: vllm-sr/Decision-1.0-Lux-9Bsource31.5I 36C 87S 90K 68est.$0.012
- 161Verdin-4Bmerge · 4BBase model: Qwen/Qwen3.5-4Bsource31.3I 35C 84S 90K 77est.$0.0060
- 162TypeCastLM 1.4.03.8BBase model: Qwen/Qwen3.5-4Bsource31.1I 35C 77S 93K 79est.$0.0049
- 163blink-4bmerge · 4BBase model: Qwen/Qwen3.5-4Bsource30.8I 35C 88S 91K 78est.$0.0054
- 164Fastino GLiDEAPIClosed APIBase model: undisclosed30.6I 66C 88S 77K 36$0.137
- 165Imajev-9Badapter · 9BBase model: Qwen/Qwen3.5-9Bsource30.4I 37C 88S 79K 50est.$0.045
- 166jiwo 4bfine-tune · 4.2BBase model: Qwen/Qwen3.5-4Bsource30.3I 35C 86S 92K 79est.$0.0052
- 167Imajev-4Badapter · 4BBase model: Qwen/Qwen3.5-4Bsource30.0I 35C 89S 90K 78est.$0.0055
- 168Uniphore-4B-Deciderfine-tune · 4BBase model: undisclosed28.3I 34C 80S 87K 79est.$0.0050
- 169Malkuth-4Badapter · 4BBase model: Qwen/Qwen3.5-4B-Basesource28.2I 34C 88S 89K 77est.$0.0056
- 170Hopperadapter · 4BBase model: Qwen/Qwen3.5-4Bsource27.7I 34C 89S 91K 77est.$0.0059
- 171SimpleJev Qwen3.6-35B-A3BAPI35B-A3BBase model: undisclosedsource27.5I 56C 80S 76K 35est.$0.145
- 172Decisio v0.9.0 on Qwen3.6-35B-A3Bpipeline · 35B-A3B · FP8Base model: undisclosed27.2I 34C 89S 91K 62est.$0.019
- 173Clef-omnifine-tune · 30B-A3BBase model: Qwen/Qwen3-Omni-30B-A3B-Instructsource26.9I 34C 82S 87K 56est.$0.029
- 174JEB-35B-A3Bfine-tune · 35B-A3BBase model: Qwen/Qwen3.6-35B-A3Bsource26.8I 33C 90S 93K 72est.$0.0084
- 175jqv32BBase model: Qwen3-32Bsource25.8I 34C 90S 82K 55est.$0.032
- 176CoCo-Decision-4Bfine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource25.7I 33C 81S 91K 80est.$0.0047
- 177Decision 4B v1.2adapter · 4BBase model: Qwen/Qwen3.5-4Bsource25.6I 32C 88S 94K 78est.$0.0056
- 178Manchego v2.1adapter · 4BBase model: Qwen/Qwen3.5-4Bsource25.5I 33C 84S 91K 79est.$0.0051
- 179Standard One 3B SH v4fine-tune · 3B · bf16Base model: StandardThinking/StandardOne-3Bsource24.4I 34C 78S 93K 49est.$0.052
- 180Raw Qwen3 4B Instruct 2507 direct logitsoriginal · 4BBase model: Qwen/Qwen3-4B-Instruct-2507 (unmodified)source22.6I 34C 35S 91K 78est.$0.0055
- 181Standard One 3B SHfine-tune · 3BBase model: StandardThinking/StandardOne-3Bsource21.6I 33C 78S 86K 49est.$0.052
- 182GPT-5.6 LunaAPIClosed APIBase model: undisclosed21.4I 93C 94S 73K 30$0.213
- 183Jebadiah 9B v2merge · 9BBase model: Qwen/Qwen3.5-9Bsource21.3I 31C 83S 91K 69est.$0.011
- 184reflex 4Badapter · 4BBase model: Qwen/Qwen3.5-4Bsource21.3I 31C 87S 69K 78est.$0.0055
- 185typecastlm4BBase model: Qwen3.5-4Bsource20.5I 30C 83S 93K 79est.$0.0052
- 186Amos 1 largeAPI27BBase model: undisclosed20.3I 68C 88S 83K 30est.$0.215
- 187iota-decide-4bfine-tune · 4B · bf16Base model: Qwen/Qwen3.5-4B-Basesource19.7I 29C 85S 87K 78est.$0.0056
- 188Decision 4B v1.1adapter · 4BBase model: Qwen/Qwen3.5-4Bsource19.5I 29C 85S 94K 78est.$0.0056
- 189Standard One 8B SHfine-tune · 8BBase model: StandardThinking/StandardOne-8Bsource18.7I 34C 85S 84K 43est.$0.078
- 190kev 8Badapter · 8BBase model: Qwen/Qwen3-8B-Basesource18.5I 29C 71S 88K 69est.$0.011
- 191Compass 0.2.0adapter · 4BBase model: Qwen/Qwen3.5-4Bsource18.5I 29C 83S 83K 72est.$0.0085
- 192pjev-2bfine-tune · 2.5BBase model: openbmb/MiniCPM5-2Bsource18.1I 29C 84S 93K 64est.$0.016
- 193Instinct Dual 4BAPIClosed APIBase model: Qwen3.5-4Bsource*1118.0I 28C 86S 89K 75$0.0068
- 194ArseneLupin v1.1adapter · 4BBase model: Qwen/Qwen3.5-4Bsource17.3I 28C 82S 90K 75est.$0.0067
- 195Gemini 3.1 Flash-LiteAPIClosed APIBase model: undisclosed16.9I 59C 61S 79K 29$0.230
- 196Standard One 8Badapter · 8BBase model: mistralai/Ministral-3-8B-Instruct-2512-BF16source16.9I 33C 84S 92K 43est.$0.078
- 197Arbiter-4Bfine-tune · 4B · bf16Base model: Qwen/Qwen3.5-4Bsource16.5I 27C 77S 92K 81est.$0.0044
- 198system-one-openAPIadapter · 2BBase model: Gemma 4 E2Bsource16.4I 28C 76S 79K 68est.$0.011
- 199Decider-4Bfine-tune · 4B · bf16Base model: Qwen/Qwen3.5-4Bsource16.3I 27C 87S 92K 81est.$0.0044
- 200SemIf4BBase model: Qwen/Qwen3.5-4Bsource16.1I 27C 84S 90K 78est.$0.0056
- 201RYOTIDE-Qwen9pipeline · 9B · BF16Base model: Qwen/Qwen3.5-9Bsource16.1I 28C 77S 86K 66est.$0.013
- 202ClassOne Gemma 4 E4Bfine-tune · E4BBase model: google/gemma-4-E4B-itsource16.0I 28C 49S 92K 82est.$0.0040
- 203JEV Qwen3.5-9B Base NVFP49B · NVFP4Base model: ig1/Qwen3.5-9B-NVFP4source16.0I 29C 85S 93K 48est.$0.056
- 204DecisionNode Edge 0.9.2fine-tune · 2B · bf16Base model: Qwen/Qwen3.5-2B-Basesource15.9I 27C 77S 93K 87est.$0.0028
- 205openjev-sglangAPI35B-A3BBase model: Qwen/Qwen3.6-35B-A3Bsource15.4I 39C 79S 78K 36est.$0.140
- 206ClassOne Qwen 3.5 4Bfine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource14.8I 27C 49S 91K 80est.$0.0048
- 207system-one8BBase model: Qwen3-8Bsource14.7I 29C 30S 91K 68est.$0.011
- 208Jez-large-1.0.0fine-tune · E4B · bf16Base model: google/gemma-4-E4B-itsource14.2I 26C 83S 91K 83est.$0.0036
- 209Chon-1.0-12Bfine-tune · 12BBase model: google/gemma-4-12B-itsource14.2I 27C 59S 65K 65est.$0.015
- 210RYOTIDE-Qwenpipeline · 4BBase model: undisclosed13.5I 25C 87S 89K 77est.$0.0060
- 211NomaLLM decoderBase model: Qwen/Qwen3.5-4B-Basesource13.3I 25C 84S 93K 76est.$0.0061
- 212Raw Qwen3 8B direct logitsoriginal · 8BBase model: Qwen/Qwen3-8B-Basesource12.1I 27C 34S 88K 69est.$0.011
- 213local-jev Qwen3.5-4Bfine-tune · 4BBase model: Qwen/Qwen3.5-4Bsource12.0I 24C 86S 86K 78est.$0.0056
- 214OpenSourceJevadapter · 4B · GGUF Q4_K_MBase model: Qwen3.5-4Bsource10.6I 23C 74S 76K 84est.$0.0035
- 215Decision 2Badapter · 2BBase model: openbmb/MiniCPM5-2Bsource10.3I 23C 87S 90K 66est.$0.013
- 216open-alternative-jev4BBase model: Qwen3.5-4Bsource9.4I 22C 76S 91K 63est.$0.017
- 217Krino-2Badapter · 2BBase model: Qwen/Qwen3.5-2B-Basesource9.2I 22C 63S 91K 84est.$0.0034
- 218Liquid AI d1-3Bfine-tune · 3BBase model: LiquidAI/LFM2.5-VL-3Bsource8.9I 22C 77S 94K 51est.$0.044
- 219Open-Jev 2Badapter · 2BBase model: Qwen/Qwen3.5-2Bsource8.8I 22C 74S 77K 70est.$0.010
- 220classify-1APIClosed APIBase model: undisclosed8.5I 22C 83S 84K 51$0.044
- 221Imajev-2Badapter · 2BBase model: Qwen/Qwen3.5-2Bsource8.3I 21C 87S 81K 67est.$0.012
- 222decider-2badapter · 2BBase model: Qwen/Qwen3.5-2B-Basesource8.0I 21C 69S 94K 86est.$0.0030
- 223D1A on Gemma 4 E4Bfine-tune · BF16Base model: google/gemma-4-E4Bsource7.4I 20C 82S 92K 81est.$0.0042
- 224Nemotron Diffusion 8B8BBase model: nvidia/Nemotron-Labs-Diffusion-8Bsource7.3I 20C 75S 94K 55est.$0.030
- Nev-2B (re-measure pending under the 10 s rule)distilled · 2B · GGUF Q8_0Base model: Qwen/Qwen3.5-2B-Basesource7.1I 20C 80S 55K 87est.$0.0028
- 225DeepSeek V4.1 FlashAPILLM decoderBase model: undisclosed6.9I 84C 95S 66K 20$0.480
- 226kev 4Badapter · 4BBase model: Qwen/Qwen3-4B-Basesource*126.8I 20C 68S 90K 78est.$0.0055
- 227DecisionNode Edge Mini 0.9.2fine-tune · 0.8B · bf16Base model: Qwen/Qwen3.5-0.8B-Basesource5.4I 18C 78S 93K 87est.$0.0028
- 228Malkuth-2Badapter · 2BBase model: empero-ai/Qwen3.8-2B-Distillsource4.1I 16C 79S 92K 84est.$0.0035
- 229Qwen3-Reranker-4BRerankerBase model: Qwen/Qwen3-4B-Basesource4.1I 16C 73S 81K 61est.$0.021
- 230jiwo 0.8bfine-tune · 0.75BBase model: Qwen/Qwen3.5-0.8Bsource4.1I 16C 79S 94K 85est.$0.0032
- 231ZeroEntropy zerank-2RerankerBase model: Qwen/Qwen3-4Bsource3.7I 16C 83S 82K 61est.$0.021
- 232Vega 4Badapter · 4BBase model: undisclosed3.6I 16C 57S 84K 62est.$0.019
- 233EXAONE-4.0-1.2B-JEV v0.31.2BBase model: LGAI-EXAONE/EXAONE-4.0-1.2Bsource3.3I 15C 81S 94K 58est.$0.025
- 234SimpleJev Qwen3.8-27BAPI27BBase model: Qwen/Qwen3.8-27Bsource3.2I 53C 90S 76K 15est.$0.687
- 235Raw Phi-4 mini direct logitsoriginalBase model: microsoft/Phi-4-mini-instruct (unmodified)source2.5I 14C 57S 92K 53est.$0.036
- 236decision-machine-1APIClosed APIBase model: undisclosed2.4I 13C 79S 93K 58$0.024
- 237SimpleJev0.8BBase model: Qwen/Qwen3.5-0.8Bsource2.0I 13C 49S 59K 77est.$0.0059
- 238Jeetu Decider 2Bfine-tune · 2B · bf16Base model: Qwen/Qwen3.5-2B-Basesource1.2I 10C 73S 91K 86est.$0.0030
- 239JevActAPIClosed APIBase model: undisclosedsource1.1I 10C 47S 76K 69est.$0.011
- 240D1A on Gemma 4 E2Bfine-tune · BF16Base model: google/gemma-4-E2Bsource0.8I 9C 82S 93K 84est.$0.0034
- 241smalljev semantic-v9adapter · 2BBase model: openbmb/MiniCPM5-2B-Basesource0.8I 9C 77S 90K 61est.$0.020
- 242Gutsy 0.8B v0.3fine-tune · 0.8B · GGUF Q8_0Base model: Qwen/Qwen3.5-0.8Bsource0.8I 9C 76S 72K 85est.$0.0032
- 243Vega-U (Qwen3.5-4B reader)adapter · 4BBase model: undisclosed0.7I 8C 77S 89K 79est.$0.0048
- 244PurpleMIST-Mini-1.0fine-tune · 2BBase model: Qwen/Qwen3.5-2B-Basesource0.7I 8C 78S 89K 86est.$0.0029
- 245kev 0.6Badapter · 0.6BBase model: Qwen/Qwen3-0.6B-Basesource0.5I 8C 66S 91K 84est.$0.0034
- 246jul fast2BBase model: openbmb/MiniCPM5-2Bsource0.5I 7C 78S 91K 69est.$0.011
- 247OpenDecisionEncoder / classifierBase model: MoritzLaurer/ModernBERT-large-zeroshot-v2.0source0.5I 7C 69S 86K 79est.$0.0050
- 248ClassOne Gemma 4 E2BE2BBase model: google/gemma-4-E2B-itsource0.5I 8C 23S 93K 86est.$0.0030
- Qwen3.5-0.8B Decision Model (re-measure pending under the 10 s rule)fine-tune · 0.8BBase model: Qwen/Qwen3.5-0.8B-Basesource0.5I 7C 78S 56K 86est.$0.0029
- 249Fastino GLiNER-2.5-DecideAPIfine-tune · 340MBase model: fastino/gliner2-large-v1source 1source 2*130.3I 7C 62S 85K 46$0.064
- 250Deem 0.8B v1LLM decoderBase model: Qwen/Qwen3.5-0.8Bsource0.3I 7C 30S 85K 87est.$0.0027
- 251Decision Fastadapter · 0.6BBase model: Qwen/Qwen3-0.6B-Basesource0.3I 6C 75S 91K 87est.$0.0028
- 252Quyet-1.0-Small-ENfine-tune · 153MBase model: answerdotai/ModernBERT-basesource0.3I 6C 73S 95K 89est.$0.0023
- 253ClassOne Qwen 3.5 2Bfine-tune · 2BBase model: Qwen/Qwen3.5-2Bsource0.2I 6C 33S 93K 86est.$0.0030
- 254Laya typed-decisionsfine-tune · 421MBase model: ModernBERT-largesource0.2I 5C 83S 69K 83est.$0.0038
- 255Vega-U (Qwen3.5-0.8B reader)adapter · 0.8BBase model: undisclosed0.2I 5C 67S 73K 86est.$0.0030
- 256WaterSheepEncoder / classifierBase model: answerdotai/ModernBERT-basesource0.2I 5C 66S 77K 69est.$0.011
- 257openJev Verdict 1.4Encoder / classifierBase model: knowledgator/gliclass-modern-base-v2.0source0.2I 5C 76S 81K 87est.$0.0028
- 258Raw Qwen3 0.6B direct logitsoriginal · 0.6BBase model: Qwen/Qwen3-0.6B-Basesource0.2I 6C 11S 93K 84est.$0.0034
- 259lev-350madapterBase model: LiquidAI/LFM2.5-350Msource0.2I 5C 82S 94K 80est.$0.0046
- 260Raw Qwen3 1.7B direct logitsoriginal · 1.7BBase model: Qwen/Qwen3-1.7B-Basesource0.1I 5C 12S 93K 84est.$0.0034
- 261kev 0.5Badapter · 0.5BBase model: Qwen/Qwen2.5-0.5Bsource0.1I 5C 61S 92K 84est.$0.0034
- 262Jez-small-1.0.0fine-tune · 0.8B · fp32Base model: Qwen/Qwen3.5-0.8Bsource0.1I 5C 82S 93K 86est.$0.0029
- 263openJev Verdictfine-tuneBase model: knowledgator/gliclass-modern-base-v2.0source 1source 20.1I 4C 49S 78K 87est.$0.0028
- 264Quyet-1.0-Smallfine-tune · 328MBase model: aisingapore/SEA-LION-ModernBERT-300Msource0.1I 4C 61S 95K 80est.$0.0048
- Reflex Instinct 0.6B (re-measure pending under the 10 s rule)adapter · 0.6BBase model: Qwen/Qwen3-0.6Bsource0.1I 4C 73S 59K 86est.$0.0028
- 265watt-flash-0.1fine-tune · 140MBase model: jhu-clsp/mmBERT-smallsource0.1I 4C 79S 74K 89$0.0023
- 266Quyet-1.0-Tinydistilled · 183MBase model: jhu-clsp/mmBERT-smallsource0.1I 4C 58S 95K 88est.$0.0024
- 267Phocinae-Largha-150M-v1fine-tune · 144MBase model: undisclosed0.1I 4C 57S 77K 95est.$0.0014
- 268Liquid AI d1-omni-600Mfine-tune · 600MBase model: LiquidAI/LFM2.5-Encoder-350Msource0.0I 3C 62S 94K 73est.$0.0079
- 269Vega 0.8Badapter · 0.8BBase model: Qwen/Qwen3.5-0.8Bsource0.0I 3C 63S 89K 68est.$0.012
- 270open-jev-deberta-v3-largeadapterBase model: microsoft/deberta-v3-largesource0.0I 3C 68S 67K 78est.$0.0056
- modernbert-jev v2 (re-measure pending under the 10 s rule)fine-tune · 150M · ONNX INT8Base model: undisclosed0.0I 3C 67S 58K 70est.$0.0097
- 271Julia-1fine-tune · 144MBase model: jhu-clsp/mmBERT-smallsource0.0I 2C 17S 78K 90est.$0.0022
- 272verdict-smallfine-tune · 118MBase model: intfloat/multilingual-e5-smallsource0.0I 2C 73S 89K 100est.$0.0009
- 273Tacet Sonatafine-tune · 144MBase model: jhu-clsp/mmBERT-smallsource0.0I 2C 46S 79K 89est.$0.0023
- 274Layafine-tune · 421MBase model: ModernBERT-largesource0.0I 2C 63S 73K 85est.$0.0032
- 275Mixedbread mxbai-rerank-base-v2RerankerBase model: Qwen2.5 (size not stated)source 1source 20.0I 1C 87S 92K 60est.$0.021
- 276Laya multilingualfine-tune · 322MBase model: mmBERT-basesource0.0I 0C 34S 77K 82est.$0.0039
- 277Certo v1Encoder / classifierBase model: ModernBERT-largesource0.0I 0C 86S 92K 97est.$0.0013
- 278CLM-8Bfine-tune · 8BBase model: Qwen/Qwen3-8Bsource0.0I 0C 40S 92K 74est.$0.0075
- 279BAAI bge-reranker-v2-m3fine-tuneBase model: BAAI/bge-m3source0.0I 0C 88S 94K 59est.$0.023
- 280Alibaba GTE Reranker ModernBERT-basefine-tuneBase model: answerdotai/ModernBERT-basesource0.0I 0C 83S 94K 69est.$0.011
- 281MirrorEncoder / classifierBase model: undisclosed0.0I 0C 52S 74K 89est.$0.0023
- 282Open Jev JSON Canvas26B-A4BBase model: google/diffusiongemma-26B-A4B-itsource0.0I 61C 0S 85K 71est.$0.0095
- 283Qwen3.8 27BAPI27BBase model: undisclosed0.0I 33C 64S 55K 0est.$2.178
Base-model notes
- *1 Myles-G 12B (base model: google/gemma-4-12B-it (self-reported)): Customer states merged LoRA on Gemma 4 12B; not independently verified.
- *2 Fastino GLiDE (base model: undisclosed): No public base model declared; proprietary vendor-hosted API.
- *3 Drex Max (base model: undisclosed): No public base model declared; proprietary vendor-hosted API.
- *4 torchcast-decision-27b (base model: startlux-models/StartLux-Decision-27B): Direct base is StartLux-Decision-27B (startlux-models, CC-BY-NC-4.0), itself a modified Alibaba Qwen model; its card does not name the Qwen version. Qwen3.8-27B is inferred from the identical text_config.
- *5 Surogate Rune 26B-A4B v3 (base model: google/gemma-4-26B-A4B-it): This model also powers our System1 Models s1-pro service.
- *6 Myles-G 31B (base model: google/gemma-4-31B-it (self-reported)): Customer statement (order notes, 21 Oct 2026): a merged LoRA adapter on google/gemma-4-31B-it. Not publicly documented by the vendor and not independently verified.
- *7 Microsoft-Decision-1 (base model: Qwen3.5-9B): Base model disclosed by Microsoft; the Decision-1 endpoint is evaluated as a hosted API offering.
- *8 Instinct (base model: Qwen3.8-27B): Operator-reported; weights not publicly verifiable.
- *9 HS1 0.1.2 (base model: google/gemma-4-26B-A4B-it (self-reported)): Customer statement (order notes, 21 Oct 2026): a LoRA fine-tune of Gemma-4-26B-A4B-it served in FP8. Not publicly documented and not independently verified.
- *10 Vansa-3.4 (base model: Qwen3.5-4B (self-reported)): Developer-reported to Benchmark Heaven (private correspondence, 1 Oct 2026): built on Qwen3.5-4B via an open decision fine-tune, with Vansa's own adapters; the intermediate fine-tune is not named. Not publicly documented or independently verified.
- *11 Instinct Dual 4B (base model: Qwen3.5-4B): Operator-reported; weights not publicly verifiable.
- *12 kev 4B (base model: Qwen/Qwen3-4B-Base): Evaluated Qwen3 variant; later releases use a different base.
- *13 Fastino GLiNER-2.5-Decide (base model: fastino/gliner2-large-v1): Measured via Fastino's hosted API. A 340M English classifier (8k context), not built for multi-step reasoning: near chance on Noul and Score items; 23 very long items exceed its context. Our request follows Fastino's documented format. The open checkpoint scores 11.2 on the community Decision Index (rank 53 of 70; Jev 57.9). Fastino's larger GLiDE is a separate model, ranked separately on the API board.
Adjust weights ↓
Weights are relative: each axis counts in proportion to its slider. The score stays a weighted harmonic mean with the low-axis gates; the gates still apply when an axis sits at 0. Only equal weights give the official JevBench Score and rank.
Score = 4 / (1/I + 1/C + 1/S + 1/K) (each 0–100; × (axis / 50)² for Intelligence, Speed or Cost below 50)
- Jev — reference (TypeSafe, closed) (2)
- Closed API (weights not public) (32)
- Open weights · LLM decoder (214)
- Open weights · diffusion LM (6)
- Open weights · encoder / classifier (21)
- Open weights · reranker (5)
- Base model control (no decision fine-tune, raw logits) (5)
- System (router / cascade / ensemble) (3)
- Striped bar = same system under the labelled alternative price assumption
- Shown, not ranked
Compare two systems
Pick any two. Radars for the score axes, capability by subject topic and use cases, chance-corrected competence per request type on the open and sealed sets, and competence per tier on each set. Further out is better on every spoke; the link keeps the pair.
- A: Jev 1.13.0REFERENCE · TypeSafe — Jev — reference (TypeSafe, closed) · Score 71.4 (#64)
- B: Torchcast Decision 4B — Open weights · LLM decoder · Score 80.5 (#1)
The four score axes
Capability by subject topic
Torchcast Decision 4B: No per-category values are published for this system.
Linear signed scale: −100 at the centre, 0 on the bold middle ring, 100 at the rim.
What each category means · items per category
- Math & numbers — a calculation decides the answer: arithmetic, word problems, probability, dates, units. 235 items (174 open / 61 sealed)
- Coding & software — code, SQL, repositories, developer tools and IT systems. 92 items (67 open / 25 sealed)
- Rules, policy & law — applying written rules: company policies, contracts, regulations, eligibility. 548 items (260 open / 288 sealed)
- Finance & commerce — money: payments, refunds, invoices, orders, expenses, insurance payouts. 224 items (134 open / 90 sealed)
- Support & operations — support tickets, incidents, logistics, scheduling desks and routing work to a team. 282 items (131 open / 151 sealed)
- Everyday language — short everyday messages: intents, assistant requests, reading a detail out of a text. 115 items (98 open / 17 sealed)
- Safety & security — untrusted or injected instructions, fraud, moderation, access and security triage. 128 items (40 open / 88 sealed)
Use cases (TypeSafe categories)
Torchcast Decision 4B: No per-category values are published for this system.
Linear signed scale: −100 at the centre, 0 on the bold middle ring, 100 at the rim.
Linear signed scale: −100 at the centre, 0 on the bold middle ring, 100 at the rim.
Low sample, n < 30 — indicative only
| Category (items) | A: Jev 1.13.0 | B: Torchcast Decision 4B |
|---|---|---|
| Graphs and knowledge graphs (15) | 100.0 n=15 | — |
No published value for either system (under 15 answered items, or no per-category values): Scientific discovery (1), Semantic code linting (4), Feature extraction for predictive modeling (7), Recruiting (3), Moderation and trust and safety (12), Advertising (2).
Not drawn on the radar: with so few items a single answer moves a category score by several points, so these values are noise-prone. These values become spokes once the item pool reaches 30 items per category.
What each category means · items per category
- Search and retrieval — scoring query-to-candidate relevance, reranking results, selecting useful context for RAG. 54 items (18 open / 36 sealed)
- Model routing — deciding which LLM or model tier should handle a prompt; classifying a request's intent, domain, difficulty or risk to pick a model. 132 items (131 open / 1 sealed)
- LLM guardrails — checking LLM inputs, outputs and tool calls: prompt injection, jailbreaks, policy violations, tool-call errors, answer quality. 339 items (209 open / 130 sealed)
- Lead generation — matching companies or inbound messages to an ideal customer profile, buyer intent, prioritising and routing sales leads. 98 items (61 open / 37 sealed)
- Customer support — classifying tickets and customer intents, urgency, refunds, routing cases to a team, checking support replies. 389 items (176 open / 213 sealed)
- Insurance claims — first-notice-of-loss reports, claim complexity, missing information, claim triage. 31 items (14 open / 17 sealed)
- Financial crime — suspicious transactions, KYC, fraud alerts, entity matching for investigations. 31 items (10 open / 21 sealed)
- Legal and compliance — contracts, policies, regulations, eligibility rules, checking documents against written requirements. 508 items (261 open / 247 sealed)
- E-commerce marketplaces — product listings, product attributes, orders and deliveries, seller catalog policy. 71 items (48 open / 23 sealed)
- Risk assessment — estimating probabilities and severity of risks, incidents, vendor or underwriting risk. 78 items (39 open / 39 sealed)
Not drawn: Other — none of the above: general reasoning, arithmetic or date puzzles, everyday assistant requests without a business workflow. 159 items (76 open / 83 sealed) — not a use case of its own, so it is counted but not drawn.
No items in this release: Gaming, Demand forecasting.
Competence per request type, open / sealed
Linear signed scale: −100 at the centre, 0 on the bold middle ring, 100 at the rim.
Competence per tier — open set
Linear signed scale: −100 at the centre, 0 on the bold middle ring, 100 at the rim.
Competence per tier — sealed set
Linear signed scale: −100 at the centre, 0 on the bold middle ring, 100 at the rim.
How the categories were made
Chance-corrected competence (0 = chance, 100 = perfect) over the category's items, open and sealed pooled, all tiers: per request type the method's competence cell (Choice and Noul accuracy above chance, Score 1 - error / chance error), then averaged over types weighted by item count. Not part of the JevBench Score; compare systems within a category, not categories with each other. Values can be negative (below chance).
Every one of the 1,624 decisions was labelled with one subject topic (the v1.2 topic list, unchanged) and one or two TypeSafe use-case categories (docs.typesafe.ai/concepts/use-case-map, plus Other) by Winnow-12B Q8 (the model behind System1 Models s1-pro) on our own GPU pod; 1,118 of the 3,248 calls were first made on s1-pro itself and agree 98.2 % with the pod run. Sealed items stayed on our own infrastructure. About 5 % of public items were checked by hand (Claude Opus 5.5); the item-group rules below fix the systematic misses found.
- routing, routing_hard and tool_selection items (choose the model, agent or tool that handles a request) are Model routing first; the labeller tagged many by the request subject.
- tool_guardrail, unsafe_action, adequacy, judge_hard and policy_compliance items (check an agent tool call or a drafted answer before it goes out) are LLM guardrails first.
- lead_qualification items take the topic Finance & commerce (sales); the labeller read the scoring rubric as rules & law.
- A second use case is kept when the labeller gave it probability >= 0.15 and it is not Other.
All values as a table
| Spoke | A: Jev 1.13.0 | B: Torchcast Decision 4B |
|---|---|---|
| The four score axes | ||
| Intelligence | 63.6 | 67.1 |
| Calibration | 90.6 | 87.8 |
| Speed | 91.2 | 92.4 |
| Cost | 54.7 | 79.4 |
| Capability by subject topic | ||
| Math & numbers | 40.5 | No per-category values are published for this system. |
| Coding & software | 80.3 | No per-category values are published for this system. |
| Rules, policy & law | 73.7 | No per-category values are published for this system. |
| Finance & commerce | 83.4 | No per-category values are published for this system. |
| Support & operations | 91.5 | No per-category values are published for this system. |
| Everyday language | 96.1 | No per-category values are published for this system. |
| Safety & security | 67.7 | No per-category values are published for this system. |
| Use cases (TypeSafe categories) | ||
| Search & retrieval | 95.9 | No per-category values are published for this system. |
| Model routing | 96.5 | No per-category values are published for this system. |
| LLM guardrails | 67.0 | No per-category values are published for this system. |
| Lead generation | 88.1 | No per-category values are published for this system. |
| Customer support | 91.9 | No per-category values are published for this system. |
| Insurance claims | 67.5 | No per-category values are published for this system. |
| Financial crime | 58.3 | No per-category values are published for this system. |
| Legal & compliance | 74.0 | No per-category values are published for this system. |
| E-commerce | 89.8 | No per-category values are published for this system. |
| Risk assessment | 80.1 | No per-category values are published for this system. |
| Competence per request type, open / sealed | ||
| Choice · open | 79.0 | 81.7 |
| Choice · sealed | 75.8 | 73.0 |
| Noul · open | 54.5 | 80.1 |
| Noul · sealed | 46.1 | 70.9 |
| Score · open | 63.3 | 47.5 |
| Score · sealed | 63.0 | 49.8 |
| Competence per tier — open set | ||
| Easy | 93.9 | 86.2 |
| Standard | 63.2 | 68.5 |
| Judge | 67.7 | 65.2 |
| Hard | 65.6 | 75.7 |
| Competence per tier — sealed set | ||
| Easy | 78.4 | 77.4 |
| Standard | 68.7 | 70.8 |
| Judge | 66.9 | 65.3 |
| Hard | 58.9 | 62.1 |
Category radars count each answered item once from the pools named under each radar. API overlay rows use A4+P+L1+L2+L3; A5+P+L1+L2+L3; S+P+L1+L2+L3. Raw and unequated; cells under 15 answered items are omitted. Per-type and tier radars retain each row's original measurement pools: A4/A5 rows have 300 open plus 300 sealed items; full-set rows have S 1,200 plus P 300.
Languages
Raw chance-corrected competence per item language (0 = chance, 100 = perfect; can be negative), from each system's own measured items: Self-hosted rows use S 1,200 + P 300 + L1 (354 items) + L2 (33 items) + L3 (1,118 items), where answered. API rows re-run on A4/A5 use their 300/300-item sealed subset instead of S. Every row’s tag lists the pools it actually answered. L3 is a sealed language supplement (1,118 items), drawn 2026-10-07. Every language has at least 60 items in P ∪ L1 ∪ L2 ∪ L3. Header counts show the full S + P + L1 + L2 + L3 pool. Headline scores are unchanged; these raw cells are unequated, scored for language/category views only and outside the Composite. L3 items were written natively by Claude Sonnet 5.5, each solved blind and language-checked by GPT-6.1 Sol, with gold kept only when both agree or a second review confirms; no gold comes from Jev or any measured API. L3 is API-facing by design and is excluded from future headline draws. Rows with unfinished runs retain their actual coverage tags. L3 items were reviewed by an OpenAI model, so the L3-based language and category cells of OpenAI rows (OpenAI Decisions, GPT-6 Luna, GPT-5.6 Luna) carry that exposure; headline scores do not use L3. C1 adds English items for thin radar categories (everyday language, safety and the other use case). L4 adds 20 new Hindi items for Fastino GLiNER 2.5 Decide only. They were authored with OpenAI and independently solved and language-reviewed with Anthropic before sealing. Seventeen L4 requests succeeded; three HTTP 400 failures remain in the scored observations and do not count as completed coverage. L4 is outside headline and category scores and the common header counts. L5 adds 60 new items for OpenJev DeBERTa v3 Large only: 20 each in Arabic, Hindi and Greek. They were authored with OpenAI and independently solved and language-reviewed with Anthropic before sealing, then checked against the original 512-token native context before keeper selection. All 60 native requests succeeded. Previous failures remain scored and do not count as completed coverage. L5 is outside headline and category scores and the common header counts. Cells under 15 completed supported responses are left empty; recorded input refusals count toward coverage. A dagger (†) marks fewer than 30 completed responses. Competence retains all supported scored observations, including failures and refusals. The mixed-language group is listed first, then English (1,306 items); the other 21 languages and the mixed-language group share 1699 items.
345 systems
| 78 | 1306 | 95 | 90 | 88 | 84 | 83 | 83 | 80 | 80 | 77 | 75 | 75 | 75 | 73 | 73 | 72 | 72 | 71 | 71 | 70 | 69 | 65 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| decide-1.1API · not measured | 84 | 76 | 84 | 74 | 74 | 82 | 78 | 84 | 73 | 81 | 84 | 75 | 79 | 71 | 90 | 75 | 85 | 84 | 83† | 84 | 86 | 84 | 68† |
| H2O-Lightning-4B v1.4.1self-hosted · not measured | 86 | 68 | 75 | 75 | 68 | 59 | 45 | 64 | 81 | 79 | 69 | 69 | 76 | 64 | 75 | 70 | 68 | 60 | 87† | 86 | 81 | 71 | 52† |
| Torchcast Decision 4B (v1.3)self-hosted · S+P (draw v1.6-regular-20261012) | — | 66 | 72 | 75† | 71 | 68 | — | 82† | — | 62† | — | — | — | — | — | — | — | 70† | 27† | — | — | — | 66† |
| Torchcast Decision 31B v1.0self-hosted · not measured | 90 | 90 | 86 | 89 | 92 | 98 | 90 | 99 | 89 | 91 | 95 | 90 | 97 | 92 | 93 | 87 | 77 | 92 | 94† | 94 | 94 | 100 | 92† |
| WeMM-JEVself-hosted · not measured | 90 | 83 | 88 | 84 | 80 | 85 | 72 | 89 | 82 | 83 | 82 | 88 | 94 | 80 | 93 | 89 | 69 | 74 | 93† | 88 | 96 | 90 | 75† |
| Arcbright Elf 1 12B (r2)self-hosted · not measured | 77 | 69 | 72 | 69 | 73 | 68 | 39 | 84 | 77 | 75 | 75 | 73 | 83 | 65 | 74 | 78 | 62 | 68 | 98† | 67 | 83 | 63 | 63† |
| Jeff-1.1-Qwen-4Bself-hosted · not measured | 93 | 70 | 67 | 75 | 65 | 87 | 66 | 72 | 84 | 76 | 63 | 66 | 84 | 74 | 78 | 78 | 50 | 47 | 95† | 87 | 83 | 66 | 62† |
| iota-decide-4b-v0.4self-hosted · not measured | 84 | 61 | 73 | 72 | 60 | 67 | 45 | 57 | 64 | 66 | 57 | 66 | 82 | 51 | 74 | 75 | 57 | 67 | 87† | 73 | 85 | 58 | 64† |
| Super DeciderAPI · not measured | — | 81 | 87 | 77† | 76 | 86 | — | 76† | — | 80† | — | — | — | — | — | — | — | 72† | 81† | — | — | — | 66† |
| Decisio 12B tuned commit-thinkself-hosted · not measured | 83 | 68 | 67 | 67 | 63 | 74 | 57 | 76 | 81 | 71 | 74 | 73 | 78 | 65 | 72 | 71 | 60 | 63 | 91† | 78 | 80 | 63 | 52† |
| Myles-G 12BAPI · S+P (draw v1.6-regular-20261012) | — | 56 | 66 | 73† | 59 | 86 | — | 58† | — | 48† | — | — | — | — | — | — | — | 82† | 4† | — | — | — | 43† |
| H2O-Lightning-4B v1.1self-hosted · S+P+L1+L2+L3 | 85 | 63 | 55 | 59 | 60 | 54 | 49 | 38 | 54 | 58 | 41 | 37 | 34 | 46 | 26 | 49 | 46 | 39 | 48 | 55 | 47 | 31 | 23 |
| VisionJEV 1.0.0self-hosted · not measured | 86 | 81 | 87 | 83 | 80 | 84 | 67 | 87 | 75 | 90 | 74 | 89 | 89 | 74 | 87 | 89 | 57 | 73 | 92† | 86 | 92 | 88 | 85† |
| kettei-fatAPI · S+P (draw v1.6-regular-20261012) | — | 80 | 90 | 76† | 86 | 87 | — | 81† | — | 81† | — | — | — | — | — | — | — | 79† | 86† | — | — | — | 78† |
| Wald 26B-A4Bself-hosted · not measured | — | 64 | 65 | 68† | 74 | 72 | — | 60† | — | 36† | — | — | — | — | — | — | — | 58† | 29† | — | — | — | 78† |
| Microsoft-Decision-1 (updated weights, Oct 2026)API · not measured | 89 | 69 | 78 | 47 | 64 | 80 | 45 | 76 | 86 | 84 | 75 | 56 | 79 | 58 | 80 | 85 | 52 | 71 | 80† | 82 | 64 | 60 | 53† |
| Torchcast Decision 4B (v1.2)self-hosted · S+P (draw v1.6-regular-20261012) | — | 60 | 65 | 68† | 76 | 78 | — | 71† | — | 63† | — | — | — | — | — | — | — | 39† | 9† | — | — | — | 74† |
| Fastino GLiDE (hosted API, 22 Oct 2026)API · S+P (draw v1.6-regular-20261012) | — | 76 | 74 | 78† | 79 | 93 | — | 66† | — | 47† | — | — | — | — | — | — | — | 70† | 49† | — | — | — | 94† |
| d1-ultraAPI · S+P (draw v1.6-regular-20261012) | — | 70 | 66 | 86† | 67 | 89 | — | 63† | — | 24† | — | — | — | — | — | — | — | 69† | 28† | — | — | — | 44† |
| Fastino GLiDE 1.2self-hosted · not measured | — | 77 | 74 | 78† | 79 | 91 | — | 67† | — | 52† | — | — | — | — | — | — | — | 70† | 49† | — | — | — | 94† |
| Bobcat Flash 1.2self-hosted · S+P+L1+L2+L3Language and category cells use the unchanged original S+P observations and the newly completed frozen supplemental items (L1, L2, L3), answered with the original model and serving setup on an isolated pod. Each supplement carries the same original P300 answers by stable item identity; they count once in the union. Failed requests stay scored as failures and are not imputed. Headline, rank, Composite and original pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 82 | 71 | 45 | 47 | 38 | 54 | 33 | 33 | 51 | 41 | 43 | 37 | 39 | 28 | 26 | 47 | 37 | 48 | 50 | 44 | 58 | 29 | 27 |
| SubQ Snap 1.1API · S+P (draw v1.6-regular-20261012) | — | 75 | 75 | 76† | 83 | 91 | — | 61† | — | 39† | — | — | — | — | — | — | — | 47† | 77† | — | — | — | 78† |
| H2O-Lightning-31B v1.0.7self-hosted · S+P (draw v1.6-regular-20261012) | — | 81 | 66 | 75† | 83 | 91 | — | 78† | — | 65† | — | — | — | — | — | — | — | 75† | 28† | — | — | — | 77† |
| StartLux-Decision v1.1 27B Instantself-hosted · S+P (draw v1.6-regular-20261012) | — | 72 | 78 | 86† | 76 | 86 | — | 78† | — | 51† | — | — | — | — | — | — | — | 82† | 61† | — | — | — | 78† |
| Decision-King v1.1self-hosted · not measured | 95 | 74 | 83 | 85 | 77 | 93 | 77 | 84 | 86 | 83 | 64 | 86 | 80 | 74 | 91 | 77 | 80 | 81 | 88† | 81 | 88 | 75 | 83† |
| Piccolo 4Bself-hosted · not measured | 85 | 60 | 74 | 70 | 51 | 65 | 42 | 58 | 65 | 70 | 61 | 64 | 71 | 58 | 78 | 67 | 58 | 44 | 77† | 76 | 71 | 68 | 63† |
| Drex MaxAPI · S+P (draw v1.6-regular-20261012) | — | 79 | 72 | 85† | 82 | 88 | — | 76† | — | 54† | — | — | — | — | — | — | — | 71† | 70† | — | — | — | 94† |
| baselabs mammoth-1self-hosted · not measured | — | 77 | 76 | 83† | 65 | 90 | — | 65† | — | 62† | — | — | — | — | — | — | — | 79† | 76† | — | — | — | 61† |
| Decisio 12B tuned commitself-hosted · not measured | — | 60 | 70 | 66† | 61 | 83 | — | 55† | — | 52† | — | — | — | — | — | — | — | 56† | 39† | — | — | — | 71† |
| Jeff-1.1-Mediumself-hosted · not measured | — | 75 | 82 | 76† | 88 | 94 | — | 85† | — | 29† | — | — | — | — | — | — | — | 88† | 52† | — | — | — | 78† |
| Philly Decider v2self-hosted · not measured | — | 54 | 63 | 49† | 66 | 70 | — | 72† | — | 50† | — | — | — | — | — | — | — | 29† | 0† | — | — | — | 55† |
| Perplexity Decider v1.1 27Bself-hosted · S+P+L1+L2+L3 | 85 | 79 | 50 | 58 | 62 | 63 | 43 | 52 | 70 | 51 | 48 | 42 | 57 | 21 | 38 | 63 | 33 | 67 | 64 | 42 | 64 | 39 | 57 |
| Bespoke Nimble-v4-maxAPI · S+P (draw v1.6-regular-20261012) | — | 71 | 70 | 65† | 73 | 82 | — | 71† | — | 27† | — | — | — | — | — | — | — | 34† | 59† | — | — | — | 61† |
| Chon-1.0-E4Bself-hosted · not measured | — | 50 | 68 | 75† | 68 | 83 | — | 71† | — | 45† | — | — | — | — | — | — | — | 61† | 25† | — | — | — | 52† |
| vLLM-SR d3-turboself-hosted · S+P (draw v1.6-regular-20261012) | — | 75 | 74 | 79† | 76 | 83 | — | 78† | — | 37† | — | — | — | — | — | — | — | 57† | 78† | — | — | — | 72† |
| vLLM-SR d3self-hosted · S+P (draw v1.6-regular-20261012) | — | 74 | 73 | 79† | 79 | 86 | — | 73† | — | 39† | — | — | — | — | — | — | — | 51† | 69† | — | — | — | 55† |
| Super Decider (thinking)API · not measured | — | 82 | 81 | 80† | 67 | 88 | — | 74† | — | 78† | — | — | — | — | — | — | — | 68† | 81† | — | — | — | 83† |
| Jeff-1.1-Largeself-hosted · not measured | 96 | 88 | 85 | 82 | 80 | 86 | 83 | 98 | 98 | 90 | 78 | 81 | 92 | 80 | 91 | 89 | 78 | 89 | 89† | 96 | 83 | 87 | 95† |
| KnowLine 26B-A4B-Gen2.5self-hosted · not measured | — | 67 | 75 | 48† | 65 | 79 | — | 79† | — | 19† | — | — | — | — | — | — | — | 57† | 49† | — | — | — | 50† |
| Torchcast Decision 4B (v1.1)self-hosted · S+P (draw v1.6-regular-20261012) | — | 54 | 62 | 65† | 72 | 61 | — | 80† | — | 46† | — | — | — | — | — | — | — | 33† | 0† | — | — | — | 59† |
| SubQ SnapAPI · S+P (draw v1.6-regular-20261012) | — | 74 | 68 | 62† | 72 | 84 | — | 67† | — | 39† | — | — | — | — | — | — | — | 51† | 61† | — | — | — | 66† |
| oenogarumself-hosted · not measured | 92 | 77 | 74† | 69 | 80 | 81 | 65 | 88† | 62† | 84† | 69† | 78 | 73 | 66† | 93 | 76 | 76 | 74† | 76† | 92† | 94 | 67 | 68† |
| Piccolo 9Bself-hosted · not measured | 90 | 64 | 75 | 61 | 74 | 79 | 38 | 71 | 67 | 76 | 65 | 75 | 65 | 61 | 76 | 79 | 66 | 56 | 79† | 80 | 76 | 63 | 68† |
| KnowLine 35B-A3B-Gen1.5self-hosted · not measured | — | 61 | 71 | 59† | 50 | 92 | — | 75† | — | 15† | — | — | — | — | — | — | — | 42† | 44† | — | — | — | 44† |
| basal-omni-1.0-ultraself-hosted · S+P (draw v1.6-regular-20261012) | — | 77 | 76 | 70† | 65 | 86 | — | 62† | — | 58† | — | — | — | — | — | — | — | 71† | 39† | — | — | — | 78† |
| Umpire 35B-A3Bself-hosted · not measured | 78 | 57 | 74 | 62 | 55 | 76 | 32 | 76 | 75 | 62 | 53 | 70 | 61 | 51 | 72 | 62 | 47 | 43 | 88† | 75 | 75 | 61 | 69† |
| Xor 26B-A4Bself-hosted · S+P+L1+L2+L3 | 80 | 61 | 46 | 40 | 48 | 56 | 51 | 36 | 52 | 44 | 34 | 45 | 43 | 32 | 33 | 50 | 40 | 68 | 50 | 50 | 50 | 42 | 46 |
| torchcast-decision-27bself-hosted · S+P+L1+L2+L3 | 81 | 74 | 49 | 58 | 51 | 45 | 43 | 40 | 67 | 52 | 42 | 53 | 47 | 23 | 21 | 50 | 38 | 57 | 61 | 39 | 51 | 35 | 44 |
| Arcbright Elf 1 31Bself-hosted · not measured | — | 72 | 67 | 71† | 74 | 86 | — | 59† | — | 50† | — | — | — | — | — | — | — | 73† | 24† | — | — | — | 77† |
| pplx-decider-v1.2self-hosted · S+P (draw v1.6-regular-20261012) | — | 73 | 78 | 77† | 78 | 87 | — | 73† | — | 35† | — | — | — | — | — | — | — | 43† | 48† | — | — | — | 61† |
| Quyet-1.0-Largeself-hosted · S+P+L1+L2+L3 | 84 | 76 | 47 | 57 | 56 | 66 | 54 | 40 | 66 | 55 | 43 | 52 | 59 | 43 | 29 | 64 | 59 | 67 | 67 | 46 | 55 | 45 | 64 |
| Nimble-v4-maxself-hosted · not measured | — | 74 | 69 | 65† | 79 | 83 | — | 72† | — | 31† | — | — | — | — | — | — | — | 52† | 69† | — | — | — | 55† |
| Sage 1.3.0API · S+P+L1+L2+L3 | 80 | 71 | 48 | 55 | 42 | 49 | 44 | 45 | 57 | 51 | 36 | 44 | 43 | 32 | 26 | 44 | 51 | 65 | 62 | 50 | 59 | 37 | 43 |
| decider-12b v2self-hosted · S+P+L1+L2+L3Language and category cells use the unchanged original S+P observations and the newly completed frozen supplemental items (L1, L2, L3), answered with the original model and serving setup on an isolated pod. Each supplement carries the same original P300 answers by stable item identity; they count once in the union. Failed requests stay scored as failures and are not imputed. Headline, rank, Composite and original pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 87 | 65 | 51 | 58 | 61 | 40 | 49 | 55 | 61 | 49 | 54 | 43 | 55 | 46 | 43 | 57 | 59 | 67 | 58 | 56 | 40 | 58 | 36 |
| Xevn-4Bself-hosted · not measured | — | 49 | 63 | 72† | 44 | 72 | — | 77† | — | 56† | — | — | — | — | — | — | — | 37† | 25† | — | — | — | 70† |
| kettei-chubAPI · S+P (draw v1.6-regular-20261012) | — | 62 | 77 | 63† | 61 | 83 | — | 77† | — | 49† | — | — | — | — | — | — | — | 24† | 28† | — | — | — | 72† |
| Surogate Rune 26B-A4B v3 (v1.6 pool)self-hosted · S+P+L1+L2+L3 | 75 | 59 | 47 | 43 | 36 | 47 | 37 | 37 | 45 | 44 | 33 | 37 | 45 | 38 | 19 | 52 | 37 | 55 | 43 | 40 | 50 | 23 | 33 |
| Jeff-1.0-Largeself-hosted · S+P (draw v1.6-fastlane-20261009) | 99† | 71 | 89 | 67† | 64 | 91 | 56† | — | 98† | 49† | — | — | — | — | — | — | 77† | 84† | 62† | — | — | — | 59† |
| Lychee-27Bself-hosted · not measured | — | 76 | 77 | 79† | 78 | 88 | — | 58† | — | 39† | — | — | — | — | — | — | — | 67† | 70† | — | — | — | 83† |
| decisio v0.8.0 on gemma-4-31B-itself-hosted · not measured | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |
| decider-12b v1, stock Gemma-4-12B-itself-hosted · S+P+L1+L2+L3Language and category cells use the unchanged original S+P observations and the newly completed frozen supplemental items (L1, L2, L3), answered with the original model and serving setup on an isolated pod. Each supplement carries the same original P300 answers by stable item identity; they count once in the union. Failed requests stay scored as failures and are not imputed. Headline, rank, Composite and original pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 85 | 62 | 48 | 50 | 49 | 42 | 46 | 54 | 61 | 51 | 42 | 46 | 47 | 38 | 32 | 49 | 44 | 61 | 50 | 49 | 40 | 51 | 43 |
| vLLM-SR d3-miniself-hosted · not measured | — | 52 | 62 | 57† | 56 | 73 | — | 80† | — | 36† | — | — | — | — | — | — | — | 30† | 0† | — | — | — | 28† |
| Sieve-31B-v2self-hosted · not measured | — | 71 | 67 | 51† | 67 | 91 | — | 51† | — | 48† | — | — | — | — | — | — | — | 40† | 44† | — | — | — | 61† |
| d1API · S+P+L1+L2+L3 | 80 | 66 | 32 | 55 | 34 | 44 | 33 | 36 | 64 | 40 | 28 | 30 | 41 | 28 | 14 | 33 | 27 | 48 | 51 | 41 | 47 | 12 | 32 |
| Vera Largeself-hosted · not measured | — | 69 | 73 | 81† | 58 | 80 | — | 88† | — | 38† | — | — | — | — | — | — | — | 49† | 45† | — | — | — | 55† |
| iota-decide-4b-v0.3self-hosted · not measured | — | 48 | 69 | 58† | 64 | 70 | — | 67† | — | 54† | — | — | — | — | — | — | — | 51† | 13† | — | — | — | 37† |
| swanOneself-hosted · S+PThe pinned model weights cannot currently be accessed (Hugging Face returned HTTP 401). Supplement measurements remain pending access recovery; the radar shows the existing S + P items. | — | 57 | 86 | 68† | 48 | 85† | 26† | 45† | 91† | 42† | — | — | — | — | — | — | — | — | — | — | — | — | — |
| Mercury DecideAPI · not measured | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |
| Winnow-12B Q8self-hosted · S+P+L1+L2+L3 | 78 | 64 | 40 | 59 | 39 | 52 | 39 | 54 | 53 | 45 | 41 | 29 | 44 | 33 | 41 | 46 | 36 | 57 | 55 | 34 | 38 | 44 | 40 |
| Bobcat 1.3self-hosted · not measured | — | 69 | 71 | 70† | 63 | 87 | — | 62† | — | 46† | — | — | — | — | — | — | — | 74† | 37† | — | — | — | 66† |
| JPT-35B-A3Bself-hosted · S+P+L1+L2+L3 | 86 | 56 | 39 | 48 | 32 | 45 | 34 | 28 | 43 | 47 | 32 | 28 | 44 | 17 | 6 | 39 | 34 | 28 | 46 | 33 | 45 | 17 | 20 |
| Chon-1.0-12B-Fastself-hosted · not measured | — | 56 | 71 | 75† | 78 | 88 | — | 49† | — | 49† | — | — | — | — | — | — | — | 71† | 31† | — | — | — | 44† |
| baselabs elephant-1self-hosted · not measured | — | 53 | 74 | 72† | 62 | 72 | — | 54† | — | 32† | — | — | — | — | — | — | — | 70† | 24† | — | — | — | 55† |
| metask-jev-rain-31B-trainedself-hosted · S+P (draw v1.6-regular-20261012) | — | 71 | 69 | 68† | 63 | 90 | — | 57† | — | 46† | — | — | — | — | — | — | — | 73† | 36† | — | — | — | 78† |
| deck-31Bself-hosted · S+P+L1+L2+L3 | 91 | 78 | 60 | 69 | 55 | 68 | 65 | 60 | 74 | 71 | 56 | 58 | 71 | 50 | 53 | 68 | 60 | 70 | 61 | 59 | 55 | 45 | 60 |
| Cygnetself-hosted · S+P+L1+L2+L3 | 79 | 57 | 38 | 56 | 41 | 41 | 32 | 39 | 63 | 45 | 34 | 27 | 42 | 36 | 21 | 42 | 45 | 53 | 54 | 34 | 39 | 46 | 40 |
| metask-jev-rain-12B-trainedself-hosted · S+P (draw v1.6-regular-20261012) | — | 64 | 74 | 81† | 72 | 85 | — | 49† | — | 45† | — | — | — | — | — | — | — | 59† | 25† | — | — | — | 77† |
| DOPEST 1.0 31Bself-hosted · not measured | — | 74 | 60 | 75† | 69 | 91 | — | 66† | — | 51† | — | — | — | — | — | — | — | 79† | 42† | — | — | — | 78† |
| Eikos-27Bself-hosted · S+P+L1+L2+L3 | 75 | 68 | 45 | 54 | 40 | 46 | 56 | 44 | 50 | 58 | 38 | 41 | 46 | 26 | 30 | 41 | 39 | 51 | 53 | 43 | 50 | 42 | 49 |
| Jev 1.13.0API · S+P+L1+L2+L3 | 76 | 68 | 38 | 44 | 22 | 48 | 35 | 34 | 36 | 36 | 30 | 15 | 43 | 11 | 7 | 34 | 20 | 36 | 43 | 23 | 47 | 19 | 21 |
| Microsoft-Decision-1 (Azure Foundry) — A2 re-runAPI · A2+P (draw v1.6-regular-20261012) | — | 59 | — | — | 53† | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |
| Jeffan-31b-1710self-hosted · not measured | — | 76 | 71 | 58† | 67 | 77 | — | 69† | — | 45† | — | — | — | — | — | — | — | 76† | 58† | — | — | — | 67† |
| Kev 27Bself-hosted · S+P+L1+L2+L3 | 77 | 69 | 47 | 50 | 38 | 42 | 42 | 44 | 64 | 44 | 41 | 45 | 44 | 20 | 26 | 50 | 31 | 51 | 55 | 35 | 48 | 22 | 33 |
| Jev-Omniself-hosted · S+P+L1+L2+L3 | 86 | 56 | 38 | 58 | 59 | 44 | 45 | 37 | 58 | 50 | 38 | 27 | 49 | 28 | 25 | 50 | 38 | 57 | 55 | 47 | 48 | 46 | 37 |
| Celeris-1 DecisionAPI · S+P (draw v1.6-regular-20261012) | — | 59 | 59 | 51† | 56 | 88 | — | 72† | — | 43† | — | — | — | — | — | — | — | 52† | 11† | — | — | — | 55† |
| GEV-26B-Decideself-hosted · S+P+L1+L2+L3 | 78 | 52 | 33 | 37 | 31 | 42 | 37 | 42 | 37 | 28 | 31 | 23 | 30 | 28 | 21 | 35 | 29 | 42 | 21 | 40 | 28 | 27 | 25 |
| decisio v0.8.0 on gemma-4-12B-itself-hosted · S+P+L1+L2+L3Language and category cells use the unchanged original S+P observations and the newly completed frozen supplemental items (L1, L2, L3), answered with the original model and serving setup on an isolated pod. Each supplement carries the same original P300 answers by stable item identity; they count once in the union. Failed requests stay scored as failures and are not imputed. Headline, rank, Composite and original pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 79 | 56 | 39 | 55 | 39 | 42 | 33 | 38 | 63 | 41 | 29 | 25 | 34 | 35 | 25 | 37 | 44 | 48 | 56 | 38 | 40 | 42 | 27 |
| Myles-G 31BAPI · S+P (draw v1.6-regular-20261012) | — | 75 | 71 | 71† | 68 | 89 | — | 59† | — | 40† | — | — | — | — | — | — | — | 76† | 38† | — | — | — | 67† |
| RSI-Jev v6.1-VL 27Bself-hosted · S+P (draw v1.6-regular-20261010-a2) | — | 57 | 83† | 83† | 51 | 72 | 44† | 90† | 42† | 32 | — | — | — | — | — | — | — | 53 | — | — | — | — | 0† |
| Nagi-ENORMOUS 27Bself-hosted · S+P (draw v1.6-regular-20261012) | — | 62 | 66 | 75† | 77 | 84 | — | 58† | — | 22† | — | — | — | — | — | — | — | 50† | 23† | — | — | — | 39† |
| StartLux-Decision v1.1 27B AutoThinkself-hosted · S+P (draw v1.6-regular-20261012) | — | 66 | 71 | 87† | 61 | 84 | — | 75† | — | 54† | — | — | — | — | — | — | — | 68† | 61† | — | — | — | 72† |
| Jev 1.14.0API · S+P (draw v1.6-regular-20261012) | — | 63 | 73 | 73† | 42 | 75 | — | 51† | — | 0† | — | — | — | — | — | — | — | 39† | 0† | — | — | — | 44† |
| metask-jev-rain-31B-trained service v3self-hosted · S+P (draw v1.6-regular-20261012) | — | 74 | 68 | 74† | 63 | 82 | — | 55† | — | 65† | — | — | — | — | — | — | — | 80† | 43† | — | — | — | 78† |
| decisio v0.9.0 on gemma-4-12B-itself-hosted · S+P+L1+L2+L3 | 81 | 56 | 41 | 55 | 38 | 40 | 31 | 41 | 62 | 41 | 28 | 29 | 36 | 34 | 25 | 37 | 44 | 48 | 56 | 37 | 40 | 43 | 31 |
| Bespoke Nimble 9B v3self-hosted · S+P+L1+L2+L3 | 80 | 61 | 45 | 50 | 35 | 44 | 30 | 30 | 56 | 41 | 27 | 7 | 40 | 32 | 17 | 36 | 23 | 32 | 42 | 60 | 54 | 20 | 37 |
| JEV-27Bself-hosted · S+P+L1+L2+L3 | 71 | 62 | 36 | 42 | 23 | 41 | 36 | 37 | 54 | 39 | 33 | 37 | 43 | 9 | 19 | 47 | 37 | 45 | 47 | 37 | 43 | 26 | 48 |
| torchcast-decision-12bself-hosted · S+P+L1+L2+L3 | 86 | 65 | 49 | 64 | 47 | 48 | 39 | 53 | 64 | 50 | 44 | 47 | 45 | 44 | 33 | 54 | 40 | 68 | 53 | 54 | 44 | 58 | 44 |
| Messier One v0.4self-hosted · S+P (draw v1.6-regular-20261012) | — | 51 | 68 | 62† | 70 | 72 | — | 65† | — | 39† | — | — | — | — | — | — | — | 32† | 18† | — | — | — | 55† |
| shisa-de-1self-hosted · S+P (draw v1.6-regular-20261012) | — | 45 | 61 | 76† | 45 | 88 | — | 52† | — | 30† | — | — | — | — | — | — | — | 52† | 25† | — | — | — | 50† |
| Microsoft-Decision-1 (Azure Foundry)API · not measured | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |
| Clefself-hosted · S+P+L1+L2+L3 | 82 | 65 | 50 | 49 | 27 | 49 | 38 | 46 | 55 | 45 | 33 | 43 | 43 | 21 | 30 | 31 | 36 | 52 | 44 | 37 | 49 | 23 | 36 |
| wity-1 (Wity, reasoning always)API · S+P+L1+L2+L3 | 75 | 73 | 57 | 68 | 32 | 50 | 33 | 44 | 46 | 43 | 29 | 40 | 17 | 36 | 32 | 29 | 41 | 44 | 55 | 43 | 31 | 18 | 5 |
| wity-1 (Wity, reasoning auto)API · S+P+L1+L2+L3 | 83 | 73 | 59 | 63 | 31 | 60 | 29 | 40 | 33 | 38 | 44 | 33 | 39 | 54 | 24 | 16 | 42 | 56 | 39 | 36 | 45 | 15 | 16 |
| Wald 4B v2.1self-hosted · S+P (draw v1.6-regular-20261010-a2) | — | 50 | 72† | 75† | 34 | 55 | 43† | 54† | 54† | 49 | — | — | — | — | — | — | — | 25 | — | — | — | — | 12† |
| Hopper 12B trainedself-hosted · S+P+L1+L2+L3Language and category cells use the unchanged original S+P observations and the newly completed frozen supplemental items (L1, L2, L3), answered with the original model and serving setup on an isolated pod. Each supplement carries the same original P300 answers by stable item identity; they count once in the union. Failed requests stay scored as failures and are not imputed. Headline, rank, Composite and original pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 79 | 54 | 50 | 51 | 42 | 48 | 33 | 39 | 54 | 42 | 32 | 23 | 38 | 28 | 16 | 36 | 32 | 48 | 47 | 34 | 32 | 24 | 34 |
| Blink v0.3 26B-A4Bself-hosted · S+P (draw v1.6-regular-20261010-a2) | — | 46 | 54† | 90† | 45 | 70 | 54† | 77† | 39† | 25 | — | — | — | — | — | — | — | 39 | — | — | — | — | 0† |
| Decision 2.0 Vega 27Bself-hosted · S+P+L1+L2+L3 | 68 | 64 | 39 | 49 | 23 | 36 | 26 | 30 | 35 | 36 | 41 | 30 | 44 | 18 | 22 | 29 | 30 | 46 | 51 | 21 | 43 | 21 | 40 |
| René-1 31B FP8self-hosted · S+P+L1+L2+L3Language and category cells use the unchanged original S+P observations and the newly completed frozen supplemental items (L1, L2, L3), answered with the original model and serving setup on an isolated pod. Each supplement carries the same original P300 answers by stable item identity; they count once in the union. Failed requests stay scored as failures and are not imputed. Headline, rank, Composite and original pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 75 | 67 | 45 | 39 | 42 | 46 | 40 | 31 | 55 | 37 | 35 | 37 | 54 | 13 | 25 | 44 | 33 | 47 | 43 | 42 | 46 | 20 | 43 |
| AutoJev-27B (denis-pplx, Qwen3.8-27B)self-hosted · S+P+L1+L2+L3 | 74 | 59 | 41 | 37 | 27 | 35 | 33 | 32 | 51 | 38 | 30 | 24 | 42 | 16 | 18 | 27 | 36 | 42 | 48 | 32 | 45 | 25 | 27 |
| OpenJev (thinking, BF16)self-hosted · S+P+L1+L2+L3 | 87 | 78 | 59 | 54 | 31 | 55 | 31 | 60 | 64 | 66 | 53 | 50 | 65 | 43 | 53 | 60 | 46 | 53 | 62 | 51 | 56 | 41 | 42 |
| Jebadiah 27Bself-hosted · S+P+L1+L2+L3 | 65 | 64 | 36 | 47 | 30 | 34 | 22 | 39 | 51 | 41 | 29 | 18 | 37 | 18 | 11 | 31 | 33 | 49 | 46 | 29 | 44 | 17 | 26 |
| decider chat on Gemma-4-31B-itself-hosted · S+P+L1+L2+L3 | 75 | 64 | 58 | 54 | 34 | 53 | 50 | 45 | 56 | 59 | 45 | 39 | 52 | 45 | 32 | 43 | 44 | 51 | 44 | 43 | 44 | 44 | 49 |
| attest-31B-v1.0API · S+P (draw v1.6-regular-20261012) | — | 67 | 67 | 74† | 58 | 89 | — | 53† | — | 45† | — | — | — | — | — | — | — | 82† | 26† | — | — | — | 67† |
| NInfer Qwen3.8-Flash-Next mixedself-hosted · S+P+L1+L2+L3 | 72 | 53 | 41 | 50 | 24 | 33 | 30 | 33 | 55 | 33 | 28 | 16 | 43 | 20 | 27 | 36 | 35 | 54 | 31 | 38 | 43 | 25 | 20 |
| Metask rain 4Bself-hosted · S+P (draw v1.6-fastlane-20261009) | 100† | 48 | 65 | 74† | 60 | 62 | 61† | — | 30† | 8† | — | — | — | — | — | — | 0† | 41† | 0† | — | — | — | 73† |
| Sage 1.4API · S+P (draw v1.6-regular-20261012) | — | 65 | 65 | 73† | 65 | 83 | — | 67† | — | 39† | — | — | — | — | — | — | — | 34† | 52† | — | — | — | 61† |
| FrontiersMind Lumma-fev-27Bself-hosted · not measured | — | 55 | 64 | 69† | 51 | 76 | — | 62† | — | 26† | — | — | — | — | — | — | — | 33† | 2† | — | — | — | 55† |
| Respan Span-02self-hosted · S+P (draw v1.6-regular-20261012) | — | 60 | 50 | 57† | 61 | 80 | — | 53† | — | 37† | — | — | — | — | — | — | — | 70† | 29† | — | — | — | 72† |
| NInfer Qwen3.8-27B NVFP4self-hosted · S+P+L1+L2+L3 | 72 | 55 | 45 | 51 | 35 | 40 | 32 | 23 | 41 | 42 | 33 | 22 | 38 | 22 | 17 | 18 | 37 | 58 | 37 | 26 | 43 | 17 | 8 |
| SPX-CD FlashAPI · S+P+L1+L2+L3 | 78 | 63 | 38 | 43 | 36 | 40 | 27 | 34 | 49 | 48 | 31 | 22 | 30 | 17 | 8 | 38 | 24 | 37 | 51 | 46 | 50 | 12 | 29 |
| decider-35b-a3bself-hosted · S+P+L1+L2+L3 | 77 | 52 | 31 | 29 | 16 | 45 | 23 | 23 | 37 | 24 | 29 | 16 | 44 | 9 | 5 | 24 | 22 | 41 | 36 | 24 | 38 | 14 | 28 |
| Diffusion Jevself-hosted · S+P+L1+L2+L3Language and category cells use the unchanged original S+P observations and the newly completed frozen supplemental items (L1, L2, L3), answered with the original model and serving setup on an isolated pod. Each supplement carries the same original P300 answers by stable item identity; they count once in the union. Failed requests stay scored as failures and are not imputed. Headline, rank, Composite and original pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 82 | 59 | 51 | 57 | 49 | 65 | 37 | 41 | 52 | 44 | 48 | 29 | 43 | 45 | 36 | 49 | 44 | 63 | 50 | 50 | 51 | 38 | 16 |
| SPX-CD-Omniself-hosted · S+P+L1+L2+L3Language and category cells use the unchanged original S+P observations and the newly completed frozen supplemental items (L1, L2, L3), answered with the original model and serving setup on an isolated pod. Each supplement carries the same original P300 answers by stable item identity; they count once in the union. Failed requests stay scored as failures and are not imputed. Headline, rank, Composite and original pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 80 | 53 | 35 | 40 | 46 | 36 | 29 | 32 | 50 | 44 | 41 | 34 | 44 | 26 | 31 | 48 | 22 | 44 | 56 | 35 | 38 | 24 | 34 |
| OpenAI DecisionsAPI · A5+P+L1+L2+L3L3 items were reviewed by an OpenAI model, so the L3-based language and category cells of this row carry that exposure; headline scores do not use L3. | 76 | 59 | 36 | 48 | 41 | 55 | 27 | 37 | 43 | 37 | 24 | 23 | 46 | 37 | 30 | 33 | 27 | 40 | 33 | 39 | 37 | 40 | 25 |
| InstinctAPI · A4+P+L1+L2+L3 | 67 | 58 | 22 | 35 | 32 | 28 | 27 | 31 | 52 | 48 | 20 | 18 | 34 | 19 | 23 | 22 | 39 | 39 | 39 | 42 | 43 | 13 | 7 |
| HS1 0.1.2API · S+P (draw v1.6-regular-20261012) | — | 50 | 54 | 73† | 46 | 78 | — | 61† | — | 35† | — | — | — | — | — | — | — | 58† | 37† | — | — | — | 39† |
| KnowLine 31B-Gen1self-hosted · not measured | — | 81 | 72 | 68† | 75 | 88 | — | 63† | — | 46† | — | — | — | — | — | — | — | 80† | 53† | — | — | — | 67† |
| Amazon Strands Decider 26B-A4Bself-hosted · not measured | — | 43 | 68 | 49† | 49 | 69 | — | 59† | — | 56† | — | — | — | — | — | — | — | 32† | 15† | — | — | — | 40† |
| Turion Jev 31Bself-hosted · not measured | — | 75 | 72 | 50† | 62 | 83 | — | 68† | — | 54† | — | — | — | — | — | — | — | 71† | 61† | — | — | — | 72† |
| KnowLine 4B-Gen5.5self-hosted · not measured | — | 49 | 64 | 46† | 27 | 76 | — | 92† | — | 15† | — | — | — | — | — | — | — | 31† | 2† | — | — | — | 33† |
| JevOneself-hosted · S+P+L1+L2+L3 | 73 | 49 | 37 | 35 | 22 | 33 | 10 | 21 | 32 | 31 | 22 | 10 | 20 | 10 | 9 | 20 | 24 | 30 | 40 | 18 | 32 | 1 | 0 |
| Seb-9B-v2self-hosted · not measured | — | 44 | 65 | 74† | 31 | 68 | — | 86† | — | 33† | — | — | — | — | — | — | — | 19† | 5† | — | — | — | 22† |
| pplx-decider-flash-v1.2self-hosted · S+P (draw v1.6-regular-20261012) | — | 47 | 66 | 65† | 54 | 74 | — | 86† | — | 24† | — | — | — | — | — | — | — | 0† | 0† | — | — | — | 22† |
| APUS-OpenJev-v1-9Bself-hosted · S+P+L1+L2+L3Language and category cells use the unchanged original S+P observations and the newly completed frozen supplemental items (L1, L2, L3), answered with the original model and serving setup on an isolated pod. Each supplement carries the same original P300 answers by stable item identity; they count once in the union. Failed requests stay scored as failures and are not imputed. Headline, rank, Composite and original pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 74 | 48 | 33 | 31 | 25 | 37 | 18 | 22 | 37 | 41 | 8 | 0 | 20 | 25 | 6 | 16 | 28 | 29 | 30 | 34 | 35 | 17 | 12 |
| Aplomb 1self-hosted · S+P+L1+L2+L3The headline keeps the original published measurement. Its originally pinned Hugging Face revision (f8e2dc81) was later deleted upstream, so the language and category supplements (L1, L2, L3) were measured on 12 Oct 2026 with the current upstream revision d6743291 (all file hashes recorded) on an isolated pod. That revision reproduces the original answers: 98 % agreement on the 300 public items (published bar 95 %) and 97.5 % on all 1,500 headline items. Each supplement carries the original P300 answers by stable item identity; they count once. All new (sealed) supplement items were answered; the only failed requests (3 public items, GPU out-of-memory) are covered by the original P300 answers. Headline, rank, Composite and pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 69 | 46 | 43 | 36 | 26 | 41 | 21 | 22 | 44 | 27 | 22 | 14 | 24 | 28 | 11 | 27 | 27 | 25 | 43 | 33 | 38 | 13 | 2 |
| JADEself-hosted · S+P+L1+L2+L3 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Tern-35B-A3Bself-hosted · not measured | — | 43 | 67 | 58† | 36 | 76 | — | 56† | — | 13† | — | — | — | — | — | — | — | 33† | 18† | — | — | — | 21† |
| AJev lm6qself-hosted · not measured | — | 74 | 68 | 76† | 67 | 84 | — | 64† | — | 43† | — | — | — | — | — | — | — | 77† | 59† | — | — | — | 65† |
| Strike-1API · not measured | 67 | 46 | 70 | 56 | 28 | 58 | 28 | 66 | 57 | 56 | 34 | 43 | 68 | 42 | 62 | 54 | 52 | 57 | 59† | 73 | 54 | 42 | 24† |
| Saif 4Bself-hosted · not measured | 66 | 44 | 58 | 51 | 27 | 56 | 26 | 58 | 66 | 34 | 30 | 46 | 51 | 47 | 49 | 54 | 36 | 21 | 62† | 67 | 64 | 42 | 49† |
| Arcbright Elf 1 12Bself-hosted · S+P (draw v1.6-regular-20261012) | — | 41 | 53 | 60† | 57 | 79 | — | 65† | — | 30† | — | — | — | — | — | — | — | 42† | 0† | — | — | — | 33† |
| Plumb-4Bself-hosted · S+P+L1+L2+L3 | 72 | 45 | 35 | 45 | 36 | 30 | 38 | 27 | 32 | 34 | 25 | 8 | 32 | 40 | 14 | 24 | 31 | 25 | 28 | 27 | 39 | 22 | 20 |
| wity-1 (Wity, reasoning off)API · S+P+L1+L2+L3 | 67 | 52 | 38 | 48 | 29 | 36 | 21 | 26 | 10 | 13 | 17 | 14 | 17 | 17 | 6 | 11 | 24 | 30 | 31 | 33 | 33 | 26 | 1 |
| cribl-decision-2self-hosted · not measured | 71 | 44 | 67 | 37 | 40 | 56 | 16 | 42 | 64 | 41 | 27 | 49 | 54 | 50 | 57 | 63 | 40 | 34 | 65† | 65 | 64 | 35 | 35† |
| SPX-CD ProAPI · S+P+L1+L2+L3 | 82 | 70 | 44 | 55 | 37 | 44 | 53 | 43 | 62 | 50 | 35 | 47 | 41 | 19 | 22 | 47 | 37 | 48 | 54 | 29 | 52 | 29 | 47 |
| Messier One v0.2self-hosted · not measured | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |
| spark-s1-4b-v6self-hosted · S+P+L1+L2+L3 | 80 | 46 | 33 | 31 | 18 | 28 | 9 | 17 | 37 | 35 | 22 | 0 | 22 | 23 | 0 | 15 | 29 | 20 | 23 | 10 | 26 | 2 | 7 |
| Bev / Bonsai 27Bself-hosted · S+P+L1+L2+L3 | 67 | 46 | 26 | 35 | 19 | 30 | 14 | 17 | 25 | 22 | 16 | 0 | 9 | 0 | 0 | 0 | 24 | 28 | 6 | 21 | 27 | 4 | 6 |
| Clef-Flashself-hosted · S+P+L1+L2+L3 | 69 | 44 | 40 | 31 | 8 | 34 | 9 | 19 | 41 | 29 | 23 | 18 | 10 | 2 | 0 | 11 | 12 | 23 | 23 | 23 | 36 | 13 | 11 |
| Quyet-1.0-Mediumself-hosted · S+P+L1+L2+L3 | 60 | 44 | 33 | 32 | 25 | 42 | 25 | 15 | 35 | 32 | 23 | 8 | 15 | 20 | 0 | 29 | 33 | 35 | 19 | 21 | 35 | 12 | 14 |
| Open-Jev 9Bself-hosted · S+P+L1+L2+L3 | 70 | 47 | 40 | 48 | 23 | 44 | 26 | 21 | 26 | 35 | 18 | 0 | 24 | 5 | 14 | 28 | 19 | 35 | 15 | 30 | 38 | 14 | 17 |
| LitJevself-hosted · S+P+L1+L2+L3 | 69 | 49 | 34 | 39 | 27 | 36 | 30 | 23 | 34 | 34 | 28 | 0 | 24 | 22 | 10 | 10 | 32 | 39 | 40 | 29 | 30 | 13 | 1 |
| Bespoke Nimble 9Bself-hosted · S+P+L1+L2+L3 | 66 | 45 | 41 | 36 | 35 | 41 | 10 | 21 | 37 | 26 | 19 | 4 | 23 | 9 | 12 | 6 | 25 | 26 | 39 | 40 | 32 | 14 | 11 |
| SimpleJev Qwen3.8-27B (self-hosted, v1.6 pool)self-hosted · S+P+L1+L2+L3 | 80 | 62 | 44 | 52 | 34 | 41 | 43 | 29 | 61 | 41 | 33 | 24 | 39 | 25 | 29 | 32 | 41 | 49 | 50 | 31 | 50 | 29 | 26 |
| Qwen3.5-9B Jev-like data-mix v2self-hosted · S+P+L1+L2+L3 | 71 | 46 | 29 | 24 | 18 | 37 | 6 | 13 | 35 | 31 | 12 | 0 | 25 | 3 | 0 | 9 | 18 | 30 | 38 | 24 | 24 | 3 | 21 |
| levself-hosted · S+P+L1+L2+L3 | 55 | 41 | 28 | 20 | 22 | 22 | 12 | 22 | 28 | 22 | 29 | 8 | 22 | 11 | 2 | 14 | 17 | 28 | 19 | 24 | 37 | 5 | 37 |
| JPT-4Bself-hosted · S+P (draw v1.6-regular-20261012) | — | 36 | 75 | 63† | 27 | 75 | — | 70† | — | 30† | — | — | — | — | — | — | — | 11† | 14† | — | — | — | 33† |
| jev-localself-hosted · S+P+L1+L2+L3 | 71 | 46 | 43 | 31 | 21 | 31 | 21 | 22 | 33 | 32 | 17 | 7 | 20 | 12 | 7 | 21 | 29 | 10 | 34 | 25 | 29 | 11 | 5 |
| Aleria Judge 1.1.1self-hosted · not measured | — | 70 | 67 | 69† | 65 | 85 | — | 58† | — | 49† | — | — | — | — | — | — | — | 68† | 28† | — | — | — | 53† |
| Bespoke Nimble-v4API · S+P (draw v1.6-regular-20261012) | — | 42 | 67 | 51† | 39 | 73 | — | 72† | — | 15† | — | — | — | — | — | — | — | 22† | 0† | — | — | — | 33† |
| decider-4b v2self-hosted · S+P+L1+L2+L3 | 62 | 42 | 41 | 25 | 11 | 28 | 8 | 22 | 21 | 32 | 32 | 0 | 18 | 13 | 1 | 8 | 18 | 32 | 22 | 24 | 29 | 1 | 1 |
| Jeffan-4B-2010self-hosted · not measured | — | 39 | 66 | 76† | 30 | 63 | — | 83† | — | 14† | — | — | — | — | — | — | — | 20† | 0† | — | — | — | 22† |
| ClassOne Qwen 3.5 9Bself-hosted · S+P+L1+L2+L3Language and category cells use the unchanged original S+P observations and the newly completed frozen supplemental items (L1, L2, L3), answered with the original model and serving setup on an isolated pod. Each supplement carries the same original P300 answers by stable item identity; they count once in the union. Failed requests stay scored as failures and are not imputed. Headline, rank, Composite and original pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 71 | 45 | 38 | 51 | 26 | 36 | 23 | 19 | 30 | 43 | 23 | 0 | 17 | 8 | 1 | 4 | 11 | 30 | 17 | 18 | 40 | 13 | 31 |
| Vansa-3.4API · A4+P+L1+L2+L3 | 54 | 47 | 12 | 42 | 28 | 17 | 12 | 10 | 24 | 43 | 11 | 0 | 13 | 19 | 12 | 9 | 17 | 26 | 15 | 33 | 35 | 0 | 11 |
| Wald 4Bself-hosted · S+P (draw v1.6-fastlane-20261009) | 95† | 43 | 51 | 52† | 35 | 54 | 51† | — | 47† | 0† | — | — | — | — | — | — | 8† | 26† | 14† | — | — | — | 15† |
| Open-Jev 27B v1.1self-hosted · S+P+L1+L2+L3 | 64 | 55 | 44 | 41 | 22 | 40 | 24 | 21 | 44 | 33 | 28 | 37 | 38 | 8 | 11 | 23 | 11 | 42 | 36 | 34 | 37 | 24 | 23 |
| GPT-6 Luna (low reasoning effort)API · A4+P+L1+L2+L3L3 items were reviewed by an OpenAI model, so the L3-based language and category cells of this row carry that exposure; headline scores do not use L3. | 97 | 96 | 91 | 93 | 91 | 94 | 100 | 94 | 100 | 99 | 98 | 96 | 94 | 93 | 96 | 94 | 96 | 97 | 100 | 98 | 96 | 99 | 97 |
| GLiClass v4 9Bself-hosted · not measured | — | 36 | 58 | 65† | 59 | 80 | — | 71† | — | 45† | — | — | — | — | — | — | — | 14† | 0† | — | — | — | 39† |
| Autoloops – Gemma 4 31B ITAPI · A4+P+L1+L2+L3 | 73 | 67 | 44 | 50 | 44 | 56 | 61 | 42 | 61 | 60 | 43 | 48 | 48 | 48 | 47 | 60 | 50 | 55 | 49 | 45 | 53 | 41 | 51 |
| metask-jev-4bself-hosted · S+P+L1+L2+L3 | 73 | 40 | 30 | 34 | 15 | 21 | 16 | 19 | 28 | 24 | 12 | 9 | 15 | 4 | 0 | 9 | 11 | 23 | 16 | 12 | 26 | 4 | 0 |
| Kahn1 4Bself-hosted · S+P+L1+L2+L3 | 67 | 40 | 36 | 46 | 28 | 35 | 25 | 30 | 29 | 45 | 25 | 5 | 35 | 25 | 21 | 14 | 33 | 19 | 28 | 41 | 30 | 20 | 20 |
| JevK5 v0.3self-hosted · S+P+L1+L2+L3 | 67 | 43 | 40 | 42 | 29 | 19 | 20 | 13 | 28 | 30 | 18 | 0 | 28 | 27 | 8 | 16 | 28 | 17 | 22 | 34 | 29 | 3 | 18 |
| GPT-6 Luna (default medium reasoning effort)API · A4+P+L1+L2+L3L3 items were reviewed by an OpenAI model, so the L3-based language and category cells of this row carry that exposure; headline scores do not use L3. | 97 | 97 | 98 | 96 | 91 | 98 | 100 | 99 | 99 | 96 | 98 | 100 | 96 | 95 | 98 | 95 | 97 | 99 | 95 | 96 | 100 | 99 | 96 |
| deck-4B v1.0self-hosted · S+P+L1+L2+L3 | 67 | 43 | 37 | 45 | 32 | 22 | 21 | 19 | 29 | 30 | 22 | 0 | 31 | 26 | 5 | 13 | 23 | 18 | 27 | 36 | 29 | 19 | 17 |
| Seb-9Bself-hosted · not measured | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |
| Decision-4Bself-hosted · S+P+L1+L2+L3 | 61 | 43 | 27 | 19 | 0 | 31 | 0 | 7 | 20 | 22 | 26 | 2 | 6 | 10 | 0 | 0 | 21 | 17 | 13 | 15 | 25 | 0 | 0 |
| decisor-4bself-hosted · S+P (draw v1.6-fastlane-20261009) | 100† | 36 | 70 | 53† | 44 | 58 | 24† | — | 45† | 0† | — | — | — | — | — | — | 50† | 12† | 11† | — | — | — | 13† |
| janus 4Bself-hosted · S+P+L1+L2+L3 | 63 | 40 | 35 | 23 | 15 | 19 | 9 | 15 | 21 | 20 | 16 | 2 | 25 | 9 | 0 | 0 | 11 | 29 | 17 | 15 | 20 | 10 | 7 |
| Jebadiah 9B v2.1self-hosted · S+P (draw v1.6-regular-20261012) | — | 35 | 67 | 45† | 32 | 70 | — | 62† | — | 25† | — | — | — | — | — | — | — | 3† | 5† | — | — | — | 22† |
| JevK5 v0.2.0self-hosted · S+P+L1+L2+L3 | 65 | 36 | 26 | 36 | 21 | 21 | 23 | 15 | 24 | 20 | 6 | 0 | 10 | 13 | 7 | 4 | 24 | 21 | 19 | 18 | 26 | 13 | 2 |
| Amos 1 mediumAPI · S+P (draw v1.6-regular-20261012) | — | 35 | 62 | 71† | 46 | 86 | — | 59† | — | 40† | — | — | — | — | — | — | — | 15† | 0† | — | — | — | 15† |
| Decision 2.0 Lux 9Bself-hosted · S+P (draw v1.6-regular-20261012) | — | 31 | 64 | 67† | 40 | 67 | — | 75† | — | 14† | — | — | — | — | — | — | — | 19† | 9† | — | — | — | 33† |
| Verdin-4Bself-hosted · S+P (draw v1.6-regular-20261012) | — | 31 | 56 | 51† | 40 | 54 | — | 69† | — | 52† | — | — | — | — | — | — | — | 34† | 5† | — | — | — | 21† |
| TypeCastLM 1.4.0self-hosted · S+P+L1+L2+L3Language and category cells use the unchanged original S+P observations and the newly completed frozen supplemental items (L1, L2, L3), answered with the original model and serving setup on an isolated pod. Each supplement carries the same original P300 answers by stable item identity; they count once in the union. Failed requests stay scored as failures and are not imputed. Headline, rank, Composite and original pricing are unchanged. L3 items were reviewed by an OpenAI model, so cells based on L3 carry that exposure; headline scores do not use L3. | 57 | 38 | 24 | 25 | 8 | 22 | 16 | 17 | 28 | 18 | 12 | 0 | 17 | 9 | 0 | 5 | 17 | 9 | 6 | 15 | 19 | 13 | 3 |
| blink-4bself-hosted · S+P (draw v1.6-regular-20261012) | — | 31 | 73 | 51† | 31 | 79 | — | 66† | — | 33† | — | — | — | — | — | — | — | 2† | 14† | — | — | — | 22† |
| Fastino GLiDEAPI · A4+P+L1+L2+L3 | 69 | 73 | 40 | 53 | 29 | 42 | 43 | 37 | 71 | 52 | 43 | 33 | 43 | 22 | 33 | 37 | 56 | 53 | 47 | 45 | 43 | 35 | 40 |
| Imajev-9Bself-hosted · S+P (draw v1.6-regular-20261012) | — | 33 | 63 | 49† | 40 | 65 | — | 64† | — | 29† | — | — | — | — | — | — | — | 9† | 0† | — | — | — | 15† |
| jiwo 4bself-hosted · S+P (draw v1.6-regular-20261010-a2) | — | 30 | 53† | 78† | 34 | 43 | 41† | 65† | 20† | 12 | — | — | — | — | — | — | — | 12 | — | — | — | — | 0† |
| Imajev-4Bself-hosted · S+P+L1+L2+L3 | 51 | 37 | 30 | 27 | 9 | 24 | 0 | 19 | 12 | 10 | 14 | 0 | 9 | 0 | 0 | 0 | 8 | 10 | 13 | 5 | 29 | 1 | 0 |
| Jev-Style-2Bself-hosted · not measured | 57 | 33 | 36 | 26 | 29 | 38 | 21 | 42 | 28 | 14 | 9 | 29 | 16 | 21 | 11 | 27 | 10 | 0 | 44† | 42 | 57 | 27 | 2† |
| Sors-2Bself-hosted · not measured | 64 | 40 | 42 | 23 | 39 | 43 | 31 | 34 | 48 | 38 | 15 | 54 | 69 | 13 | 24 | 43 | 30 | 0 | 48† | 58 | 48 | 17 | 44† |
| Uniphore-4B-Deciderself-hosted · S+P (draw v1.6-regular-20261012) | — | 32 | 71 | 52† | 25 | 70 | — | 74† | — | 29† | — | — |