{"schema_version":1,"benchmark":"ImageJevBench by Benchmark Heaven","version":"v0.3.0","built_at":"2026-10-07T15:19:10.573549+00:00","source_sha256":"1f5014f77a9945c2098f50460872a3d5c193b3751a3fb44543bcaf0931365ffc","method":{"revision":"v0.3.0","built_at":"2026-10-07T15:19:10.573549+00:00","artifact_sha256":"1f5014f77a9945c2098f50460872a3d5c193b3751a3fb44543bcaf0931365ffc","counts":{"reserve":2441,"real_hf":713,"synthetic":1728,"public":300,"sealed":1200,"api_subset":300,"equating_note":"Frozen v0.2 scoring math is applied to the new draw. Core is the headline; computer-use is separate. Pending field-median gap/API equating holds remain visible per row. Scores from v0.1.5 are not directly ranked on the v0.3 scale. GPT-6 Luna via OpenAI Decisions was measured on 6 Oct 2026 through the native Decisions choice endpoint (same option text, native option probabilities, images re-encoded losslessly as PNG, refusals and provider errors counted wrong, no retries); the GPT-6 Luna chat-completions row was re-measured separately on 7 Oct 2026 (see below). Wity-1 (AlphaNimble) was measured on 7 Oct 2026 on the same A300+P300 input through its native SystemOne choice endpoint (reasoning=auto, native option probabilities, no retries; failed requests and timeouts counted wrong). Images that would exceed Wity's 12 MB request limit were downscaled to 1,500 px on the long side, as Wity's docs advise (2 images). Latency is measured end to end; on this run large images took much longer on the Wity side than the model time Wity reports. A second Wity-1 row uses reasoning off (the server default); the first row uses reasoning auto. Dated-carry re-measurement (7 Oct 2026, requested by Florian): GPT-6 Luna (chat), GPT-5.6 Luna, Gemini 3.1 Flash Lite, Gemini 3.8 Flash and Autoloops Gemma 4 31B IT were re-measured on the same A300+P300 input as an owner exception to the N=3 API refresh cadence (no provider version change is claimed; exposure logged before dispatch). OpenRouter and Autoloops requests used the unchanged v0.2 prompts and parsers; images were sent with their real MIME type, 7 BMP images were re-encoded losslessly as PNG and 5 images over 6 MiB were downscaled to 2,048 px on the long side. Provider failures count wrong; no retries. Gemini 3.8 Flash reasons by default and ran out of the 384-token answer budget on 329 of 600 items, which count wrong under the unchanged method. NeoHorse Jev 4B was re-measured on its self-hosted runtime at Hugging Face revision 434cb21d (identical weights and code; the reviewed revision 56c36ae6 was removed by the author). The two JevAny rows remain carries because their source is unavailable.","passes":"Pass 1 is the official prediction pass; pass 2 is diagnostic and is never included in these rankings. Reproducibility: a full second pass of the 29 common self-hosted systems on a fresh pod returned the same answer for 1,500 of 1,500 items in every system (100 % agreement)."},"capability":{"anchor":"jev-1.13.0","anchor_source":"JevBench v1.5.4","factor":2,"cost_usd_per_1000_cap":0.06459465517241379,"latency_p50_s_cap":1.2329566404223442,"anchor_cost_usd_per_1000":0.032297327586206896,"anchor_latency_p50_s":0.6164783202111721,"rationale":"ImageJevBench has no Jev reference row because Jev does not accept images. Capability eligibility therefore uses the same absolute envelope as JevBench: twice Jev 1.13.0’s v1.5.4 cost and adjusted median latency. These anchor values are frozen here so later JevBench releases do not move the ImageJevBench cap."},"composite":{"definition":"Weighted harmonic mean of Intelligence, Calibration, Speed and Cost, multiplied by squared penalties when Intelligence is below its configured floor, or Speed or Cost is below 50. Equal 25% weights do not mean an arithmetic average.","weights":{"intelligence":25,"calibration":25,"speed":25,"cost":25},"intelligence_floor":50,"speed_floor":50,"cost_floor":50}},"scope":"Published core track only; dated carry and computer-use track are separate. Cite source_sha256 for the exact result bytes.","rows":[{"key":"wity_1","name":"Wity-1 (AlphaNimble), reasoning auto","last_measured_on":"2026-10-07T11:18:42.946732+00:00","source_url":"https://wity.alphanimble.com/","ranked":true,"not_ranked_because":null,"capability":74.02894240271806,"composite":71.20534871268245,"intelligence":68.69211947094445,"calibration":79.36576533449167,"speed":66.27371847599187,"cost_axis":71.79258072904886},{"key":"imajev_4b","name":"Imajev-4B","last_measured_on":"2026-10-06T18:39:58.945603+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":68.00815133457166,"composite":63.714150433135494,"intelligence":49.912099813991645,"calibration":86.1042028551517,"speed":86.25032165855477,"cost_axis":51.76882846981477},{"key":"surogate_rune_26b_v3","name":"Surogate Rune 26B-A4B v3","last_measured_on":"2026-10-06T18:39:58.969603+00:00","source_url":"https://huggingface.co/surogate/rune-26b-a4b-GGUF","ranked":true,"not_ranked_because":null,"capability":64.80734378424876,"composite":42.45660909190766,"intelligence":44.802301097191055,"calibration":84.81238647130645,"speed":85.40678897602376,"cost_axis":47.07794794076873},{"key":"kushal_gemma4_31b_it_autoloops","name":"Autoloops – Gemma 4 31B IT","last_measured_on":"2026-10-07T13:59:33.425607+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":68.34612872759499,"composite":41.37214357411463,"intelligence":49.69106235123083,"calibration":87.00119510395915,"speed":75.0112987443141,"cost_axis":42.36461877432538},{"key":"imajev_9b","name":"imajev 9B","last_measured_on":"2026-10-06T18:39:58.949603+00:00","source_url":"https://huggingface.co/mohit67890/imajev-9b","ranked":true,"not_ranked_because":null,"capability":67.07083180482039,"composite":34.52367925709313,"intelligence":48.33225164592811,"calibration":85.80941196371268,"speed":80.72541425758794,"cost_axis":40.108419916329765},{"key":"wity_1_off","name":"Wity-1 (AlphaNimble), reasoning off","last_measured_on":"2026-10-07T13:59:33.425607+00:00","source_url":"https://wity.alphanimble.com/","ranked":true,"not_ranked_because":null,"capability":56.15775650871143,"composite":33.08473742784245,"intelligence":37.44011467989038,"calibration":74.87539833753249,"speed":72.48321137129895,"cost_axis":71.79258072904886},{"key":"jev_omni","name":"Jev-Omni","last_measured_on":"2026-10-06T18:39:58.949603+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":54.25010940945775,"composite":32.84476033103093,"intelligence":37.5428930262609,"calibration":70.9573257926546,"speed":88.76929265483074,"cost_axis":60.00043944820517},{"key":"jpt_9b","name":"JPT-9B (kirp / llm2jev)","last_measured_on":"2026-10-06T18:39:58.957603+00:00","source_url":"https://huggingface.co/kirp/jpt-9b","ranked":true,"not_ranked_because":null,"capability":58.724020261408135,"composite":31.43482324293899,"intelligence":44.287843520154325,"calibration":73.16019700266195,"speed":81.59890595061219,"cost_axis":42.47534555544172},{"key":"neohorse_jev_4b","name":"NeoHorse Jev 4B","last_measured_on":"2026-10-07T15:18:40.784819+00:00","source_url":"https://huggingface.co/TokenRhythm/NeoHorse-Jev-4B","ranked":true,"not_ranked_because":null,"capability":57.62143030219451,"composite":30.45233617944629,"intelligence":36.82579044708881,"calibration":78.4170701573002,"speed":86.78931800554419,"cost_axis":50.44467630521143},{"key":"jevify_gemma4_26b_a4b","name":"Jevify Gemma 4 26B-A4B","last_measured_on":"2026-10-06T18:39:58.949603+00:00","source_url":"https://huggingface.co/kushalpatil/jevify-gemma4-26b-a4b","ranked":true,"not_ranked_because":null,"capability":58.73392972986179,"composite":29.67854238938692,"intelligence":38.49741766113502,"calibration":78.97044179858857,"speed":85.54923125543378,"cost_axis":47.29042850843103},{"key":"autojev_27b","name":"AutoJev-27B","last_measured_on":"2026-10-06T18:39:58.933603+00:00","source_url":"https://huggingface.co/denis-pplx/autojev-27b","ranked":true,"not_ranked_because":null,"capability":62.14807280669487,"composite":29.338747300476655,"intelligence":37.5571435243649,"calibration":86.73900208902484,"speed":85.68582841158397,"cost_axis":47.930716352659346},{"key":"jpt_4b","name":"JPT-4B (kirp / llm2jev)","last_measured_on":"2026-10-06T18:39:58.953603+00:00","source_url":"https://huggingface.co/kirp/jpt-4b","ranked":true,"not_ranked_because":null,"capability":55.62157033861286,"composite":26.548911345338187,"intelligence":38.26627166279164,"calibration":72.97686901443409,"speed":83.32870956469687,"cost_axis":45.698922000855035},{"key":"seanliu_jev_vision_8b","name":"Jev-Vision 8B (SeanLiu)","last_measured_on":"2026-10-06T18:39:58.965603+00:00","source_url":"https://huggingface.co/SeanLiu/Jev-Vision","ranked":true,"not_ranked_because":null,"capability":37.76380296341325,"composite":25.50840982937144,"intelligence":38.99762474006772,"calibration":36.529981186758775,"speed":84.83602601624847,"cost_axis":47.44244857365174},{"key":"s1-vision","name":"System1 s1-vision (System1 Models)","last_measured_on":"2026-10-06T18:39:58.973602+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":58.265076839005395,"composite":23.937566212867583,"intelligence":42.01032448942553,"calibration":74.51982918858526,"speed":90.72276682555781,"cost_axis":39.486309709635144},{"key":"shisa_de_1","name":"shisa-de-1","last_measured_on":"2026-10-06T18:39:58.965603+00:00","source_url":"https://huggingface.co/shisa-ai/shisa-de-1","ranked":true,"not_ranked_because":null,"capability":51.46110090220014,"composite":22.827353425972486,"intelligence":34.89935265055726,"calibration":68.02284915384301,"speed":85.49763406488808,"cost_axis":47.24416290658394},{"key":"clef_flash","name":"Clef-Flash (Cloudflare)","last_measured_on":"2026-10-06T18:39:58.937603+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":52.242066261085995,"composite":20.41332641283099,"intelligence":37.283246031709524,"calibration":67.20088649046247,"speed":81.43608064054402,"cost_axis":42.21616791210676},{"key":"clef","name":"Clef (Cloudflare)","last_measured_on":"2026-10-06T18:39:58.933603+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":58.078071888840654,"composite":18.65217306735797,"intelligence":47.403089978582685,"calibration":68.75305379909862,"speed":75.73157576853697,"cost_axis":32.193052704622644},{"key":"gpt6_luna_decisions","name":"GPT-6 Luna via OpenAI Decisions (OpenAI)","last_measured_on":"2026-10-06T22:09:55.865802+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":62.86749027752279,"composite":17.304447326927857,"intelligence":45.00061795206187,"calibration":80.73436260298371,"speed":81.94459199811888,"cost_axis":32.23665547357503},{"key":"winnow_12b_q8","name":"Winnow-12B (Q8_0 + F16 vision projector)","last_measured_on":"2026-10-06T18:39:58.973602+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":49.99327379732049,"composite":17.076041429294005,"intelligence":38.63194820142968,"calibration":61.3545993932113,"speed":82.52942679243671,"cost_axis":37.968863491072845},{"key":"image_hopper","name":"Image Hopper (HopitAI)","last_measured_on":"2026-10-06T18:39:58.945603+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":51.68214760978667,"composite":15.299609388298443,"intelligence":32.49323433055565,"calibration":70.87106088901768,"speed":83.15801981680382,"cost_axis":42.65445905066934},{"key":"omnijev_9b_v4_tzcfly","name":"OmniJev-Qwen3.5-9B-v4 (tzcfly)","last_measured_on":"2026-10-06T18:39:58.961603+00:00","source_url":"https://huggingface.co/tzcfly/OmniJev-Qwen3.5-9B-v4","ranked":true,"not_ranked_because":null,"capability":33.1431267864209,"composite":14.988415675862688,"intelligence":29.009173304809927,"calibration":37.277080268031874,"speed":89.46440552073801,"cost_axis":57.613028453424214},{"key":"omnijev_4b","name":"OmniJev 4B (tinnel123)","last_measured_on":"2026-10-06T18:39:58.957603+00:00","source_url":"https://huggingface.co/tinnel123/OmniJev-4B","ranked":true,"not_ranked_because":null,"capability":47.21130615991377,"composite":14.8307243060187,"intelligence":28.04039817183182,"calibration":66.38221414799571,"speed":86.3730168379761,"cost_axis":49.33242544148521},{"key":"reflex_4b","name":"Reflex 4B (released stable configuration)","last_measured_on":"2026-10-06T18:39:58.965603+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":53.3437274880298,"composite":13.799726124914287,"intelligence":27.366047086971744,"calibration":79.32140788908785,"speed":85.66904473002427,"cost_axis":48.431673793278605},{"key":"cua_s1_4b","name":"CUA-S1 4B","last_measured_on":"2026-10-07T11:18:42.850734+00:00","source_url":"https://huggingface.co/cua-ai/cua-s1-4b-0.2","ranked":true,"not_ranked_because":null,"capability":49.43698587469592,"composite":12.796578434475126,"intelligence":30.11468419283286,"calibration":68.75928755655897,"speed":81.85296392037813,"cost_axis":42.8552863838826},{"key":"gpt6_luna","name":"GPT-6 Luna (low reasoning effort)","last_measured_on":"2026-10-07T13:59:33.421607+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":74.43906644902145,"composite":12.18906568701566,"intelligence":72.40263081515377,"calibration":76.47550208288915,"speed":64.61837709100361,"cost_axis":25.03948935173132},{"key":"bonsai_2_27b_pq2_0","name":"Bonsai-2-27B v2 PQ2_0 + Q8_0 MMProj","last_measured_on":"2026-10-06T18:39:58.933603+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":63.06990316191141,"composite":11.982904102811153,"intelligence":43.22728934119354,"calibration":82.91251698262928,"speed":72.87086486680872,"cost_axis":28.92365661577752},{"key":"visual_jev_generic_baseline","name":"Visual-Jev generic (zero-shot Qwen3.5-4B baseline)","last_measured_on":"2026-10-06T18:39:58.969603+00:00","source_url":"https://huggingface.co/Qwen/Qwen3.5-4B","ranked":true,"not_ranked_because":null,"capability":56.73044357386753,"composite":11.136398700020102,"intelligence":29.70091291645334,"calibration":83.75997423128172,"speed":80.55162789488776,"cost_axis":40.40648841515147},{"key":"decider_2b_vision","name":"Mapika decider-2b-vision BF16","last_measured_on":"2026-10-06T18:39:58.937603+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":42.83879475696605,"composite":9.520408217700803,"intelligence":23.076242464750585,"calibration":62.60134704918151,"speed":85.76369298392828,"cost_axis":53.97969108217693},{"key":"vjev_vision","name":"vjev-vision (yah01)","last_measured_on":"2026-10-06T18:39:58.969603+00:00","source_url":"https://huggingface.co/yah01/vjev-vision","ranked":true,"not_ranked_because":null,"capability":55.6637460753182,"composite":8.857240570004542,"intelligence":21.727540295030423,"calibration":89.59995185560598,"speed":89.73268441088186,"cost_axis":58.99829391726849},{"key":"visual_jev_4b","name":"Visual-Jev 4B Answer-SFT","last_measured_on":"2026-10-06T18:39:58.969603+00:00","source_url":"https://huggingface.co/guanxuyu/visual-jev-4b-answer-sft","ranked":true,"not_ranked_because":null,"capability":35.886804011982974,"composite":8.70679301463658,"intelligence":24.03076709962469,"calibration":47.742840924341266,"speed":84.2024397009894,"cost_axis":47.43615671943154},{"key":"gpt56_luna","name":"GPT-5.6 Luna","last_measured_on":"2026-10-07T13:59:33.421607+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":76.82287976720755,"composite":7.8700106047940235,"intelligence":75.99290756972928,"calibration":77.65285196468584,"speed":66.62173639547285,"cost_axis":20.90824911981497},{"key":"jevify_gemma4_e4b","name":"Jevify Gemma 4 E4B","last_measured_on":"2026-10-06T18:39:58.953603+00:00","source_url":"https://huggingface.co/kushalpatil/jevify-gemma4-e4b","ranked":true,"not_ranked_because":null,"capability":43.713650577306296,"composite":7.261253970826696,"intelligence":20.43584011772628,"calibration":66.99146103688632,"speed":89.84164501747028,"cost_axis":58.7173304498756},{"key":"jpt_0p8b","name":"JPT-0.8B (kirp / llm2jev)","last_measured_on":"2026-10-06T18:39:58.953603+00:00","source_url":"https://huggingface.co/kirp/jpt-0.8b","ranked":true,"not_ranked_because":null,"capability":46.06841944686127,"composite":7.170924974951632,"intelligence":20.41845159094295,"calibration":71.71838730277959,"speed":87.14430904497962,"cost_axis":53.67957093714323},{"key":"glance_qwen3vl_4b","name":"Glance (frozen Qwen3-VL-4B)","last_measured_on":"2026-10-06T18:39:58.945603+00:00","source_url":"https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct","ranked":true,"not_ranked_because":null,"capability":28.425742632321374,"composite":6.853978531035631,"intelligence":21.25583421230571,"calibration":35.59565105233703,"speed":87.77222414785882,"cost_axis":52.80175097908753},{"key":"gemini31_flash_lite","name":"Gemini 3.1 Flash Lite","last_measured_on":"2026-10-07T13:59:33.417607+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":46.83292512835939,"composite":6.451693013167622,"intelligence":45.70040018328592,"calibration":47.96545007343287,"speed":74.43779274454106,"cost_axis":22.120029027729558},{"key":"djev_v10_step160_snowicarus","name":"diffusiongemma-26b djev v10 step160 (snowicarus)","last_measured_on":"2026-10-06T18:39:58.941603+00:00","source_url":"https://huggingface.co/snowicarus/diffusiongemma-26b-djev-v10-step160","ranked":true,"not_ranked_because":null,"capability":36.739849835996296,"composite":5.9026850777165105,"intelligence":23.22502350314927,"calibration":50.25467616884332,"speed":82.89544471799634,"cost_axis":41.20305481346977},{"key":"imajev_2b","name":"imajev 2B","last_measured_on":"2026-10-06T18:39:58.945603+00:00","source_url":"https://huggingface.co/mohit67890/imajev-2b","ranked":true,"not_ranked_because":null,"capability":46.418680728822835,"composite":5.758835431107005,"intelligence":19.524066977164175,"calibration":73.3132944804815,"speed":85.15111971164411,"cost_axis":47.962645986387905},{"key":"gevva_e4b","name":"Gevva E4B (text checkpoint, image input)","last_measured_on":"2026-10-06T18:39:58.945603+00:00","source_url":"https://huggingface.co/davidburhans/gevva-e4b","ranked":true,"not_ranked_because":null,"capability":49.575466619378105,"composite":4.139103044869637,"intelligence":17.37759565171394,"calibration":81.77333758704228,"speed":84.12177372223184,"cost_axis":46.957286624011395},{"key":"djev_distill_v4","name":"djev-distill-v4 (tarsur385)","last_measured_on":"2026-10-06T18:39:58.941603+00:00","source_url":"https://huggingface.co/tarsur385/djev-distill-v4","ranked":true,"not_ranked_because":null,"capability":40.246912432589575,"composite":3.61559312390983,"intelligence":18.818076867416764,"calibration":61.675747997762386,"speed":82.87744270788728,"cost_axis":41.07668748706446},{"key":"jevify_qwen3vl_2b_t2","name":"Jevify Qwen3-VL-2B T2","last_measured_on":"2026-10-06T18:39:58.953603+00:00","source_url":"https://huggingface.co/Praveenrajus/jevify-qwen3-vl-2b-t2","ranked":true,"not_ranked_because":null,"capability":43.932256205984224,"composite":3.287126199862389,"intelligence":15.05698032033634,"calibration":72.80753209163211,"speed":86.95864458594147,"cost_axis":53.46779880281604},{"key":"omnijev_2b","name":"OmniJev 2B (tinnel123)","last_measured_on":"2026-10-06T18:39:58.957603+00:00","source_url":"https://huggingface.co/tinnel123/OmniJev-2B","ranked":true,"not_ranked_because":null,"capability":37.93117973571243,"composite":3.167630441514959,"intelligence":14.999978327920326,"calibration":60.862381143504535,"speed":87.56651842791668,"cost_axis":52.268097388028984},{"key":"jev_spatial","name":"jev-spatial (Fr0zencr4nE)","last_measured_on":"2026-10-07T11:18:42.886733+00:00","source_url":"https://huggingface.co/Fr0zencr4nE/jev-spatial","ranked":true,"not_ranked_because":null,"capability":27.462821628839542,"composite":2.5153273922594006,"intelligence":13.970476290246939,"calibration":40.95516696743215,"speed":89.7496926776156,"cost_axis":58.78283535746186},{"key":"gevva_e2b_multimodal","name":"Gevva E2B multimodal","last_measured_on":"2026-10-06T18:39:58.941603+00:00","source_url":"https://huggingface.co/davidburhans/gevva-e2b-multimodal","ranked":true,"not_ranked_because":null,"capability":47.33674902529331,"composite":2.0187562401669568,"intelligence":12.750615487062742,"calibration":81.92288256352387,"speed":85.05216186736818,"cost_axis":48.825702127591235},{"key":"jevision","name":"JEVision (divyanshx11, visual route)","last_measured_on":"2026-10-06T18:39:58.953603+00:00","source_url":"https://huggingface.co/Qwen/Qwen3.5-0.8B-Base","ranked":true,"not_ranked_because":null,"capability":16.201178647308954,"composite":1.844492180671806,"intelligence":15.011090797345004,"calibration":17.391266497272902,"speed":83.81679119971204,"cost_axis":44.99261341634595},{"key":"omnijev_0p8b","name":"OmniJev 0.8B (tinnel123)","last_measured_on":"2026-10-06T18:39:58.957603+00:00","source_url":"https://huggingface.co/tinnel123/OmniJev-0.8B","ranked":true,"not_ranked_because":null,"capability":38.582913031486044,"composite":1.5713824347867986,"intelligence":11.413025786767259,"calibration":65.75280027620482,"speed":88.35256384063848,"cost_axis":54.10256606524743},{"key":"playjev_0p8b","name":"PlayJev 0.8B","last_measured_on":"2026-10-06T18:39:58.961603+00:00","source_url":"https://huggingface.co/OmniJev/PlayJev-0.8B","ranked":true,"not_ranked_because":null,"capability":25.59835078541178,"composite":0.5024413404980145,"intelligence":7.609177745374826,"calibration":43.587523825448734,"speed":87.25352730448708,"cost_axis":53.893916125154796},{"key":"djev_dev_bf16","name":"djev-dev BF16","last_measured_on":"2026-10-06T18:39:58.937603+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":25.406742112125414,"composite":0.039394970602823154,"intelligence":3.939860244277072,"calibration":46.87362397997376,"speed":83.0537433559073,"cost_axis":35.369123115589105},{"key":"qevi_2b","name":"Qevi-2B (MeerDevelopment)","last_measured_on":"2026-10-06T18:39:58.961603+00:00","source_url":"https://huggingface.co/MeerDevelopment/Qevi-2B","ranked":true,"not_ranked_because":null,"capability":11.149289293675002,"composite":0.025179372535196823,"intelligence":2.676661063180926,"calibration":19.621917524169078,"speed":86.36089922363703,"cost_axis":52.301412899270986},{"key":"djev_spark_nvfp4","name":"djev-spark NVFP4","last_measured_on":"2026-10-06T18:39:58.941603+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":24.523319528108974,"composite":0.0027345818593487985,"intelligence":1.5159349936682165,"calibration":47.53070406254973,"speed":83.69775856317538,"cost_axis":36.587632301649045},{"key":"openjev_4b_nli","name":"OpenJev 4B NLI v2 (official image-premise path)","last_measured_on":"2026-10-06T18:39:58.961603+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":8.204410259367913,"composite":0,"intelligence":16.408820518735826,"calibration":0,"speed":75.08625427634703,"cost_axis":33.91769526690582},{"key":"openjev_4b_v5","name":"OpenJev 4B NLI v5","last_measured_on":"2026-10-06T18:39:58.961603+00:00","source_url":"https://huggingface.co/AlexWortega/openjev","ranked":true,"not_ranked_because":null,"capability":16.408079687440843,"composite":0,"intelligence":32.816159374881686,"calibration":0,"speed":75.10978006580767,"cost_axis":33.95403743915943},{"key":"gemini38_flash","name":"Gemini 3.8 Flash","last_measured_on":"2026-10-07T13:59:33.421607+00:00","source_url":null,"ranked":true,"not_ranked_because":null,"capability":19.341650013892455,"composite":0,"intelligence":7.608110001633342,"calibration":31.075190026151564,"speed":63.61844062141785,"cost_axis":0},{"key":"standard_one_3b","name":"Standard One 3B","last_measured_on":"2026-10-06T18:39:58.965603+00:00","source_url":"https://huggingface.co/StandardThinking/StandardOne-3B","ranked":false,"not_ranked_because":"measured-unrankable: CORE cost unavailable (runtime returns no GPU-seconds), so no composite","capability":49.553367311282734,"composite":null,"intelligence":13.499357091122167,"calibration":85.6073775314433,"speed":84.9697316818905,"cost_axis":null},{"key":"standard_one_8b","name":"Standard One 8B","last_measured_on":"2026-10-06T18:39:58.969603+00:00","source_url":"https://huggingface.co/StandardThinking/StandardOne-8B","ranked":false,"not_ranked_because":"measured-unrankable: CORE cost unavailable (runtime returns no GPU-seconds), so no composite","capability":51.5492301988327,"composite":null,"intelligence":27.660471135089765,"calibration":75.43798926257564,"speed":83.34411826174517,"cost_axis":null}]}