Metask rain 4B
Data: JevBench v1.6.39, published 2026-10-22
Capability 66.0 · rank #34 of 139 on the open-weights board
Last measured: 2026-10-09 · measurement release: v1.6.2
Licence not stated
intelligence
51.1
calibration
80.9
speed
79.6
cost
51.8
Composite (secondary)
62.7 · Composite rank #30
Cost and measurement conditions
$0.040 per 1,000 decisions (estimated)
Self-hosted open weights, no bookable tariff. v1.5-M2 base-model reference: the model card names base_model Qwen/Qwen3.5-4B. Per the frozen v1.5 precedent (METHOD-v1.5-ADDENDUM-PRICING-INTERPRETATION-1.md I-2/I-3), Qwen3.5-4B rows use DeepInfra Qwen/Qwen3.5-4B at USD 0.03/M input and USD 0.15/M output (frozen 25 Sep 2026 price cut-off snapshot; listing later deprecated, frozen reference retained per I-3). Read from the official method files on 2026-10-08; no fresh provider page was fetched. Output tokens priced at the reference output rate. Estimate, not a bookable tariff.
Measured p50 latency: 0.058 s (on-GPU, no network, loopback; not directly comparable with API latency, which we time end to end from our measuring host, network included)
Ranking and cap use: 0.27 s (est. incl. network (2x + 150 ms))
Self-hosted model: measured p50 0.058 s on-GPU, no network (timed on our GPU over loopback). Not directly comparable with API latency, which we time end to end from our measuring host, network included. The ranking and latency cap use the same estimate for every self-hosted row: 2 × measured + 150 ms = 0.27 s. Model authors can ask us to time a hosted endpoint instead (on request).
x2 + 0.15 s (assumption, not measured)
Setup not stated