TDE general large v0.1 (tdelab, ModernBERT-large encoder)
Data: JevBench v1.6.40, published 2026-10-22
Capability 30.9 · Not ranked in the current release
unpriced: answerdotai/ModernBERT-large is in the frozen module's UNLISTED_BASE_MODELS (no eligible base-model price); one listing decision would make the row rankable.
Last measured: 2026-10-16 · measurement release: v1.6.26
Apache-2.0
intelligence
5.6
calibration
56.1
speed
93.9
cost
—
Composite (secondary)
— · Not ranked on this board
Cost and measurement conditions
not published (not published)
UNPRICED. The frozen pricing_v15 module (sha256 3948e3f1..., and the later re-freezes, which only add or re-price hosted-API launch-list keys) has no market-listing decision for the declared base answerdotai/ModernBERT-large (the module lists it in UNLISTED_BASE_MODELS; the card declares no base_model); no price is invented here. Axes only: Intelligence, Calibration and Speed are computed; Cost, composite and rank are void. Tokens: the server reports no token field, so input is counted OFFLINE with the model's own tokenizer on the pod (the counter of the earlier measurement, 672,464 over the full draw, including the 1,024-token truncation) and output is 0 under the 9 Oct 2026 rule (encoder classifier, nothing generated).
Measured p50 latency: 0.021 s (on-GPU, no network, loopback; not directly comparable with API latency, which we time end to end from our measuring host, network included)
Ranking and cap use: 0.19 s (est. incl. network (2x + 150 ms))
Self-hosted model: measured p50 0.021 s on-GPU, no network (timed on our GPU over loopback). Not directly comparable with API latency, which we time end to end from our measuring host, network included. The ranking and latency cap use the same estimate for every self-hosted row: 2 × measured + 150 ms = 0.19 s. Model authors can ask us to time a hosted endpoint instead (on request).
x2 + 0.15 s (assumption, not measured)
Evaluator-owned rented Lium GPU pod (measurement receipts on file), 1x NVIDIA H100 80 GB HBM3 (sm_90, driver 580.178.04, United States node, pre-registration Amendments 1-2) - the card most of these systems were first evaluated on, but a different pod, stack and pin set from the earlier runs, so Speed is as measured on this card and probabilities may differ from the earlier runs in the last digits. Python packaging: uv venv from a hashed lock at the old pins, dependencies resolved as of the old build time where the old freeze is lost (declared deviation, UNVERIFIED where noted). Isolation: author server started inside a network namespace with loopback only, the cut proven before and after the sealed input was staged, synthetic smoke gate passed in between; runner unchanged (run_v15.py --resume --resume-keep-failures); one use of input-selfhosted-1500 (custody #20324, under the pre-registration). Published Speed uses the standing x2 + 0.15 s self-hosted adjustment. Author's tde-serve, one forward pass.