Reflex Instinct 0.6B (Atlas AI)v1.6 · re-measure pending

Data: JevBench v1.8.15, published 2026-11-17 · re-measure pending under the 10 s rule (v1.6 values)

Capability 38.6 · Not ranked in the current release

Re-measure pending under the 10 s rule: this row's per-decision times were recorded on a loaded CPU host, so they cannot be scored under the time limit. Shown with its v1.6 values until it is measured again.

Last measured: 2026-10-13 · measurement release: v1.6.15

Apache-2.0 (model card; base Qwen/Qwen3-0.6B Apache-2.0)

Base model: Qwen/Qwen3-0.6Bsource

intelligence

4.0

calibration

73.2

speed

59.0

cost

86.4

Composite (secondary)

0.1 · Not ranked on this board

Cost and measurement conditions

$0.0028 per 1,000 decisions (estimated)

GPU-time estimate from v1.8.0: one monthly-rented RTX PRO 6000 96 GB, EUR 999/month / 730 hours, ECB USD 1.1133/EUR dated 28 Oct 2026, USD 1.5235/hour; average load 70%. Architecture: small qwen, 0.6B active parameters; throughput 100000 tokens/s (architecture-class calibration, 29 Oct 2026, efficient-engine prefill; capped at 100,000 tokens/s). The row's own scored cost basis: 699,758 input + 0 output tokens over 1,485 decisions = 471.217508418 tokens/decision. GPU-time cost USD 0.00284880902410347/1,000; old list-price cost USD 0.00471217508417508/1,000; applied min(old list-price cost, GPU-time cost) = USD 0.00284880902410347/1,000. The GPU-time estimate is lower. Estimated, not a bill. Intelligence, Calibration, measured latency and the common cost-item membership are unchanged. Prior prices remain in the archived v1.7 releases.

Measured p50 latency: 1.872 s (on-CPU, no network, loopback; not directly comparable with API latency, which we time end to end from our measuring host, network included)

Ranking and cap use: 3.89 s (est. incl. network (2x + 150 ms))

Self-hosted model: measured p50 1.872 s on-CPU, no network (timed on our CPU host over loopback). Not directly comparable with API latency, which we time end to end from our measuring host, network included. The ranking and latency cap use the same estimate for every self-hosted row: 2 × measured + 150 ms = 3.89 s. Model authors can ask us to time a hosted endpoint instead (on request).

x2 + 0.15 s (assumption, not measured)

Sandy, the evaluator's own shared CPU host (AMD Ryzen 5 3600, 6 cores / 12 threads, Zen 2, AVX2), NOT a dedicated machine: other jobs ran beside it and the 1-minute load average was logged every 60 s into logs/CONDITIONS-<key>.jsonl. The author's own serve.py, shipped in their weights repo, run with their own documented line `python serve.py --port 11472 --device cpu --repo <the pinned local snapshot directory>` inside a loopback-only network namespace with an outbound probe that failed as required, no credentials in the environment, offline (HF_HUB_OFFLINE=1). float32 on CPU, which is their own code's choice for CPU and the right one on Zen 2 (AVX2 only, where bf16 is about 5x slower). Their serve.py sets no torch thread count, so their own default is every core of the host; this run bounded it to 6 of Sandy's 12 (OMP_NUM_THREADS=6) to stay polite to the other jobs on the box - OUR cap, not theirs, and an unbounded host would use all 12. Peak RSS about 7.6 GB, so the row ran in a 14 GiB systemd scope rather than the initial 4 GiB allocation. Speed is therefore a loaded-shared-CPU figure and a lower bound for this model on a dedicated core or a GPU; the standard self-hosted x2 + 0.15 s adjustment is applied on top and the raw p50/p95 are kept. Re-measured for this release on the frozen v1.6-regular-20261012 self-hosted input (sha256 dfd36720077ef7c41ace367524896507c7f44ce71306fb3e659e8b85069d995b) under the pre-registration, at USD 0 on Sandy’s own CPU, 6 of 12 threads, starting 2026-10-13 06:14:53Z; the 1-minute load average is logged for the whole window and reported with the row. DISCLOSED: the author’s own encode() truncates whole state lines above its own max_len=16384 rather than refusing them, so this row answers the draw’s 15 items of 106,804–122,936 characters that four other rows of this draw recorded as context refusals (attest-31b-v1.0, julia-1, standard_one_3b_sh and uniphore-4b-decider; krino-2b, both MeTask rows and torchcast-decision-4b-v1.1 answered them) — the author’s design choice, not ours, and those items are the slowest in the row.

not yet re-scored under the 10 s rule.

JevBench v1.6.43 values (method v1.6, before the 10 s rule)

Re-measure pending under the 10 s rule: this row's per-decision times were recorded on a loaded CPU host, so they cannot be scored under the time limit. Shown with its v1.6 values until it is measured again.

Capability 38.56 · Composite 0.08

intelligence 3.96 · calibration 73.15 · speed 58.97 · cost 79.80

v1.6 speed basis (124 items): p50 1.872 s · p95 16.192 s

Published source