JevBench v1.3.0 · one system

Bespoke Nimble 9B (Bespoke Labs)

Bespoke Labs · Apache-2.0 (weights); repository without a licence file as of 19 Sep · open (code and weights) · jev-rebuild

JevBench v1.3.0 score

60.5

Rank #24 of 48 ranked systems.

13.9 points behind Jev 1.13.0's 74.4.

Axes

Intelligence
77.9
Calibration
65.3
Speed
78.7
Cost
33.4

Cost

$0.166 per 1,000 decisions (estimated).

github.com/bespokelabsai/nimble

See every JevBench v1.3.0 system, method and scoring on the full leaderboard.