Bespoke Nimble 9B (Bespoke Labs)
Bespoke Labs · Apache-2.0 (weights); repository without a licence file as of 19 Sep · open (code and weights) · jev-rebuild
JevBench v1.3.0 score
60.5
Rank #24 of 48 ranked systems.
13.9 points behind Jev 1.13.0's 74.4.
Axes
- Intelligence
- 77.9
- Calibration
- 65.3
- Speed
- 78.7
- Cost
- 33.4
Cost
$0.166 per 1,000 decisions (estimated).
github.com/bespokelabsai/nimble
See every JevBench v1.3.0 system, method and scoring on the full leaderboard.