{"schema_version":1,"total":1,"offset":0,"limit":100,"observations":[{"id":"public:e9310c98e8539537e17fda42","benchmark_id":"vals-index::2","subject":{"source_id":"thinkingmachines/inkling-small","name":"thinkingmachines/inkling-small","model_id":"inkling-small::default","variant":null,"harness":null},"value":31.862,"unit":"percent","basis":"measured","source":{"url":"https://www.vals.ai/benchmarks/vals_index","retrieved_at":"2026-09-26T04:22:13.903077+00:00","published_at":null,"file":"data/raw/benchmarks/daily-evidence/2026-09-26-vals-simplebench/capture/b99902ee631d2073658f.gz","sha256":"b99902ee631d2073658f65a28eec15013cf11be39f753d97d3d492f103bbfd5f","locator":"astro_props; source row 52; thinkingmachines/inkling-small; field accuracy"},"protocol":"Vals Index v2 (source metadata.version \"2\"; Vals re-dates the page when it adds models, so the page date is carried by each row's own capture, not by this identity), component overall; accuracy in percent, higher is better; each row is one model slug with its published compute/reasoning effort.; source row: {\"task\":\"overall\",\"accuracy\":31.862,\"stderr\":1.103,\"cost_per_test\":0.281249,\"latency\":1372.678,\"compute_effort\":null,\"reasoning_effort\":\"0.99\",\"max_output_tokens\":262000,\"provider\":\"Thinkingmachines\"}","comparison_key":null,"join_note":"Reviewed identity map 2026-09-16: label names inkling-small without a setting; the catalog has exactly one configuration, the default (inkling-small::default)"}],"divergences":[],"cell":null,"coverage":{"model":null,"benchmark":{"total_models":924,"available":38,"unknown":886,"not_tested":0,"not_published":0,"source_unreachable":0,"contested":0,"measured":38,"self_reported":0,"observations":65,"unmatched_observations":27}},"collection":{"benchmark_id":"vals-index::2","status":"collected","source_url":"https://www.vals.ai/benchmarks/vals_index","source_urls":["https://www.vals.ai/benchmarks/vals_index"],"reason":"65 source results parsed from 1 source(s); configurations remain separate; unmatched model identities are retained."},"coverage_note":"Denominators are catalog model configurations × versioned registry entries; capability_available excludes Efficiency (cost) boards. Basis counts count covered cells, not runs; measured and self_reported may overlap. Unmatched source identities remain in observations and never inflate catalog coverage."}