{"schema_version":1,"total":1,"offset":0,"limit":100,"observations":[{"id":"public:916dbc188e572c2cb9048bf8","benchmark_id":"vals-index-vibe-code-bench::2","subject":{"source_id":"grok/grok-4.3","name":"grok/grok-4.3","model_id":"grok-4.3::high","variant":null,"harness":null},"value":19.403,"unit":"percent","basis":"measured","source":{"url":"https://www.vals.ai/benchmarks/vals_index","retrieved_at":"2026-09-18T13:00:43.826192+00:00","published_at":null,"file":"data/raw/benchmarks/daily-evidence/2026-09-18T12-58-20-378Z/558f8306d2b1cf1a1874.gz","sha256":"558f8306d2b1cf1a1874ebee5c907d17b0776ccc1f9e70fbb764af4470bb7bbb","locator":"astro_props; source row 45; grok/grok-4.3; field accuracy"},"protocol":"Vals Index v2 (updated 2026-09-10), component vibe_code_bench; accuracy in percent, higher is better; each row is one model slug with its published compute/reasoning effort.; source row: {\"task\":\"vibe_code_bench\",\"accuracy\":19.403,\"stderr\":4.243,\"cost_per_test\":1.28472,\"latency\":589.407,\"compute_effort\":null,\"reasoning_effort\":\"high\",\"max_output_tokens\":null,\"provider\":\"SpaceXAI\"}","comparison_key":null,"join_note":"Reviewed identity map 2026-09-16: label states model grok-4.3 and setting high; exact catalog configuration grok-4.3::high"}],"divergences":[],"cell":null,"coverage":{"model":null,"benchmark":{"total_models":844,"available":32,"unknown":812,"not_tested":0,"not_published":0,"source_unreachable":0,"contested":0,"measured":32,"self_reported":0,"observations":58,"unmatched_observations":26}},"collection":{"benchmark_id":"vals-index-vibe-code-bench::2","status":"collected","source_url":"https://www.vals.ai/benchmarks/vals_index","reason":"58 source results parsed; configurations remain separate; unmatched model identities are retained."},"coverage_note":"Denominators are catalog model configurations × versioned registry entries; capability_available excludes Efficiency (cost) boards. Basis counts count covered cells, not runs; measured and self_reported may overlap. Unmatched source identities remain in observations and never inflate catalog coverage."}