SOURCE-LINKED INTELLIGENCE

A Statistical Audit of Physical AI Benchmark Redundancy

arXiv · AI, language, vision and robotics · article · Aug 26, 2026 · UTC

Physical AI models are evaluated on suites of benchmarks that differ across model reports, leaving the model-by-benchmark matrix sparse and the relationship between benchmarks unmeasured. We construct a matrix of 51 models on 12 physical AI benchmarks, selected from a registry of 51 benchmarks and 152 models by reporting density, combining scores from model cards and benchmark papers with our own evaluation runs under each benchmark's official protocol. We measure how much information the benchmarks share and show quantitative evidence of Redundancy. Redundancy affects reported rankings: colla

Read original source ↗ Open in workspace

recordType

paper

region

Global