A Statistical Audit of Physical AI Benchmark Redundancy
Physical AI models are evaluated on suites of benchmarks that differ across model reports, leaving the model-by-benchmark matrix sparse and the relationship between benchmarks unmeasured. We construct a matrix of 51 models on 12 physical AI benchmarks, selected from a registry of 51 benchmarks and 152 models by reporting density, combining scores from model cards and benchmark papers with our own…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
