CaliBench: Are the Stochastic Dynamics of Video World Models Physically Calibrated?
Video world models approximate the stochastic distribution of physical outcomes through generative sampling, but existing benchmarks score individual generations or compare distributions coarsely over a whole dataset, leaving the fine-grained aleatoric uncertainty of specific phenomena untested. We introduce CaliBench, which scores outcomes in a physically interpretable discrete space - a bin…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.