Marionette: Predicting World States, Rendering Geometry, Painting Appearance
Interactive game world models typically autoregress visual observations directly in pixel or latent space, forcing structured properties such as pose, geometry, and occlusion to be implicitly maintained by the same generative sequence. Over long horizons, errors in these latent world properties accumulate, making consistency and controllability fragile. We explicitly model the evolving world…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.