DreamX: Video Diffusion Model is a Universal Latent Action Learner
Learning a universal action representation from video requires modeling dynamics that are consistent across different executions of the same action yet invariant to changes in embodiment and appearance. Existing latent action models infer actions from visual transitions, but their representations often entangle the underlying action with irrelevant visual variations, limiting transfer across…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.