ReWorld: An Interactive World Model with Long-Horizon Memory
An interactive world model must follow the user's actions, remember the places it has shown, and stream in real time. The tension is structural: control wants a short horizon, memory wants an unbounded one. ReWorld separates the two during training and bounds them at inference. Mixed per-head attention windows confine most heads to the recent past while a small set of global heads attends over…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
