What Should World Models Forget? Stratified Retention for Continual Adaptation
Continual learning treats degradation on previously seen data as evidence of failure, a convention inherited from settings with a stationary prediction target, where a correct label remains correct indefinitely. World models do not satisfy this condition. Their prediction target is the environment, which changes, so knowledge that was accurate when acquired may later become false, and discarding…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
