A Visual Dependence-Aware Framework for Multimodal Unsupervised Continual Post-Training
In this paper, we explore a novel task of Multimodal Unsupervised Continual Post-Training (MU-CPT), enabling deployed MLLMs to continually evolve from streaming unlabeled data. Existing unsupervised post-training methods for MLLMs typically optimize target tokens uniformly, overlooking their heterogeneous visual dependence (VD). However, we reveal that token-level VD is crucial for MU-CPT.…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
