Urgent.News

What's breaking now, across hundreds of outlets.

AI

CoPre-MoE: Consolidating and Preserving MoE for Multimodal Continual Instruction Tuning

Multimodal continual instruction tuning requires multimodal large language models to sequentially acquire new capabilities without catastrophic forgetting. Mixture-of-experts (MoE) architectures offer a promising way to mitigate task interference through expert specialization and combination. However, while existing MoE-based methods avoid overwriting shared parameters by allocating separate…

We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.

Source: arxiv.org

Read the original at arxiv.org →

Report a problem with this story

More in AI

More from Friday 13 November →