Functional Subnetwork Localization for Efficient Continual Learning in Large Language Models
Biological intelligence continually adapts to new information while retaining prior skills through localized plasticity. In contrast, continual learning in large language models (LLMs) remains vulnerable to catastrophic forgetting. A promising direction is to identify functionally specialized subnetworks within LLMs that enable targeted and resource-efficient adaptation. Using…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
