Hippocampal consolidation without replay in fully fine-tuned networks
Networks that keep learning overwrite what they know. Prevailing remedies replay stored data, distil from old models or freeze the backbone. The brain suggests a different division of labour: the hippocampus indexes where experience lies in cortex while the cortex keeps learning. We show that this division lets a fully trainable network keep learning without cross-task replay, a teacher or…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
