ENGRAM: From Agent Experience to Weights through Verified Consolidation
Language-model agents use experience through external retrieval and parameter learning. Consolidating stored experience into model weights requires deciding both which experience to train on and when its external records can leave retrieval. Admission based solely on student mastery can exclude useful teacher demonstrations, while removal immediately after training can discard guidance that the…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.