Self-Improving AI Agents Chapter 4: Skill Library, Memory and 4 Layers

Researchers have proposed two methods to address the issue of AI models forgetting what they have learned: Skill Library and Memory. Skill Library allows AI to accumulate skills and reuse them, as seen in Voyager, which plays Minecraft and learns from its experiences, and SAGE, a more recent development from Amazon that uses Reinforcement Learning to manage skills.

Memory, on the other hand, enables AI to retain knowledge across tasks, as demonstrated by MemGPT, which uses a hierarchical memory system. These concepts are part of a broader framework of 4 Layers of Self-Evolution, which categorize self-improvement into four layers: Parameter, Capability, Memory, and System.