{
  "id": 20551062,
  "title": "LLM agent memory compared: whole chat, summary, sliding window, retrieval and host-held state on a 14B model",
  "url": "https://urgent.news/2026/11/18/llm-agent-memory-compared-whole-chat-summary-sliding-window-retrieval",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-18T05:43:36.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/shalendra_gaur_ecd0567a49/llm-agent-memory-compared-whole-chat-summary-sliding-window-retrieval-and-host-held-state-on-a-371i"
  },
  "original_language": "en",
  "account": "Six different methods of remembering an LLM agent's actions were tested on a 14B model. These methods are whole chat, summary, sliding window, retrieval, and a host-held state. The host-held state was the cheapest and fastest method, taking only 0.3034 seconds per step and 21.8 joules per step. The whole chat method stopped at 16,000 tokens after 418 steps in three jobs, while summaries and the sliding window took significantly longer to run. The host-held state correctly identified the model's own reply 81.89% of the time, while the other methods ranged from 84.00% to 93.83%. However, the model's own step was correct 21.63% of the time when deleting a service with edges. The host's check and repair completed any missing edges, ensuring the exact state was maintained on every step.",
  "summary": "Six ways of remembering what an agent has done, measured on one 14B model over 600-step jobs: the whole chat, a generic summary, a summary that writes the state out, a sliding window, retrieval, and a host-held state shown fresh each step. With the host's check in the loop, all six ended with the exact state on every step they ran. They differed in cost: 0.30 s and 21.8 joules a step for the…",
  "key_points": [
    "Host-held state is cheapest and fastest method at 0.3034 seconds per step",
    "Whole chat method limited to 16,000 tokens after 418 steps",
    "Host-held state achieved 81.89% correct identification of model's reply"
  ],
  "editors_take": "Prioritizing host-held state offers a significant speed and cost advantage for agent memory, even if it requires external repair mechanisms to maintain the same accuracy as more intensive methods.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}