Urgent.News

What's breaking now, across thousands of outlets.

More in AI

LLM agent memory compared: whole chat, summary, sliding window, retrieval and host-held state on a 14B model

Six ways of remembering what an agent has done, measured on one 14B model over 600-step jobs: the whole chat, a generic summary, a summary that writes the state out, a sliding window, retrieval, and a…

  • Host-held state is cheapest and fastest method at 0.3034 seconds per step
  • Whole chat method limited to 16,000 tokens after 418 steps
  • Host-held state achieved 81.89% correct identification of model's reply

More from Wednesday 18 November →