{
  "id": 9785058,
  "title": "Before You Blame the Model, Check What Your Compactor Deleted",
  "url": "https://urgent.news/2026/09/25/before-you-blame-the-model-check-what-your-compactor-deleted",
  "topic": "ai",
  "section": "AI",
  "published": "2026-09-25T13:17:11.000Z",
  "source": {
    "name": "HackerNoon",
    "slug": "hackernoon",
    "url": "https://hackernoon.com/before-you-blame-the-model-check-what-your-compactor-deleted?source=rss"
  },
  "original_language": "en",
  "account": "Many AI production issues appear to be intelligence failures, such as asking for data users already provided or ignoring stated constraints. The default assumption is that the model hallucinated, but often the real issue is that the context fed to the model was compressed improperly. This article explains how to fix that failure mode using a lightweight probe harness.\n\nReadable summaries can still be operationally wrong. Production systems need to check if the exact state needed for the next decision survived compression. When state drops, downstream behavior can look irrational even if the model is behaving consistently with the compressed input.\n\nIn various domains, there are high-impact, low-frequency fields that prose-style compression tends to blur first. These include healthcare contraindications, finance approval thresholds, legal jurisdiction constraints, and supply chain cold-chain requirements.\n\nWhen investigating a failure, measure the token composition before touching prompts. If tool payloads make up a large portion of the context, compressing dialogue alone is a minor optimization. Clear spent tool payloads before compression to remove stale high-volume noise and reclaim tokens.\n\nCompact the state into a typed structure rather than a narrative summary. Use a TypedDict with fields like entities, constraints, commitments, decisions, open items, and risk flags. This makes missing fields visible, makes output machine-checkable, and makes reviews objective instead of impressionistic.\n\nAdd probe questions that are executable questions over the compacted state. For example, check if the scope is still limited to us-east-1, if the \"do-not-restart-database\" constraint is present, if the error rate threshold is preserved, and if the platform engineer is still the owner of the traffic-shift approval. If these probes fail, the regression is caught before a production decision is made.\n\nSeparate the CI pipeline into two lanes. The deterministic lane tests probe predicates and scoring against fixed state fixtures without any network calls or model dependencies. The compactor eval lane runs fixed transcripts through the real compactor and may call the model, running nightly or as a release-quality gate. This keeps developer feedback fast while still catching model/prompt drift.",
  "summary": "AI agents can look forgetful when context compaction drops critical state. Typed summaries and regression probes make that failure measurable.",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}