{
  "id": 5684656,
  "title": "How We Doubled Our Cache Hit Rate When Pre-Warming Wasn’t Enough",
  "url": "https://urgent.news/2026/09/05/how-we-doubled-our-cache-hit-rate-when-pre-warming-wasnt-enough",
  "topic": "ai",
  "section": "AI",
  "published": "2026-09-05T01:27:00.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/programmerraja/how-we-doubled-our-cache-hit-rate-when-pre-warming-wasnt-enough-2cab"
  },
  "original_language": "en",
  "account": null,
  "summary": "The article discusses the challenges faced by a company running voice agents, specifically how their cache hit rate on turn 1 was lower than expected, despite pre-warming before every call. The key insight is that the cache hit rate was not optimized across calls but only within a single call, due to three rules that had to be met for caching to be effective. These rules include exact prefix matching, the prefix being long enough, and landing on the same machine for caching to be reused. The author found that their caching optimization was focused on one call at a time, rather than across calls, which led to a lower overall cache hit rate of around 40%.",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}