{
  "id": 21043651,
  "title": "Why We Abandoned Linear Disk Scans: How 16-Byte Address Crystals Cut AI Agent Latency by 99%",
  "url": "https://urgent.news/2026/11/21/why-we-abandoned-linear-disk-scans-how-16-byte-address-crystals-cut",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-21T12:26:28.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/kotokvit/why-we-abandoned-linear-disk-scans-how-16-byte-address-crystals-cut-ai-agent-latency-by-99-209"
  },
  "original_language": "en",
  "account": "In 2016, ripgrep - a highly efficient search tool written in Rust - became the go-to solution for developers seeking to locate code snippets swiftly. However, ripgrep's design heavily relied on linear disk scans, which were suitable for human users but fell short when it came to AI agents working in automated environments. These AI agents execute a high number of search queries rapidly, triggering excessive disk I/O and causing significant latency. To address this issue, a new approach was introduced: the 16-Byte Address Crystals. By decoupling the search process into two phases, Initial FastCDC + BLAKE3 Content Ingestion and Sub-3ms Memory-Mapped Query, poler (github.com/Kotokvit/poler-cli) significantly enhanced search performance. The .t5a Address Crystal, mapped directly into L1–L3 CPU cache, enabled queries to be processed at lightning speed, resulting in a 22 to 115 times faster response time compared to traditional linear scans. This innovation not only reduced disk I/O and latency but also minimized LLM token consumption and prevented RAM spikes. Furthermore, poler's built-in file mutation capabilities ensured that agents could seamlessly read and patch files in a single, atomic operation, streamlining the entire workflow for these autonomous tools.",
  "summary": "Why We Abandoned Linear Disk Scans: How 16-Byte Address Crystals Cut AI Agent Latency by 99% Substack / Dev.to / Hacker News (Show HN) Technical Manifesto Author: Vitalij Kotok (Kotokvit) & POLER Engineering Core Repository: https://github.com/Kotokvit/poler-cli The 2016 Assumption vs The 2026 Reality In 2016, Andrew Gallant ( BurntSushi ) released ripgrep . It was an undeniable masterclass in…",
  "key_points": [
    "Linear disk scans inefficient for AI agents",
    "16-Byte Address Crystals decouple search process",
    "Poler achieves 22-115x faster search performance"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}