{
  "id": 20007045,
  "title": "Web search for agents is here: Why ranking still decides the answer",
  "url": "https://urgent.news/2026/11/14/web-search-for-agents-is-here-why-ranking-still-decides-the-answer",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-11-14T16:00:00.000Z",
  "source": {
    "name": "The New Stack",
    "slug": "the-new-stack",
    "url": "https://thenewstack.io/ai-agent-search-ranking/"
  },
  "original_language": "en",
  "account": "AI agents have struggled with finding current information for a while. When they need up-to-date details but lack a search tool, they often assume the correct web address and end up with \"page not found\" errors. This guessing habit leads to outdated or incorrect information being used. To address this issue, Cloudflare introduced a beta Web Search API in its AI Gateway. This allows agents to access live search results from multiple providers through a single interface, complete with source links, logging, and access controls. However, even with live search, another important challenge remains: determining which of the fresh pages and internal documents the agent should rely on. The agent must prioritize this information based on relevance, quality, and authority. This decision-making process occurs in the retrieval layer, where two distinct pools of evidence are combined - the web and the company's internal data. Each of these pools has its own characteristics, such as freshness, quality, structure, and authority. For example, web results may be hours or days old, while internal data can be months out of date without anyone noticing. The agent must reconcile these differences and make ranking and filtering decisions based on company-specific data and business rules.",
  "summary": "AI agents have had a URL problem for a while. When an agent needs current information but has no search The post Web search for agents is here: Why ranking still decides the answer appeared first on The New Stack .",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}