{
  "id": 20794440,
  "title": "Pilotfish: Redesigning Browser Agents",
  "url": "https://urgent.news/2026/11/19/pilotfish-redesigning-browser-agents",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-11-19T19:58:50.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/nitin_59f9bb54f7686214ae6/pilotfish-redesigning-browser-agents-2ngc"
  },
  "original_language": "en",
  "account": "An invoice appears before a network becomes idle. The displayed page's Document Object Model (DOM) no longer experiences changes. The account balance is listed as $8,400, situated beneath a banner labeled \"Refreshing balances.\" The optimal approach is not to expedite that number; instead, it involves minimizing repeated page content and modeling round trips without losing track of the agent's knowledge. The fundamental principle is that a diff must initiate from the page the caller originally received, rather than merely the page captured by the browser. This perspective is an excerpt from a technical guide authored by a Pilotfish team member, employing a hypothetical receivables portal. The customer, invoice, and amounts are representative. The core components include maintaining row integrity, diffing against the page the model received, executing failure and recovery procedures, minimizing unnecessary typing, and testing specific scenarios. The published results demonstrate the effectiveness of these strategies. The guide emphasizes connecting to a browser for visual demonstration. The source notes provide additional context about the plain-row path, which preserves cell order and reference action. The row serializer ensures cells are delineated, avoiding indiscriminate flattening of tables. A compact view may omit certain controls, necessitating the availability of a fuller read. The diff against the page the model received is crucial, as typing a customer name only modifies a field and suggests a few options. Resending the unchanged invoice table is inefficient. The diff helps, only if the model can apply it, starting from a full observation that reached the caller. The base must be a complete observation, not the server's latest capture. Failure and recovery involve delivering a full observation as the base on delivery. If a response is withheld, a subsequent observation must be full again. A diff also requires page order; swapping invoices should not appear as an unchanged list. When the document changes, the base becomes outdated, or the diff becomes too large or ambiguous, a full observation must be sent. Resynchronization is integral to the design. The failure and recovery process is tested using Node's built-in assertions. The model is a simplified representation of Pilotfish's implementation, focusing on a small protocol model rather than an exhaustive integration test. Each balance represents a full page, and delivery is synchronous, requiring handling of dropped responses, acknowledgements, and resets.",
  "summary": "An agent opens an invoice. The network is quiet. The DOM has stopped changing. The balance says $8,400 , under a banner that reads \"Refreshing balances\" . The wrong optimization is to return that number faster. The useful one is to cut repeated page text and model round trips without losing track of what the agent knows . The rule that makes the rest work: a diff must start from the page the…",
  "key_points": [
    "Pilotfish redesigns browser agents with diff-based approach",
    "Maintains row integrity and minimizes page content repetition",
    "Emphasizes full observation base for efficient diff execution"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}