{
  "id": 20108301,
  "title": "Why Traditional Web Scraping Fails at Physical Reality (And How to Build a Constraint-Based Schema)",
  "url": "https://urgent.news/2026/11/15/why-traditional-web-scraping-fails-at-physical-reality-and-how-to",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-11-15T03:45:46.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/gochinatripapp/why-traditional-web-scraping-fails-at-physical-reality-and-how-to-build-a-constraint-based-schema-4n2p"
  },
  "original_language": "en",
  "account": "Traditional web scraping is geared towards extracting text, not capturing the real-world conditions necessary for an instruction to work. An AI can perfectly extract and parse information from a webpage, but the instruction might still be physically impossible to execute. For instance, asking an AI to show a driver a phone screen while they are stuck in heavy traffic with suitcases is not just an LLM hallucination problem—it's a fundamental data-modeling failure. Most travel guides and the models trained on them focus on idealized digital workflows, ignoring the physical constraints that are crucial in real-world scenarios. When you ask ChatGPT how to handle luggage with a DiDi service in China, it confidently suggests booking a standard Express car. However, a 28-inch suitcase simply won't fit in an Express trunk, and the driver would cancel the booking. To address this, researchers developed the Survival Semantic Action Protocol (SSAP), an open-source approach that aims to account for physical constraints. The core problem with traditional schemas is the loss of physical context. A simplistic schema like {action: \"Book a DiDi\", payment: \"Link Alipay\"} lacks the necessary constraints. SSAP tackles this issue by extending the Schema.org HowTo format with custom namespaces that define physical boundaries. A real action card in SSAP might look like this:\n\n{\n@context: {\nschema: \"https://schema.org/\",\nssap: \"https://gochinatrip.app/ns/ssap/v1#\"\n},\n@type: \"schema:HowTo\",\nname: \"Check DiDi vehicle capacity before booking\",\nstep: [\n{\n@type: \"schema:HowToStep\",\nposition: 1,\ntext: \"Record the number of passengers and the number and size of suitcases.\"\n},\n{\n@type: \"schema:HowToStep\",\nposition: 2,\ntext: \"If you have 2+ large 28-inch suitcases, you MUST book DiDi Premier or a 7-seater.\"\n]\n},\nssap:physicalConstraints: [\n\"Vehicle configuration affects usable luggage space.\",\n\"A seven-seat label does not guarantee sufficient luggage capacity.\"\n],\nssap:communicationChannel: [\n\"Do not answer the phone. Use the DiDi in-app typed chat.\"\n],\nssap:evidenceGrade: \"Operationally tested with documented scope\",\nssap:lastReviewed: \"2026-11-15\"\n}\n\nBy integrating physical constraints directly into the schema, AI retrieval systems can match a user's intent (e.g., having three suitcases) with the actual physical reality (e.g., Express cars cannot fit that size). The SSAP Solution seeks to make physical feasibility a first-class property of machine-readable knowledge, ensuring that AI agents interacting with the real world account for these constraints. The researchers are open-sourcing this protocol, inviting developers to participate in testing and improving the schema. The GitHub repository, governance document, and live implementation are all available for reference and collaboration.",
  "summary": "Traditional web scraping is optimized for extracting text, not preserving the conditions under which an instruction can actually be executed. A page can tell an AI agent to \"show the driver your phone screen.\" The text extracts perfectly, the JSON parses cleanly. But the instruction is physically impossible—the driver is navigating traffic, and you are standing on a curb with three suitcases.…",
  "key_points": [
    "Traditional web scraping focuses on text extraction, not physical reality.",
    "AI can extract information but fails when physical constraints are crucial.",
    "SSAP (Survival Semantic Action Protocol) addresses physical constraints in AI schemas."
  ],
  "editors_take": "Integrating physical constraints into machine-readable schemas moves AI from mere text extraction toward operational reliability by ensuring digital instructions align with the actual limitations of the real world.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}