{
  "id": 17348785,
  "title": "AI giants promise publishers new way to block some scraping",
  "url": "https://urgent.news/2026/10/31/ai-giants-promise-publishers-new-way-to-block-some-scraping",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-31T05:47:00.000Z",
  "source": {
    "name": "Channel News Asia",
    "slug": "channel-news-asia",
    "url": "https://www.channelnewsasia.com/world/ai-giants-promise-publishers-new-way-block-some-scraping-6509181"
  },
  "original_language": "en",
  "account": "San Francisco - Tech giants OpenAI, Google, Microsoft, and Anthropic have pledged to provide a single method for media outlets and websites to prevent their content from being scraped to train artificial intelligence models. Publishers currently need to implement multiple blocking commands for each web crawler, but the proposed standard will allow them to enter one unified instruction recognized by all AI companies adopting the protocol. The solution will not be fully implemented for several months, with Microsoft starting in February 2027, Google sometime in 2027, OpenAI in the coming months, and Anthropic already beginning roll-out. The announcement comes amid increased competition from bots that scrape articles to feed AI models, with some publishers like the New York Times taking legal action. Microsoft and Google stated opting out of AI training may reduce the likelihood of a publisher's content appearing in AI apps and experiences. Meta also expressed support for the effort.",
  "summary": "Publishers currently have to implement multiple blocking commands for every bot that crawls the web to collect data, but the new proposed solution will allow them to enter a single, standardised instruction that's recognised and honoured.",
  "key_points": [
    "OpenAI, Google, Microsoft, and Anthropic pledge unified scraping block method",
    "Publishers will enter single instruction recognized by all AI companies"
  ],
  "editors_take": "Standardizing blocking protocols simplifies content protection for media outlets while forcing a trade-off between securing intellectual property and maintaining visibility within the evolving artificial intelligence ecosystem.",
  "illustration": null,
  "coverage": {
    "outlets": 2,
    "also_reported_by": [
      {
        "outlet": "The Hindu - Sci-Tech",
        "title": "AI giants promise publishers new way to block some scraping",
        "url": "https://urgent.news/2026/10/31/ai-giants-promise-publishers-new-way-to-block-some-scraping-17370161",
        "published": "2026-10-31T08:17:27.000Z"
      }
    ]
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}