{
  "id": 5874204,
  "title": "133 of 10,099 Shopify stores block an AI crawler. Six block the one ChatGPT shops with.",
  "url": "https://urgent.news/2026/09/06/133-of-10-099-shopify-stores-block-an-ai-crawler-six-block-the-one",
  "topic": "ai",
  "section": "AI",
  "published": "2026-09-06T00:33:59.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/bpmcginley/133-of-10099-shopify-stores-block-an-ai-crawler-six-block-the-one-chatgpt-shops-with-13ec"
  },
  "original_language": "en",
  "account": "A study of 10,099 Shopify stores found that 133 of them block at least one AI crawler, amounting to 1.32% of the total. The majority of these blocks, 120, are aimed at training and grounding crawlers, which feed into AI shopping answers. Only 13 stores block crawlers that actually fetch data in response to user queries. Among the blocked crawlers, OpenAI's GPTBot is the most commonly blocked, followed by OAI-SearchBot, used for ChatGPT search and shopping results. Notably, 6 of the 8 stores that utilize the noai or noimageai meta robots tag on their product pages do not block any AI crawlers either. This suggests that the tag, while intended to opt out of training, does not necessarily extend to shopping crawlers, based on the study's findings.",
  "summary": "Merchants are told two opposite things about AI crawlers: block them, because they take your content and give nothing back; and admit them, because that is how a store gets into an AI shopping answer. Both assume a decision is being made. We wanted to know how many stores have made one, and which way. Method Every store in a corpus of 10,099 known Shopify storefronts has its /robots.txt read as…",
  "key_points": [
    "133 of 10,099 Shopify stores block AI crawlers, 1.32% of total",
    "OpenAI's GPTBot and OAI-SearchBot most commonly blocked crawlers",
    "6 stores with noai/noimageai tag don't block AI crawlers"
  ],
  "editors_take": "Blocking AI crawlers does not guarantee protection from AI training data collection, as the opt-out meta tag appears to have limited effect on shopping results.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}