{
  "id": 3254050,
  "title": "Half the Requests Wearing ChatGPT's Name Were Scanning Us for Secrets",
  "url": "https://urgent.news/2026/08/25/half-the-requests-wearing-chatgpts-name-were-scanning-us-for-secrets",
  "topic": "ai",
  "section": "AI",
  "published": "2026-08-25T11:53:00.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/izgorodin/half-of-chatgpts-requests-to-our-site-were-not-chatgpt-3hj2"
  },
  "original_language": "en",
  "account": "Cloudflare launched AI Crawl Control, allowing them to monitor AI agents visiting their website. In the initial 24-hour period, they observed 1,890 requests from AI agents, with 483 of those requests failing. This failure rate increased by 63 percent when compared to the previous day. Among the agents they were most interested in was ChatGPT-User, which was documented as user-initiated. It accounted for 859 requests, but only 412 of those returned a 200 status code, meaning roughly half of the requests with this name were failing. Initial investigation suggested a redirect problem due to recent migrations of document slugs, but further examination revealed a vulnerability scanner's list of items to probe: SSH keys, Terraform state, environment backups, CI configuration, and more. All 447 failures had the user agent ChatGPT-User. While this may seem like a common occurrence for any public site, the distinction lay in the source of these requests. The label of ChatGPT-User was misleading, as it only identified traffic based on its user agent string, not the actual sender. To determine if these requests were coming from OpenAI, users could refer to OpenAI's published IP ranges or use Cloudflare's cf.client.bot field in their WAF custom rules. Additionally, ChatGPT serves pages from a shared cache, meaning even if a request comes from a ChatGPT-User agent, it may not directly interact with the user's server. This story began as an investigation into an alarming AI metric but ultimately exposed the need for more accurate identification of AI traffic and the potential security risks associated with vulnerable scanning.",
  "summary": "We finally opened Cloudflare's AI Crawl Control last week, mostly out of curiosity about which AI bots actually visit us. It had been collecting quietly the whole time. The first 24-hour window we looked at showed 1,890 requests from AI agents, and 483 of them failed. Compared with the previous day, that failure count was up 63 percent. The worst record belonged to the agent we were most curious…",
  "key_points": [
    "Cloudflare monitors AI agents visiting their website",
    "ChatGPT-User accounted for 859 requests, but only 412 succeeded",
    "Vulnerability scanner probed SSH keys, Terraform state, and more"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}