Why some websites are blocking AI agents from accessing the web
AI agents can be a great tool to help make purchases for you online - but it can become a frustrating problem if the website you're using blocks their access.
Some websites are implementing measures to block AI agents from accessing their platforms. This issue has affected Meta's Muse, an AI assistant, when interacting with Walmart's website. While AI agents can automate tasks like shopping and booking travel, websites often require users to prove they are human through CAPTCHA, which can disrupt the agent's operations.
Amazon has taken a more direct approach by blocking its own AI tool, Comet AI, from shopping on its platform. Security concerns are heightened when financial transactions are involved, as AI agents may use shared login credentials, posing risks of unauthorized fund transfers. Banks like JPMorgan Chase are blocking such methods, emphasizing the importance of security.
Even if a user grants an AI agent permission to act on their behalf, websites may still impose restrictions due to security systems unable to differentiate between legitimate agents and unwanted automated traffic. Cloudflare, for instance, now distinguishes between search crawlers, AI training bots, and user-permissioned agents, defaulting to allowing search crawlers while blocking AI training bots and agents on web pages with advertisements.
This situation highlights the challenges AI agents face when navigating websites, often encountering human-verification prompts that interrupt automated shopping sessions.
Written by urgent.news from Engadget's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
