Fake AI Tools Put US Companies at Risk: Inside Counterfeit Claude, ChatGPT, and Copilot
ANY.RUN analyzes 1,258 fake AI campaign submissions, exposing malicious installers, session theft, credential phishing, and detection strategies for SOC teams.
Fake AI tools, posing as Claude, ChatGPT, and GitHub Copilot, pose a significant risk to U.S. companies, according to recent research. Between April and October 2026, 1,258 public sandbox analyses were tied to these counterfeit campaigns, with the USA being the second-largest source of submissions after India.
These attacks rely on the employee taking a crucial step, such as pasting an "install command," running a convincing installer, or signing in to a fake window. This can put source code, cloud and AI API keys, business sessions, ad accounts, and billing access at risk, potentially resulting in data exposure, account compromise, financial loss, or disruption to development and marketing operations.
The analysis found that Claude and ChatGPT were the most impersonated brands, accounting for 81% of all analyzed activities. U.S. organizations are particularly vulnerable, with the country accounting for 16% of all recorded submitter-country data, ranking second overall and first in several major campaign groups.
The attacks are particularly effective because they blend into normal employee behavior. Victims are often prompted to paste a command into PowerShell or Terminal, bypassing traditional controls. Common attack vectors include search results, Google Ads, shared AI chats, fake download pages, and email invitations.
The consequences of these attacks can be severe. Developers may expose sensitive information, while marketing and business teams could be targeted for ad and billing account compromise. These incidents can lead to unauthorized access to business systems, loss of sensitive data and credentials, and disruption to operations.
To combat these threats, organizations should focus on detecting commands, backend paths, and scheduled tasks. Additionally, it's crucial to strengthen threat response measures and educate employees about the risks associated with installing AI software from unverified sources.
Written by urgent.news from HackerNoon's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.