OpenAI Bans Russian ChatGPT Accounts Used to Run Influence Operation

OpenAI has uncovered a covert influence campaign targeting Russian ChatGPT accounts, which were involved in promoting a self-described Israel-based expert community called the International Burke Institute (IBI). The investigation revealed that IBI published copied academic research with misleading author attributions, including claims of connections to prominent figures like Francis Fukuyama and Noam Chomsky.

IBI's most notable feature was its "sovereignty index," which was used to praise Russia and criticize Western governments. The operation utilized ChatGPT to generate promotional content and coordinated social media posts, with the accounts engaging in activities such as creating logos for Telegram channels, summarizing country activity in Russian, and producing German-language material.

While the campaign may have had a modest immediate reach, it demonstrated the potential for AI to construct the infrastructure necessary for more convincing and legitimate-looking influence operations. The significance of the operation lies not in the number of people reached, but in the credibility-building infrastructure it created, which poses a challenge for platforms, businesses, and consumers in recognizing coordinated messaging as part of an influence operation.