AI agents may raise conflict-of-interest risks, study finds
A new Stanford research paper finds that it’s becoming less clear whether recommendations by AI chatbots are driven by advertising dollars or genuine information.
AI agents could introduce conflict-of-interest concerns, according to a new Stanford research paper. The study highlights an emerging issue as AI increasingly contributes to internet search and e-commerce, making it harder to determine whether recommendations are influenced by advertising revenue or accurate information. In the future, when consumers seek products like toasters online, they may interact with AI agents while driving home, potentially resulting in the purchase of a toaster the next day.
Behind the scenes, multiple toaster manufacturers might have placed bids for the agent's consideration. The challenge lies in ensuring that consumers receive the best product or price, as well as addressing potential risks in sensitive areas such as healthcare and financial services. While the widespread use of personalized AI agents could mitigate the problem, it's more probable that most individuals will rely on free chatbots funded by advertisements.
Potential government regulations prohibiting AI agents from providing advice without disclosing financial incentives may not be effective due to the opaque nature of the industry. It is crucial to address this issue before adtech-like businesses develop around agentic commerce, making it difficult to decipher the underlying motivations behind AI-driven recommendations.
Written by urgent.news from Semafor's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
