SFU researchers warn of dangers with AI chatbots giving misleading references for health advice
'There's a big difference between Health Canada and a business that is trying to sell you a product,' says lead researcher Jeremy Snyder
A recent study from Simon Fraser University raises concerns about the reliability of health advice provided by artificial intelligence chatbots. The research, published in BMJ Connections Digital Health & AI, found that nearly one-quarter of the sources referenced in responses to queries about Alzheimer's disease, autism, and cerebral palsy were from for-profit medical providers.
Researchers tested six popular chatbots, including ChatGPT and Claude, with questions about the potential benefits of stem cell treatments for these conditions. While legitimate scientific information was provided, the majority of links led to businesses selling unproven stem cell therapies. The study's lead author, Jeremy Snyder, expresses concern about the high proportion of for-profit providers, stating, "We were surprised and concerned that the proportion of for-profit medical service providers was so high."
He advises users to scrutinize the motivations behind links provided by chatbots, distinguishing between reputable sources like Health Canada and commercial interests. The study also highlights the prevalence of unverified claims about stem cell treatments for age-related conditions, particularly in marketing materials aimed at vulnerable parents seeking solutions for their children.
Despite the legitimate research in the field, many businesses exploit the hype to sell unproven therapies, creating a conflict of interest that may lead users to disregard professional medical advice.
Written by urgent.news from Medical Xpress's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
This story
This is one outlet's version. Read the fullest account.
