Doctor forced to apologise after AI makes 'scary' error about illegal drugs
Artificial Intelligence is listening to many people's medical appointments, but it is not always hearing things correctly.
Rebecca Green was surprised when her urologist made a serious error in documenting her medical history during a recent appointment. The AI scribe falsely claimed that Ms Green was taking illegal drugs – specifically psychedelic mushrooms – which she had never used. This incorrect information appeared in a post-operative letter sent to her GP, causing Ms Green considerable distress.
New research from a privacy watchdog has highlighted the risks of AI making up false medical information, warning that patients could be harmed by such errors. Australia's peak regulator, AHPRA, stressed that doctors must always verify the accuracy of AI-generated information to avoid compromising patient care. The urologist acknowledged the mistake and apologized, admitting she was unaware how the false claim had been made.
Ms Green feels fortunate that she noticed the error early enough to address it but worries that some people may not be as vigilant, potentially leading to serious consequences for their health, career, or insurance.
Written by urgent.news from ABC News AU's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.