Clinicians are using AI scribes, but what happens to your medical data?
There’s little transparency about who has access to deeply personal medical data or how companies handle it.
In Australia, a growing number of doctors are incorporating AI scribes into their consultations, with over 40% reportedly using these tools, as reported by Digital Rights Watch. These AI scribes transcribe consultations, feed the information into Large Language Models to produce medical notes, and can reduce the workload of clinicians.
However, the implications of using AI scribes extend beyond convenience, raising questions about the privacy and security of patients' medical data. These AI tools often generate summaries and interpretations of conversations, leading to potential inaccuracies due to a phenomenon known as "hallucination." Additionally, AI systems can exhibit biases that may result in medical records that significantly deviate from reality, particularly for patients from diverse cultural and linguistic backgrounds or those whose first language is not English.
Studies indicate that around 20% of AI clinical notes contain critical errors that could impact patient diagnoses, a statistic that can lead to significant issues when these errors are overlooked under time pressure. While clinicians may find the use of AI scribes appealing due to the reduction in paperwork, the lack of transparency regarding data handling and access is a major concern.
Patients are often left in the dark about who has access to their data and how it is utilized, making it difficult for them to make informed decisions. Regulators are grappling with this rapidly evolving landscape, as existing laws struggle to keep pace with the rapid advancements in AI technology. The Therapeutic Goods Administration (TGA) should take a more proactive role in regulating AI scribes as they would with any other medical device, subjecting them to rigorous safety testing requirements.
This would ensure that the data collected and processed by these systems are handled with the utmost care and integrity, safeguarding patients' privacy and enhancing the overall reliability of the medical system.
Written by urgent.news from The Conversation AU's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
