AI scribes promise less paperwork but may introduce errors into patient records
Visits to a new doctor, physical therapist or specialist often begin with: "Do you mind if I use AI?" According to Off the Record, a new report by Digital Rights Watch, more than 40% of Australian doctors are now using AI scribes. These tools listen to consultations, feeding what they hear into large language models—similar to ChatGPT or Claude—to generate medical notes.
A new report by Digital Rights Watch reveals that over 40% of Australian doctors are using AI scribes to transcribe consultations. These AI tools aim to streamline administrative tasks, allowing doctors to focus on patient care and reduce burnout. However, the benefits for patients remain unclear due to several concerns. Firstly, the lack of transparency regarding data handling and access by AI scribes raises significant privacy issues.
Secondly, AI systems often generate errors, with recent studies indicating that up to 20% of clinical notes contain significant mistakes. This is concerning as these errors can affect diagnoses and lead to misinformed patient care. Additionally, AI scribes may introduce biases based on race, ethnicity, class, and gender, particularly affecting patients from diverse backgrounds or non-English speakers.
This can result in medical records that significantly deviate from the patient's reality. Furthermore, clinicians face challenges in verifying AI-generated notes due to the pressure of time constraints and a lack of expertise in identifying AI mistakes. This verification burden could undermine the productivity gains promised by AI scribes.
The issue of trust is further complicated by the inability of healthcare professionals to provide clear information about data handling and AI model usage. With regulators struggling to keep up with rapidly evolving technology, there is a pressing need for stringent regulation and independent testing of AI scribes. The Australian Therapeutic Goods Administration (TGA) should treat AI scribes as medical devices, subjecting them to similar safety and privacy testing as other medical equipment.
Without proper safeguards, the integration of AI scribes could undermine patient trust in the healthcare system, ultimately affecting everyone.
Written by urgent.news from Medical Xpress's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
