More GPs are asking patients this question. What should you do?

In recent years, a new question is becoming more common in GP consultations: "Do you consent to me using an AI transcription tool?" This question is likely to become routine as AI scribes are now used by around 40% of Australian GPs, up from 22% in August 2024, according to the Royal Australian College of General Practitioners (RACGP).

AI scribes help GP and clinicians transcribe conversations with patients, take notes, and summarize discussions. During consultations, the AI listens and drafts a note afterwards, while also generating referral and specialist letters, care plans, and sometimes a plain-English summary for patients. However, these software tools do not decide care plans, merely document interactions.

While GPs appreciate AI scribes for reducing burnout and allowing more patient-centred care, the benefits for patients are less clear-cut. Andrew Cullen from the University of Melbourne's School of Computing and Information Systems expresses concern about potential errors, noting that up to 20% of AI-scribed notes contain significant mistakes. This could lead to misdiagnoses or inappropriate care. AI tools also struggle with accents, speech impediments, and noisy environments, raising equity concerns.

Regulation and privacy concerns are also significant. Cullen argues that current oversight is insufficient, particularly regarding how personal information is handled. GPs are advised to check data storage and processing methods, as draft notes are stored in clinical software covered by the Privacy Act. It remains unclear whether AI scribes should be classified as medical devices, as this would require more stringent testing and oversight.

Experts agree that clinician oversight and patient consent are essential. Ultimately, AI scribes require careful use and responsibility to ensure they enhance rather than compromise patient care.