{
  "id": 3566626,
  "title": "AI receptionists seem like a dangerous idea after a patient revealed it failed to understand her request",
  "url": "https://urgent.news/2026/08/26/ai-receptionists-seem-like-a-dangerous-idea-after-a-patient-revealed",
  "topic": "ai",
  "section": "AI",
  "published": "2026-08-26T18:30:00.000Z",
  "source": {
    "name": "Digital Trends",
    "slug": "digital-trends",
    "url": "https://www.digitaltrends.com/computing/ai-receptionists-seem-like-a-dangerous-idea-after-a-patient-reveals-it-failed-to-understand-her-request/"
  },
  "original_language": "en",
  "account": "Judith Butterfield, a 71-year-old woman recovering from a stroke, recounted how an AI receptionist at her GP surgery repeatedly failed to understand her fragmented speech after the stroke affected her speech and movement on the right side of her body. After numerous attempts, she decided to switch to another practice. The surgery subsequently deactivated the AI system. This incident highlights a broader issue: healthcare technology must be designed to accommodate patients' communication needs, including those with speech impairments or regional accents. The AI receptionist, known as EMMA developed by QuantumLoopAI, was introduced to manage telephone demand and reduce waiting times. However, Healthwatch Rotherham reported complaints from patients, including those with regional accents and speech impairments, who struggled to communicate with the system. The automated service allegedly asked Butterfield not to use speakerphone, but when it failed to recognize her name, no human intervened to help her. This issue extends beyond a single receptionist system, as Healthwatch England collected similar accounts from patients experiencing difficulties with AI while booking appointments, requesting medication, and communicating their needs. While AI can benefit overburdened GP practices by answering calls and freeing reception staff, it also poses risks if not designed with patient communication in mind. Healthwatch warns that vulnerable patients, such as those with communication needs, disabilities, or lower digital confidence, are particularly at risk of being excluded from healthcare technology. The incident in South Yorkshire underscores the importance of ensuring AI receptionists make it easier to reach a human, rather than creating additional obstacles between patients and the care they need.",
  "summary": "AI receptionists are being introduced to handle GP calls and reduce waiting times, but patient complaints are raising concerns about accessibility, communication and human backup.",
  "key_points": [
    "71-year-old Judith Butterfield struggled with AI receptionist due to speech impairment",
    "EMMA AI system deactivated after patient complaints of communication difficulties",
    "Healthwatch warns vulnerable patients at risk from poorly designed AI healthcare tools"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}