AMIE, our research medical AI system, demonstrates real-time clinical video consultation capabilities in a first-of-its-kind study.
Google introduces AMIE for real-time clinical video consultations in simulated settings.
When you visit a doctor, a consultation is more than just the words spoken. A physician must notice a cough, observe a patient's gait, or register visible signs of discomfort. Google Research and Google DeepMind are working to advance AMIE, their research medical AI system, toward real-time clinical video consultations. In a groundbreaking demonstration, AMIE, built on Gemini and Project Astra using a multi-agent architecture, was able to interpret visual and auditory cues, guide virtual physical exams, and reason diagnostically in real time.
In a randomized study using simulated consultations with patient actors and primary care physicians, clinical evaluators found AMIE to be favorable across core clinical competencies. These included thorough history-taking, diagnostic accuracy, management appropriateness, and communication quality. Patient actors also expressed a preference for the video experience over text chat.
Despite being a research system, AMIE provides an exciting glimpse into the future of health AI, though more research is needed before responsible real-world clinical deployment.
Written by urgent.news from Google Blog's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.