Google’s AMIE research system shows real-time clinical video consultation capabilities in simulated study

AMIE, a research medical AI system from Google Research and Google DeepMind, demonstrated real-time clinical video consultation capabilities in a first-of-its-kind study. The system interprets visual and auditory cues, guides virtual physical exams, and reasons diagnostically in real time.

Built on Gemini and Project Astra using a multi-agent architecture, AMIE participated in a randomized study with simulated consultations involving patient actors and primary care physicians. Clinical evaluators assessed AMIE favorably across core clinical competencies, including history-taking thoroughness, diagnostic accuracy, management appropriateness, and communication quality.

Patient actors also expressed a preference for the video consultation experience over text chat when interacting with AMIE.

The researchers emphasize that AMIE remains a research system and additional research is required before any responsible real-world clinical deployment.