---
title: "AMIE (Video) Reaches Expert-Level Medical AI: A Milestone in Real-Time Video Consultations"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2608.09861v1"
permalink: "https://feed.astralor.com/items/itm_e2c4e77bb68a3f0cd02b94c2"
published: "2026-08-10T17:19:31.000Z"
score: 78
channel: "ai"
tags: ["AMIE","Gemini","Google Research","Multi-agent Systems","Video Consultation","Telehealth"]
---

# AMIE (Video) Reaches Expert-Level Medical AI: A Milestone in Real-Time Video Consultations

## AI commentary

> This paper is worth reading because it's the first to push medical AI into real-time audio-visual consultation with expert-level performance, backed by a rigorous OSCE design. For medical AI product builders, telehealth platforms, and clinical decision support teams, this signals that multimodal interaction is no longer conceptual but approaching clinical parity. Still, fine anatomy and affective understanding remain far from perfect, so real-world deployment still has a long way to go.

## At a glance

Google Research's AMIE, a Gemini-based multi-agent system, now includes a video configuration. In a randomized OSCE study with 30 primary care physicians, 15 patient actors, and 100 clinical scenarios, AMIE (Video) performed on par with or better than PCPs in history-taking, diagnosis, management, and physical examination. Patient actors preferred AMIE's methods for assessing and explaining conditions, though they preferred human PCPs for rapport and partnership. Ablation showed video interface outperformed text-only. Limitations remain in fine anatomical precision, subtle affective nuances, and high-frequency movements, marking an important milestone toward sensory-rich clinical AI.

## Key points

- AMIE (Video) is a Gemini-based multi-agent system integrating low-latency dialogue, clinical reasoning, and real-time audio-visual perception.
- In a randomized OSCE study across 100 clinical scenarios, clinical evaluators rated AMIE (Video) on par or better than PCPs in history-taking, diagnosis, management, and physical examination.
- Patient actors preferred AMIE's approach to assessing and explaining conditions, while human PCPs were preferred for rapport and partnership building.
- Video interface outperformed text chat in communicative effectiveness, convenience, and feeling understood, but limitations remain in fine anatomical precision, subtle affective nuances, and high-frequency movements.

## Full text

Audio-visual interaction is the standard for patient-physician consultations, enabling natural communication and effective assessment of illness through non-verbal cues. While text-based AI has shown promise, it discards essential perceptual dimensions and limits patients who cannot articulate symptoms in writing. Early efforts to extend medical AI to audio-visual interaction have demonstrated feasibility but not reached clinician-level performance. Here, we provide the first demonstration of expert-level AI in real-time clinical video consultations using AMIE (Articulate Medical Intelligence Explorer) in a video configuration. AMIE (Video) is a Gemini-based multi-agent system integrating low-latency dialogue, clinical reasoning, and real-time audio-visual perception. To guide development, we established a taxonomy and automated evaluations for clinical audio-visual cues in telehealth settings. In a randomized Objective Structured Clinical Examination (OSCE) study with 30 primary care physicians (PCPs), 15 patient actors and 100 clinical scenarios, we compared AMIE (Video), its text-only counterpart AMIE (Text), and PCPs consulting via video. Clinical evaluators rated AMIE (Video) on par or better than PCPs in history-taking, diagnosis, management, and physical observation and examination. Patient actors preferred AMIE's approach to assessing and explaining conditions, while PCPs were preferred for rapport and partnership building. In modality ablation, patient actors preferred AMIE (Video)'s interface over text chat for communicative effectiveness, convenience, and feeling understood. Limitations remain in fine anatomical precision, subtle affective nuances, and high-frequency movements. While further research is needed before real-world translation, these results mark an important milestone toward AI systems capable of augmenting care across the sensory complexity of clinical practice.

---

Verify against the original before citing; curated by Astral Feed: https://feed.astralor.com/items/itm_e2c4e77bb68a3f0cd02b94c2