---
title: "AMIE视频版达到专家级医疗AI水平：实时视频问诊新里程碑"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2608.09861v1"
permalink: "https://feed.astralor.com/items/itm_e2c4e77bb68a3f0cd02b94c2"
published: "2026-08-10T17:19:31.000Z"
score: 78
channel: "ai"
tags: ["AMIE","Gemini","Google Research","多智能体系统","视频问诊","远程医疗"]
---

# AMIE视频版达到专家级医疗AI水平：实时视频问诊新里程碑

## AI 点评

> 这篇论文最值得看的是它首次把医疗AI拉到音视频实时问诊的赛道上，并且用严谨的OSCE设计证明AI能跟人类医生扳手腕。对于做医疗AI产品、远程医疗平台和临床辅助决策的人，这是个重要的信号：多模态交互不再只是概念，而是开始有专家级效果。当然，别急着吹，精细解剖和情感理解还差得远，真实落地路还长。

## 速览

谷歌研究团队基于Gemini构建的多智能体系统AMIE推出视频配置，在100个临床场景、30名全科医生和15名模拟患者的随机OSCE研究中，达到或超过全科医生的病史采集、诊断、管理和体格检查水平。患者演员认可AMIE的解释和评估方式，但在融洽关系和伙伴关系方面仍偏好人类医生。消融实验显示视频界面优于纯文本。局限包括精细解剖、细微情感和高频动作识别仍需改进。该成果标志着医疗AI向感官丰富的临床实践迈出重要一步。

## 关键点

- AMIE (Video) 是基于Gemini的多智能体系统，融合低延迟对话、临床推理和实时视听感知。
- 在100个临床场景的随机OSCE研究中，临床评估者认为AMIE (Video)在病史采集、诊断、管理和体格检查方面与全科医生相当或更优。
- 患者演员偏好AMIE的病情评估和解释方式，但人类医生在建立融洽关系和伙伴关系上更受青睐。
- 视频界面相比纯文本提升了沟通效率、便利性和被理解感，但精细解剖、细微情感及高频动作识别仍是待突破的局限。

## 全文

Audio-visual interaction is the standard for patient-physician consultations, enabling natural communication and effective assessment of illness through non-verbal cues. While text-based AI has shown promise, it discards essential perceptual dimensions and limits patients who cannot articulate symptoms in writing. Early efforts to extend medical AI to audio-visual interaction have demonstrated feasibility but not reached clinician-level performance. Here, we provide the first demonstration of expert-level AI in real-time clinical video consultations using AMIE (Articulate Medical Intelligence Explorer) in a video configuration. AMIE (Video) is a Gemini-based multi-agent system integrating low-latency dialogue, clinical reasoning, and real-time audio-visual perception. To guide development, we established a taxonomy and automated evaluations for clinical audio-visual cues in telehealth settings. In a randomized Objective Structured Clinical Examination (OSCE) study with 30 primary care physicians (PCPs), 15 patient actors and 100 clinical scenarios, we compared AMIE (Video), its text-only counterpart AMIE (Text), and PCPs consulting via video. Clinical evaluators rated AMIE (Video) on par or better than PCPs in history-taking, diagnosis, management, and physical observation and examination. Patient actors preferred AMIE's approach to assessing and explaining conditions, while PCPs were preferred for rapport and partnership building. In modality ablation, patient actors preferred AMIE (Video)'s interface over text chat for communicative effectiveness, convenience, and feeling understood. Limitations remain in fine anatomical precision, subtle affective nuances, and high-frequency movements. While further research is needed before real-world translation, these results mark an important milestone toward AI systems capable of augmenting care across the sensory complexity of clinical practice.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_e2c4e77bb68a3f0cd02b94c2