FetalAgents: A Multi-Agent System for Fetal Ultrasound Image and Video Analysis
This provides an auditable, workflow-aligned solution for clinicians in prenatal screening, though it is incremental as it builds on existing deep learning and multi-agent approaches.
The paper tackled the challenge of automating fetal ultrasound analysis by proposing FetalAgents, a multi-agent system that dynamically coordinates specialized vision experts for tasks like diagnosis and segmentation, achieving robust and accurate performance across eight clinical tasks in external evaluations.
Fetal ultrasound (US) is the primary imaging modality for prenatal screening, yet its interpretation relies heavily on the expertise of the clinician. Despite advances in deep learning and foundation models, existing automated tools for fetal US analysis struggle to balance task-specific accuracy with the whole-process versatility required to support end-to-end clinical workflows. To address these limitations, we propose FetalAgents, the first multi-agent system for comprehensive fetal US analysis. Through a lightweight, agentic coordination framework, FetalAgents dynamically orchestrates specialized vision experts to maximize performance across diagnosis, measurement, and segmentation. Furthermore, FetalAgents advances beyond static image analysis by supporting end-to-end video stream summarization, where keyframes are automatically identified across multiple anatomical planes, analyzed by coordinated experts, and synthesized with patient metadata into a structured clinical report. Extensive multi-center external evaluations across eight clinical tasks demonstrate that FetalAgents consistently delivers the most robust and accurate performance when compared against specialized models and multimodal large language models (MLLMs), ultimately providing an auditable, workflow-aligned solution for fetal ultrasound analysis and reporting.