A Dempster-Shafer approach to trustworthy AI with application to fetal brain MRI segmentation
This addresses the critical need for trustworthy AI in medical image segmentation to ensure safety and compliance with potential regulations, specifically for fetal brain MRI analysis.
The paper tackles the problem of deep learning models for medical image segmentation failing unexpectedly on pathological cases and images from different centers, by proposing a trustworthy AI framework that automatically discards unreliable voxel-level predictions and uses a fallback method. The approach improves the robustness of a state-of-the-art backbone AI on a dataset of 540 fetal brain MRIs from 13 centers, demonstrating effectiveness across various conditions.
Deep learning models for medical image segmentation can fail unexpectedly and spectacularly for pathological cases and images acquired at different centers than training images, with labeling errors that violate expert knowledge. Such errors undermine the trustworthiness of deep learning models for medical image segmentation. Mechanisms for detecting and correcting such failures are essential for safely translating this technology into clinics and are likely to be a requirement of future regulations on artificial intelligence (AI). In this work, we propose a trustworthy AI theoretical framework and a practical system that can augment any backbone AI system using a fallback method and a fail-safe mechanism based on Dempster-Shafer theory. Our approach relies on an actionable definition of trustworthy AI. Our method automatically discards the voxel-level labeling predicted by the backbone AI that violate expert knowledge and relies on a fallback for those voxels. We demonstrate the effectiveness of the proposed trustworthy AI approach on the largest reported annotated dataset of fetal MRI consisting of 540 manually annotated fetal brain 3D T2w MRIs from 13 centers. Our trustworthy AI method improves the robustness of a state-of-the-art backbone AI for fetal brain MRIs acquired across various centers and for fetuses with various brain abnormalities.