What are You Looking at? Modality Contribution in Multimodal Medical Deep Learning
This work addresses the need for interpretability in multimodal AI for clinical practice, though it is incremental as it applies an existing occlusion technique to new medical contexts.
The authors tackled the problem of understanding how multimodal deep learning models process individual data sources in medical applications, and they developed an occlusion-based method to quantitatively measure modality importance, finding that some networks exhibit modality preferences leading to unimodal collapses and some datasets are inherently imbalanced.
Purpose High dimensional, multimodal data can nowadays be analyzed by huge deep neural networks with little effort. Several fusion methods for bringing together different modalities have been developed. Given the prevalence of high-dimensional, multimodal patient data in medicine, the development of multimodal models marks a significant advancement. However, how these models process information from individual sources in detail is still underexplored. Methods To this end, we implemented an occlusion-based modality contribution method that is both model- and performance-agnostic. This method quantitatively measures the importance of each modality in the dataset for the model to fulfill its task. We applied our method to three different multimodal medical problems for experimental purposes. Results Herein we found that some networks have modality preferences that tend to unimodal collapses, while some datasets are imbalanced from the ground up. Moreover, we provide fine-grained quantitative and visual attribute importance for each modality. Conclusion Our metric offers valuable insights that can support the advancement of multimodal model development and dataset creation. By introducing this method, we contribute to the growing field of interpretability in deep learning for multimodal research. This approach helps to facilitate the integration of multimodal AI into clinical practice. Our code is publicly available at https://github.com/ChristianGappGit/MC_MMD.