Exploiting Causality Signals in Medical Images: A Pilot Study with Empirical Results
This addresses the need for accurate and reliable classification in medical imaging for cancer diagnosis, though it appears incremental as it builds on existing attention-based solutions.
The authors tackled the problem of discovering and exploiting weak causal signals in medical images for classification, using a neural network with a causality-factors extractor module, and found that it improves classification and produces more robust predictions focusing on relevant image parts.
We present a novel technique to discover and exploit weak causal signals directly from images via neural networks for classification purposes. This way, we model how the presence of a feature in one part of the image affects the appearance of another feature in a different part of the image. Our method consists of a convolutional neural network backbone and a causality-factors extractor module, which computes weights to enhance each feature map according to its causal influence in the scene. We develop different architecture variants and empirically evaluate all the models on two public datasets of prostate MRI images and breast histopathology slides for cancer diagnosis. We study the effectiveness of our module both in fully-supervised and few-shot learning, we assess its addition to existing attention-based solutions, we conduct ablation studies, and investigate the explainability of our models via class activation maps. Our findings show that our lightweight block extracts meaningful information and improves the overall classification, together with producing more robust predictions that focus on relevant parts of the image. That is crucial in medical imaging, where accurate and reliable classifications are essential for effective diagnosis and treatment planning.