FedMix: Mixed Supervised Federated Learning for Medical Image Segmentation
This addresses the challenge of heterogeneous annotation in federated medical imaging, enabling more practical deployment without data sharing, though it is incremental in adapting existing federated learning to mixed supervision.
FedMix tackles the problem of federated learning for medical image segmentation by allowing clients to use mixed supervision levels (pixel-level, bounding box, image-level labels) and adaptively weighting their contributions, achieving state-of-the-art performance with significant improvements on breast tumor and skin lesion segmentation tasks.
The purpose of federated learning is to enable multiple clients to jointly train a machine learning model without sharing data. However, the existing methods for training an image segmentation model have been based on an unrealistic assumption that the training set for each local client is annotated in a similar fashion and thus follows the same image supervision level. To relax this assumption, in this work, we propose a label-agnostic unified federated learning framework, named FedMix, for medical image segmentation based on mixed image labels. In FedMix, each client updates the federated model by integrating and effectively making use of all available labeled data ranging from strong pixel-level labels, weak bounding box labels, to weakest image-level class labels. Based on these local models, we further propose an adaptive weight assignment procedure across local clients, where each client learns an aggregation weight during the global model update. Compared to the existing methods, FedMix not only breaks through the constraint of a single level of image supervision, but also can dynamically adjust the aggregation weight of each local client, achieving rich yet discriminative feature representations. To evaluate its effectiveness, experiments have been carried out on two challenging medical image segmentation tasks, i.e., breast tumor segmentation and skin lesion segmentation. The results validate that our proposed FedMix outperforms the state-of-the-art method by a large margin.