FedMT: Federated Learning with Mixed-type Labels
This addresses a practical limitation in federated learning for domains like disease diagnosis, where clinical centers have varying standards, making it an incremental but important advancement.
The paper tackles the problem of federated learning with mixed-type labels, where different data centers use different labeling criteria, by introducing FedMT, a model-agnostic approach that estimates label correspondences and projects classification scores, resulting in substantial improvements in classification accuracy on benchmark and medical datasets.
In federated learning (FL), classifiers (e.g., deep networks) are trained on datasets from multiple data centers without exchanging data across them, which improves the sample efficiency. However, the conventional FL setting assumes the same labeling criterion in all data centers involved, thus limiting its practical utility. This limitation becomes particularly notable in domains like disease diagnosis, where different clinical centers may adhere to different standards, making traditional FL methods unsuitable. This paper addresses this important yet under-explored setting of FL, namely FL with mixed-type labels, where the allowance of different labeling criteria introduces inter-center label space differences. To address this challenge effectively and efficiently, we introduce a model-agnostic approach called FedMT, which estimates label space correspondences and projects classification scores to construct loss functions. The proposed FedMT is versatile and integrates seamlessly with various FL methods, such as FedAvg. Experimental results on benchmark and medical datasets highlight the substantial improvement in classification accuracy achieved by FedMT in the presence of mixed-type labels.