Single-Round Clustered Federated Learning via Data Collaboration Analysis for Non-IID Data
This addresses the need for efficient federated learning under tight communication constraints, though it is incremental as it builds on existing CFL methods.
The paper tackled the problem of clustered federated learning (CFL) requiring multiple communication rounds for non-IID data, and proposed DC-CFL, a single-round framework that achieves accuracy comparable to multi-round baselines while using only one round.
Federated Learning (FL) enables distributed learning across multiple clients without sharing raw data. When statistical heterogeneity across clients is severe, Clustered Federated Learning (CFL) can improve performance by grouping similar clients and training cluster-wise models. However, most CFL approaches rely on multiple communication rounds for cluster estimation and model updates, which limits their practicality under tight constraints on communication rounds. We propose Data Collaboration-based Clustered Federated Learning (DC-CFL), a single-round framework that completes both client clustering and cluster-wise learning, using only the information shared in DC analysis. DC-CFL quantifies inter-client similarity via total variation distance between label distributions, estimates clusters using hierarchical clustering, and performs cluster-wise learning via DC analysis. Experiments on multiple open datasets under representative non-IID conditions show that DC-CFL achieves accuracy comparable to multi-round baselines while requiring only one communication round. These results indicate that DC-CFL is a practical alternative for collaborative AI model development when multiple communication rounds are impractical.