Anti-Matthew FL: Bridging the Performance Gap in Federated Learning to Counteract the Matthew Effect
This work addresses fairness issues in federated learning for clients with limited data resources, offering a novel approach to reduce disparities, though it is incremental in improving existing FL methods.
The paper tackles the performance imbalance in federated learning caused by the Matthew effect, where disadvantaged clients suffer from degraded model accuracy, and proposes anti-Matthew FL to achieve fairness by equalizing accuracy and decision bias across clients, demonstrating through experiments that it outperforms state-of-the-art methods in bridging performance gaps.
Federated learning (FL) stands as a paradigmatic approach that facilitates model training across heterogeneous and diverse datasets originating from various data providers. However, conventional FLs fall short of achieving consistent performance, potentially leading to performance degradation for clients who are disadvantaged in data resources. Influenced by the Matthew effect, deploying a performance-imbalanced global model in applications further impedes the generation of high-quality data from disadvantaged clients, exacerbating the disparities in data resources among clients. In this work, we propose anti-Matthew fairness for the global model at the client level, requiring equal accuracy and equal decision bias across clients. To balance the trade-off between achieving anti-Matthew fairness and performance optimality, we formalize the anti-Matthew effect federated learning (anti-Matthew FL) as a multi-constrained multi-objectives optimization (MCMOO) problem and propose a three-stage multi-gradient descent algorithm to obtain the Pareto optimality. We theoretically analyze the convergence and time complexity of our proposed algorithms. Additionally, through extensive experimentation, we demonstrate that our proposed anti-Matthew FL outperforms other state-of-the-art FL algorithms in achieving a high-performance global model while effectively bridging performance gaps among clients. We hope this work provides valuable insights into the manifestation of the Matthew effect in FL and other decentralized learning scenarios and can contribute to designing fairer learning mechanisms, ultimately fostering societal welfare.