LGDec 30, 2024

Accelerating Energy-Efficient Federated Learning in Cell-Free Networks with Adaptive Quantization

arXiv:2412.20785v11 citationsh-index: 11IEEE Trans Mach Learn Commun Netw
Originality Incremental advance
AI Analysis

This work addresses latency and energy efficiency problems for FL in wireless networks, offering incremental improvements over existing methods.

The paper tackles the challenge of communication resource limitations hindering Federated Learning (FL) completion in Cell-Free Massive MIMO networks by proposing an energy-efficient, low-latency FL framework with adaptive quantization and optimized power allocation. Numerical results show test accuracy improvements of up to 19% over baseline power allocation methods and up to 36% over baseline quantization schemes under the same energy and latency budgets.

Federated Learning (FL) enables clients to share learning parameters instead of local data, reducing communication overhead. Traditional wireless networks face latency challenges with FL. In contrast, Cell-Free Massive MIMO (CFmMIMO) can serve multiple clients on shared resources, boosting spectral efficiency and reducing latency for large-scale FL. However, clients' communication resource limitations can hinder the completion of the FL training. To address this challenge, we propose an energy-efficient, low-latency FL framework featuring optimized uplink power allocation for seamless client-server collaboration. Our framework employs an adaptive quantization scheme, dynamically adjusting bit allocation for local gradient updates to reduce communication costs. We formulate a joint optimization problem covering FL model updates, local iterations, and power allocation, solved using sequential quadratic programming (SQP) to balance energy and latency. Additionally, clients use the AdaDelta method for local FL model updates, enhancing local model convergence compared to standard SGD, and we provide a comprehensive analysis of FL convergence with AdaDelta local updates. Numerical results show that, within the same energy and latency budgets, our power allocation scheme outperforms the Dinkelbach and max-sum rate methods by increasing the test accuracy up to $7$\% and $19$\%, respectively. Moreover, for the three power allocation methods, our proposed quantization scheme outperforms AQUILA and LAQ by increasing test accuracy by up to $36$\% and $35$\%, respectively.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes