Enhancing Communication Efficiency in FL with Adaptive Gradient Quantization and Communication Frequency Optimization
This addresses communication bottlenecks for resource-constrained wireless networks in FL, but appears incremental as it builds on existing compression and optimization methods.
The paper tackles the high communication overhead in Federated Learning by proposing a three-fold strategy including adaptive gradient quantization and communication frequency optimization, achieving high communication efficiency while maintaining accuracy.
Federated Learning (FL) enables participant devices to collaboratively train deep learning models without sharing their data with the server or other devices, effectively addressing data privacy and computational concerns. However, FL faces a major bottleneck due to high communication overhead from frequent model updates between devices and the server, limiting deployment in resource-constrained wireless networks. In this paper, we propose a three-fold strategy. Firstly, an Adaptive Feature-Elimination Strategy to drop less important features while retaining high-value ones; secondly, Adaptive Gradient Innovation and Error Sensitivity-Based Quantization, which dynamically adjusts the quantization level for innovative gradient compression; and thirdly, Communication Frequency Optimization to enhance communication efficiency. We evaluated our proposed model's performance through extensive experiments, assessing accuracy, loss, and convergence compared to baseline techniques. The results show that our model achieves high communication efficiency in the framework while maintaining accuracy.