Towards Resource-Efficient Federated Learning in Industrial IoT for Multivariate Time Series Analysis
This addresses resource constraints and privacy concerns for industrial IoT applications, though it is incremental as it builds on existing federated learning and pruning techniques.
The paper tackles the resource inefficiency of federated learning for anomaly detection and missing data imputation in industrial IoT by proposing a server-side compression method that prunes models, achieving over 99.7% compression with less than 1.18% performance loss compared to centralized solutions.
Anomaly and missing data constitute a thorny problem in industrial applications. In recent years, deep learning enabled anomaly detection has emerged as a critical direction, however the improved detection accuracy is achieved with the utilization of large neural networks, increasing their storage and computational cost. Moreover, the data collected in edge devices contain user privacy, introducing challenges that can be successfully addressed by the privacy-preserving distributed paradigm, known as federated learning (FL). This framework allows edge devices to train and exchange models increasing also the communication cost. Thus, to deal with the increased communication, processing and storage challenges of the FL based deep anomaly detection NN pruning is expected to have significant benefits towards reducing the processing, storage and communication complexity. With this focus, a novel compression-based optimization problem is proposed at the server-side of a FL paradigm that fusses the received local models broadcast and performs pruning generating a more compressed model. Experiments in the context of anomaly detection and missing value imputation demonstrate that the proposed FL scenario along with the proposed compressed-based method are able to achieve high compression rates (more than $99.7\%$) with negligible performance losses (less than $1.18\%$ ) as compared to the centralized solutions.