CRDBFeb 12, 2022

Local Differential Privacy for Federated Learning

arXiv:2202.06053v223 citations
Originality Incremental advance
AI Analysis

This addresses privacy risks in cross-silo FL for domains like healthcare, offering a scalable solution with stronger guarantees, though it appears incremental by building on existing LDP methods.

The paper tackles the problem of privacy vulnerabilities in federated learning (FL) for industrial settings with untrusted parties, proposing a new local differentially private FL protocol (LDPFL) that achieves up to 98% model performance under small privacy budgets like epsilon = 0.5.

Advanced adversarial attacks such as membership inference and model memorization can make federated learning (FL) vulnerable and potentially leak sensitive private data. Local differentially private (LDP) approaches are gaining more popularity due to stronger privacy notions and native support for data distribution compared to other differentially private (DP) solutions. However, DP approaches assume that the FL server (that aggregates the models) is honest (run the FL protocol honestly) or semi-honest (run the FL protocol honestly while also trying to learn as much information as possible). These assumptions make such approaches unrealistic and unreliable for real-world settings. Besides, in real-world industrial environments (e.g., healthcare), the distributed entities (e.g., hospitals) are already composed of locally running machine learning models (this setting is also referred to as the cross-silo setting). Existing approaches do not provide a scalable mechanism for privacy-preserving FL to be utilized under such settings, potentially with untrusted parties. This paper proposes a new local differentially private FL (named LDPFL) protocol for industrial settings. LDPFL can run in industrial settings with untrusted entities while enforcing stronger privacy guarantees than existing approaches. LDPFL shows high FL model performance (up to 98%) under small privacy budgets (e.g., epsilon = 0.5) in comparison to existing methods.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes