LGCRDCApr 12, 2021

Practical Defences Against Model Inversion Attacks for Split Neural Networks

arXiv:2104.05743v272 citations
Originality Incremental advance
AI Analysis

This addresses privacy risks for users in federated learning systems, but it is incremental as it builds on existing defenses like NoPeekNN.

The authors tackled model inversion attacks in split neural networks by proposing an additive noise defense, which significantly reduced attack efficacy on MNIST with an acceptable accuracy trade-off.

We describe a threat model under which a split network-based federated learning system is susceptible to a model inversion attack by a malicious computational server. We demonstrate that the attack can be successfully performed with limited knowledge of the data distribution by the attacker. We propose a simple additive noise method to defend against model inversion, finding that the method can significantly reduce attack efficacy at an acceptable accuracy trade-off on MNIST. Furthermore, we show that NoPeekNN, an existing defensive method, protects different information from exposure, suggesting that a combined defence is necessary to fully protect private user data.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes