LGCRFeb 8, 2024

Mitigating Privacy Risk in Membership Inference by Convex-Concave Loss

arXiv:2402.05453v36 citationsh-index: 14ICML
Originality Incremental advance
AI Analysis

This addresses privacy risks for machine learning practitioners by providing a defense against MIAs, though it appears incremental as it builds on existing gradient-based methods.

The paper tackles the problem of membership inference attacks (MIAs) on machine learning models by proposing a Convex-Concave Loss method, which reduces loss convexity to increase training loss variance and achieves state-of-the-art balance in privacy-utility trade-off.

Machine learning models are susceptible to membership inference attacks (MIAs), which aim to infer whether a sample is in the training set. Existing work utilizes gradient ascent to enlarge the loss variance of training data, alleviating the privacy risk. However, optimizing toward a reverse direction may cause the model parameters to oscillate near local minima, leading to instability and suboptimal performance. In this work, we propose a novel method -- Convex-Concave Loss, which enables a high variance of training loss distribution by gradient descent. Our method is motivated by the theoretical analysis that convex losses tend to decrease the loss variance during training. Thus, our key idea behind CCL is to reduce the convexity of loss functions with a concave term. Trained with CCL, neural networks produce losses with high variance for training data, reinforcing the defense against MIAs. Extensive experiments demonstrate the superiority of CCL, achieving state-of-the-art balance in the privacy-utility trade-off.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes