Provable Membership Inference Privacy
This addresses privacy challenges for sensitive data applications like finance and healthcare, offering a more practical alternative to differential privacy.
The paper tackles the trade-off between privacy and utility in machine learning by proposing a new privacy notion called membership inference privacy (MIP), which reduces the randomness needed compared to differential privacy and leads to a smaller drop in utility while offering interpretable guarantees.
In applications involving sensitive data, such as finance and healthcare, the necessity for preserving data privacy can be a significant barrier to machine learning model development. Differential privacy (DP) has emerged as one canonical standard for provable privacy. However, DP's strong theoretical guarantees often come at the cost of a large drop in its utility for machine learning, and DP guarantees themselves can be difficult to interpret. In this work, we propose a novel privacy notion, membership inference privacy (MIP), to address these challenges. We give a precise characterization of the relationship between MIP and DP, and show that MIP can be achieved using less amount of randomness compared to the amount required for guaranteeing DP, leading to a smaller drop in utility. MIP guarantees are also easily interpretable in terms of the success rate of membership inference attacks. Our theoretical results also give rise to a simple algorithm for guaranteeing MIP which can be used as a wrapper around any algorithm with a continuous output, including parametric model training.