$(ε, δ)$-Differentially Private Partial Least Squares Regression
This work addresses privacy concerns for sensitive data in analytical chemistry, offering a practical solution for privacy-preserving multivariate calibrations, though it is incremental as it applies existing differential privacy mechanisms to a specific domain method.
The paper tackles the lack of privacy guarantees in Partial Least Squares (PLS) regression, a key tool in analytical chemistry, by proposing an $(\epsilon, \delta)$-differentially private PLS algorithm that adds Gaussian noise to key functions, resulting in effective privacy protection with competitive prediction error (e.g., RMSEP remains low at $\epsilon=1$ on the NIR corn dataset).
As data-privacy requirements are becoming increasingly stringent and statistical models based on sensitive data are being deployed and used more routinely, protecting data-privacy becomes pivotal. Partial Least Squares (PLS) regression is the premier tool for building such models in analytical chemistry, yet it does not inherently provide privacy guarantees, leaving sensitive (training) data vulnerable to privacy attacks. To address this gap, we propose an $(ε, δ)$-differentially private PLS (edPLS) algorithm, which integrates well-studied and theoretically motivated Gaussian noise-adding mechanisms into the PLS algorithm to ensure the privacy of the data underlying the model. Our approach involves adding carefully calibrated Gaussian noise to the outputs of four key functions in the PLS algorithm: the weights, scores, $X$-loadings, and $Y$-loadings. The noise variance is determined based on the global sensitivity of each function, ensuring that the privacy loss is controlled according to the $(ε, δ)$-differential privacy framework. Specifically, we derive the sensitivity bounds for each function and use these bounds to calibrate the noise added to the model components. Experimental results demonstrate that edPLS effectively renders privacy attacks, aimed at recovering unique sources of variability in the training data, ineffective. Application of edPLS to the NIR corn benchmark dataset shows that the root mean squared error of prediction (RMSEP) remains competitive even at strong privacy levels (i.e., $ε=1$), given proper pre-processing of the corresponding spectra. These findings highlight the practical utility of edPLS in creating privacy-preserving multivariate calibrations and for the analysis of their privacy-utility trade-offs.