Bayesian Distance Weighted Discrimination
This work provides a Bayesian framework for DWD, allowing uncertainty assessment and semi-supervised analysis in high-dimensional classification, but it is incremental as it extends an existing method rather than introducing a new paradigm.
The authors tackled the lack of a model-based framework for statistical inference in distance weighted discrimination (DWD) by developing a Bayesian version that identifies the mode of a proper posterior distribution, enabling uncertainty quantification and improved power in classification tasks, as demonstrated in simulation studies and a breast cancer genomics application.
Distance weighted discrimination (DWD) is a linear discrimination method that is particularly well-suited for classification tasks with high-dimensional data. The DWD coefficients minimize an intuitive objective function, which can solved very efficiently using state-of-the-art optimization techniques. However, DWD has not yet been cast into a model-based framework for statistical inference. In this article we show that DWD identifies the mode of a proper Bayesian posterior distribution, that results from a particular link function for the class probabilities and a shrinkage-inducing proper prior distribution on the coefficients. We describe a relatively efficient Markov chain Monte Carlo (MCMC) algorithm to simulate from the true posterior under this Bayesian framework. We show that the posterior is asymptotically normal and derive the mean and covariance matrix of its limiting distribution. Through several simulation studies and an application to breast cancer genomics we demonstrate how the Bayesian approach to DWD can be used to (1) compute well-calibrated posterior class probabilities, (2) assess uncertainty in the DWD coefficients and resulting sample scores, (3) improve power via semi-supervised analysis when not all class labels are available, and (4) automatically determine a penalty tuning parameter within the model-based framework. R code to perform Bayesian DWD is available at https://github.com/lockEF/BayesianDWD .