Balancing Fairness and Accuracy in Data-Restricted Binary Classification
This work addresses fairness-accuracy trade-offs in machine learning for applications with sensitive data restrictions, but it is incremental as it builds on prior methods by directly analyzing optimal Bayesian classifiers.
The paper tackles the problem of balancing fairness and accuracy in binary classification when data access is restricted, by proposing a framework that models this trade-off under four practical scenarios and demonstrates its utility through experiments on three datasets.
Applications that deal with sensitive information may have restrictions placed on the data available to a machine learning (ML) classifier. For example, in some applications, a classifier may not have direct access to sensitive attributes, affecting its ability to produce accurate and fair decisions. This paper proposes a framework that models the trade-off between accuracy and fairness under four practical scenarios that dictate the type of data available for analysis. Prior works examine this trade-off by analyzing the outputs of a scoring function that has been trained to implicitly learn the underlying distribution of the feature vector, class label, and sensitive attribute of a dataset. In contrast, our framework directly analyzes the behavior of the optimal Bayesian classifier on this underlying distribution by constructing a discrete approximation it from the dataset itself. This approach enables us to formulate multiple convex optimization problems, which allow us to answer the question: How is the accuracy of a Bayesian classifier affected in different data restricting scenarios when constrained to be fair? Analysis is performed on a set of fairness definitions that include group and individual fairness. Experiments on three datasets demonstrate the utility of the proposed framework as a tool for quantifying the trade-offs among different fairness notions and their distributional dependencies.