Fair Generalized Linear Mixed Models
This addresses fairness and bias issues in machine learning predictions for social survey applications, but it is incremental as it combines existing concepts of fairness and mixed models.
The paper tackles the problem of bias in fair machine learning predictions due to stratified sampling in social survey data, presenting an algorithm that simultaneously handles fairness and strata correlations, and demonstrates its impact through a simulation study.
When using machine learning for automated prediction, it is important to account for fairness in the prediction. Fairness in machine learning aims to ensure that biases in the data and model inaccuracies do not lead to discriminatory decisions. E.g., predictions from fair machine learning models should not discriminate against sensitive variables such as sexual orientation and ethnicity. The training data often in obtained from social surveys. In social surveys, oftentimes the data collection process is a strata sampling, e.g. due to cost restrictions. In strata samples, the assumption of independence between the observation is not fulfilled. Hence, if the machine learning models do not account for the strata correlations, the results may be biased. Especially high is the bias in cases where the strata assignment is correlated to the variable of interest. We present in this paper an algorithm that can handle both problems simultaneously, and we demonstrate the impact of stratified sampling on the quality of fair machine learning predictions in a reproducible simulation study.