LGAIJan 17, 2022

Fair Group-Shared Representations with Normalizing Flows

arXiv:2201.06336v17 citations
AI Analysis

This work addresses fairness issues in ML for underprivileged groups, but it is incremental as it builds on existing fair representation learning approaches.

The paper tackles the problem of fairness in machine learning by developing a fair representation learning algorithm that maps individuals from different groups into a single group using Normalizing Flows, achieving competitive performance and stronger invariance with respect to sensitive attributes compared to other methods.

The issue of fairness in machine learning stems from the fact that historical data often displays biases against specific groups of people which have been underprivileged in the recent past, or still are. In this context, one of the possible approaches is to employ fair representation learning algorithms which are able to remove biases from data, making groups statistically indistinguishable. In this paper, we instead develop a fair representation learning algorithm which is able to map individuals belonging to different groups in a single group. This is made possible by training a pair of Normalizing Flow models and constraining them to not remove information about the ground truth by training a ranking or classification model on top of them. The overall, ``chained'' model is invertible and has a tractable Jacobian, which allows to relate together the probability densities for different groups and ``translate'' individuals from one group to another. We show experimentally that our methodology is competitive with other fair representation learning algorithms. Furthermore, our algorithm achieves stronger invariance w.r.t. the sensitive attribute.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes