MLLGJun 30, 2017

On Fairness, Diversity and Randomness in Algorithmic Decision Making

arXiv:1706.10208v144 citations
Originality Incremental advance
AI Analysis

This addresses fairness concerns in algorithmic decision-making systems where diversity of perspectives is important.

The paper tackles the problem of reduced decision diversity when replacing human decision-makers with a single ML classifier, and demonstrates that random classifier ensembles can maintain fairness guarantees while achieving better accuracy-fairness trade-offs than single classifiers.

Consider a binary decision making process where a single machine learning classifier replaces a multitude of humans. We raise questions about the resulting loss of diversity in the decision making process. We study the potential benefits of using random classifier ensembles instead of a single classifier in the context of fairness-aware learning and demonstrate various attractive properties: (i) an ensemble of fair classifiers is guaranteed to be fair, for several different measures of fairness, (ii) an ensemble of unfair classifiers can still achieve fair outcomes, and (iii) an ensemble of classifiers can achieve better accuracy-fairness trade-offs than a single classifier. Finally, we introduce notions of distributional fairness to characterize further potential benefits of random classifier ensembles.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes