RISE: Interactive Visual Diagnosis of Fairness in Machine Learning Models
This addresses the problem of opaque fairness evaluation for ML practitioners, though it is incremental as it builds on existing visualization and fairness concepts.
The paper tackles the challenge of diagnosing fairness issues in machine learning models under domain shift by introducing RISE, an interactive visualization tool that converts sorted residuals into interpretable patterns to expose localized disparities and accuracy-fairness trade-offs.
Evaluating fairness under domain shift is challenging because scalar metrics often obscure exactly where and how disparities arise. We introduce \textit{RISE} (Residual Inspection through Sorted Evaluation), an interactive visualization tool that converts sorted residuals into interpretable patterns. By connecting residual curve structures to formal fairness notions, RISE enables localized disparity diagnosis, subgroup comparison across environments, and the detection of hidden fairness issues. Through post-hoc analysis, RISE exposes accuracy-fairness trade-offs that aggregate statistics miss, supporting more informed model selection.