LGCRCYJun 7, 2022

FairVFL: A Fair Vertical Federated Learning Framework with Contrastive Adversarial Learning

Tencent
arXiv:2206.03200v249 citationsh-index: 55
Originality Incremental advance
AI Analysis

This addresses fairness and privacy issues in federated learning for real-world applications, but it is incremental as it builds on existing adversarial and contrastive learning methods.

The paper tackles the problem of bias in vertical federated learning (VFL) models due to fairness-sensitive features like gender, proposing FairVFL to improve fairness while preserving privacy. Experiments on three real-world datasets show it effectively enhances model fairness with privacy protection.

Vertical federated learning (VFL) is a privacy-preserving machine learning paradigm that can learn models from features distributed on different platforms in a privacy-preserving way. Since in real-world applications the data may contain bias on fairness-sensitive features (e.g., gender), VFL models may inherit bias from training data and become unfair for some user groups. However, existing fair machine learning methods usually rely on the centralized storage of fairness-sensitive features to achieve model fairness, which are usually inapplicable in federated scenarios. In this paper, we propose a fair vertical federated learning framework (FairVFL), which can improve the fairness of VFL models. The core idea of FairVFL is to learn unified and fair representations of samples based on the decentralized feature fields in a privacy-preserving way. Specifically, each platform with fairness-insensitive features first learns local data representations from local features. Then, these local representations are uploaded to a server and aggregated into a unified representation for the target task. In order to learn a fair unified representation, we send it to each platform storing fairness-sensitive features and apply adversarial learning to remove bias from the unified representation inherited from the biased data. Moreover, for protecting user privacy, we further propose a contrastive adversarial learning method to remove private information from the unified representation in server before sending it to the platforms keeping fairness-sensitive features. Experiments on three real-world datasets validate that our method can effectively improve model fairness with user privacy well-protected.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes