CVFeb 17, 2023

LDFA: Latent Diffusion Face Anonymization for Self-driving Applications

arXiv:2302.08931v137 citationsh-index: 27
Originality Incremental advance
AI Analysis

This addresses data protection needs for vulnerable road users in self-driving applications, but it is incremental as it builds on existing diffusion models for a specific domain.

The paper tackles face anonymization in intelligent transportation systems by introducing a two-stage pipeline using latent diffusion models, which achieves comparable performance to GAN-based methods and improves face detection mAP scores.

In order to protect vulnerable road users (VRUs), such as pedestrians or cyclists, it is essential that intelligent transportation systems (ITS) accurately identify them. Therefore, datasets used to train perception models of ITS must contain a significant number of vulnerable road users. However, data protection regulations require that individuals are anonymized in such datasets. In this work, we introduce a novel deep learning-based pipeline for face anonymization in the context of ITS. In contrast to related methods, we do not use generative adversarial networks (GANs) but build upon recent advances in diffusion models. We propose a two-stage method, which contains a face detection model followed by a latent diffusion model to generate realistic face in-paintings. To demonstrate the versatility of anonymized images, we train segmentation methods on anonymized data and evaluate them on non-anonymized data. Our experiment reveal that our pipeline is better suited to anonymize data for segmentation than naive methods and performes comparably with recent GAN-based methods. Moreover, face detectors achieve higher mAP scores for faces anonymized by our method compared to naive or recent GAN-based methods.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes