CVOct 19, 2023

ExtSwap: Leveraging Extended Latent Mapper for Generating High Quality Face Swapping

arXiv:2310.12736v14 citationsh-index: 26
Originality Incremental advance
AI Analysis

This addresses the problem of generating high-quality face-swapped images for computer vision applications, representing an incremental improvement over existing methods.

The paper tackles the problem of entangled representations in face swapping by proposing a method that disentangles identity and attribute features separately, then maps them into StyleGAN's extended latent space. The method outperforms state-of-the-art face swapping methods both qualitatively and quantitatively.

We present a novel face swapping method using the progressively growing structure of a pre-trained StyleGAN. Previous methods use different encoder decoder structures, embedding integration networks to produce high-quality results, but their quality suffers from entangled representation. We disentangle semantics by deriving identity and attribute features separately. By learning to map the concatenated features into the extended latent space, we leverage the state-of-the-art quality and its rich semantic extended latent space. Extensive experiments suggest that the proposed method successfully disentangles identity and attribute features and outperforms many state-of-the-art face swapping methods, both qualitatively and quantitatively.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes