CVSep 26, 2023

Face Cartoonisation For Various Poses Using StyleGAN

arXiv:2309.14908v1h-index: 5
Originality Incremental advance
AI Analysis

This addresses the problem of generating consistent cartoon faces from varied poses for applications in entertainment or social media, representing an incremental improvement over existing StyleGAN-based approaches.

The paper tackles face cartoonization across different poses while preserving identity by using an encoder to map images into StyleGAN's latent space, then generating cartoons with a pre-trained generator, achieving improved identity preservation compared to previous methods.

This paper presents an innovative approach to achieve face cartoonisation while preserving the original identity and accommodating various poses. Unlike previous methods in this field that relied on conditional-GANs, which posed challenges related to dataset requirements and pose training, our approach leverages the expressive latent space of StyleGAN. We achieve this by introducing an encoder that captures both pose and identity information from images and generates a corresponding embedding within the StyleGAN latent space. By subsequently passing this embedding through a pre-trained generator, we obtain the desired cartoonised output. While many other approaches based on StyleGAN necessitate a dedicated and fine-tuned StyleGAN model, our method stands out by utilizing an already-trained StyleGAN designed to produce realistic facial images. We show by extensive experimentation how our encoder adapts the StyleGAN output to better preserve identity when the objective is cartoonisation.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes