CVMar 1, 2023

Few-shots Portrait Generation with Style Enhancement and Identity Preservation

arXiv:2303.00377v12 citationsh-index: 7
Originality Incremental advance
AI Analysis

This addresses the need for AI-generated virtual digital humans in digital culture, though it appears incremental as it builds on existing GAN-based methods with specific enhancements.

The paper tackles the problem of generating personalized portraits with both artistic style and identity preservation, proposing StyleIdentityGAN which achieves superior artistry and identity effects compared to state-of-the-art methods, as demonstrated through qualitative, quantitative, and perceptual user studies.

Nowadays, the wide application of virtual digital human promotes the comprehensive prosperity and development of digital culture supported by digital economy. The personalized portrait automatically generated by AI technology needs both the natural artistic style and human sentiment. In this paper, we propose a novel StyleIdentityGAN model, which can ensure the identity and artistry of the generated portrait at the same time. Specifically, the style-enhanced module focuses on artistic style features decoupling and transferring to improve the artistry of generated virtual face images. Meanwhile, the identity-enhanced module preserves the significant features extracted from the input photo. Furthermore, the proposed method requires a small number of reference style data. Experiments demonstrate the superiority of StyleIdentityGAN over state-of-art methods in artistry and identity effects, with comparisons done qualitatively, quantitatively and through a perceptual user study. Code has been released on Github3.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes