MyStyle++: A Controllable Personalized Generative Prior
This work addresses the need for more controllable personalization in generative models for face editing applications, representing an incremental improvement over existing methods.
The paper tackles the problem of lacking precise attribute control in personalized generative priors for face images, proposing MyStyle++ which organizes the latent space to enable controllable synthesis, editing, and enhancement while preserving individual facial features.
In this paper, we propose an approach to obtain a personalized generative prior with explicit control over a set of attributes. We build upon MyStyle, a recently introduced method, that tunes the weights of a pre-trained StyleGAN face generator on a few images of an individual. This system allows synthesizing, editing, and enhancing images of the target individual with high fidelity to their facial features. However, MyStyle does not demonstrate precise control over the attributes of the generated images. We propose to address this problem through a novel optimization system that organizes the latent space in addition to tuning the generator. Our key contribution is to formulate a loss that arranges the latent codes, corresponding to the input images, along a set of specific directions according to their attributes. We demonstrate that our approach, dubbed MyStyle++, is able to synthesize, edit, and enhance images of an individual with great control over the attributes, while preserving the unique facial characteristics of that individual.