Face Beautification: Beyond Makeup Transfer
This work addresses the problem of enhancing facial appearance in digital media for applications like social media or entertainment, but it is incremental as it builds on existing style-based synthesis and beauty prediction methods.
The paper tackles virtual face beautification by proposing a GAN-based framework that translates an inquiry face into multiple beautified images using style-based beauty representation and beauty score prediction, achieving effective and flexible results as demonstrated in experiments.
Facial appearance plays an important role in our social lives. Subjective perception of women's beauty depends on various face-related (e.g., skin, shape, hair) and environmental (e.g., makeup, lighting, angle) factors. Similar to cosmetic surgery in the physical world, virtual face beautification is an emerging field with many open issues to be addressed. Inspired by the latest advances in style-based synthesis and face beauty prediction, we propose a novel framework of face beautification. For a given reference face with a high beauty score, our GAN-based architecture is capable of translating an inquiry face into a sequence of beautified face images with referenced beauty style and targeted beauty score values. To achieve this objective, we propose to integrate both style-based beauty representation (extracted from the reference face) and beauty score prediction (trained on SCUT-FBP database) into the process of beautification. Unlike makeup transfer, our approach targets at many-to-many (instead of one-to-one) translation where multiple outputs can be defined by either different references or varying beauty scores. Extensive experimental results are reported to demonstrate the effectiveness and flexibility of the proposed face beautification framework.