CVAINEOct 22, 2021

EvoGAN: An Evolutionary Computation Assisted GAN

arXiv:2110.11583v133 citations
Originality Synthesis-oriented
AI Analysis

This work addresses a domain-specific problem for facial expression synthesis, offering an incremental improvement by combining evolutionary computation with GANs to handle compound expressions.

The paper tackled the problem of generating diverse and complex compound facial expressions in image synthesis, which existing GANs struggle with, and proposed EvoGAN, an evolutionary algorithm-assisted GAN that successfully synthesizes images with target compound expressions, demonstrating feasibility and potential through experimental results.

The image synthesis technique is relatively well established which can generate facial images that are indistinguishable even by human beings. However, all of these approaches uses gradients to condition the output, resulting in the outputting the same image with the same input. Also, they can only generate images with basic expression or mimic an expression instead of generating compound expression. In real life, however, human expressions are of great diversity and complexity. In this paper, we propose an evolutionary algorithm (EA) assisted GAN, named EvoGAN, to generate various compound expressions with any accurate target compound expression. EvoGAN uses an EA to search target results in the data distribution learned by GAN. Specifically, we use the Facial Action Coding System (FACS) as the encoding of an EA and use a pre-trained GAN to generate human facial images, and then use a pre-trained classifier to recognize the expression composition of the synthesized images as the fitness function to guide the search of the EA. Combined random searching algorithm, various images with the target expression can be easily sythesized. Quantitative and Qualitative results are presented on several compound expressions, and the experimental results demonstrate the feasibility and the potential of EvoGAN.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes