CVLGJul 9, 2021

White-Box Cartoonization Using An Extended GAN Framework

arXiv:2107.04551v17 citations
Originality Incremental advance
AI Analysis

This provides a white-box controllable method for image cartoonization, which is incremental as it builds on existing GAN frameworks.

The authors tackled the problem of generating high-quality cartoon images and videos from real-world photos by extending a GAN framework with three distinct representations (surface, structure, texture), resulting in improved clarity, colors, textures, and shapes while maintaining cartoon characteristics.

In the present study, we propose to implement a new framework for estimating generative models via an adversarial process to extend an existing GAN framework and develop a white-box controllable image cartoonization, which can generate high-quality cartooned images/videos from real-world photos and videos. The learning purposes of our system are based on three distinct representations: surface representation, structure representation, and texture representation. The surface representation refers to the smooth surface of the images. The structure representation relates to the sparse colour blocks and compresses generic content. The texture representation shows the texture, curves, and features in cartoon images. Generative Adversarial Network (GAN) framework decomposes the images into different representations and learns from them to generate cartoon images. This decomposition makes the framework more controllable and flexible which allows users to make changes based on the required output. This approach overcomes any previous system in terms of maintaining clarity, colours, textures, shapes of images yet showing the characteristics of cartoon images.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes