CVAIFeb 22, 2017

Unsupervised Diverse Colorization via Generative Adversarial Networks

arXiv:1702.06674v2184 citations
Originality Incremental advance
AI Analysis

This addresses the need for diverse and realistic colorization in computer vision, offering an incremental improvement over previous single-output methods.

The paper tackles the problem of generating multiple realistic colorizations for a single grayscale image by proposing an unsupervised method using conditional generative adversarial networks, achieving highly competitive performance on the LSUN bedroom dataset and high human convincibility in a Turing test.

Colorization of grayscale images has been a hot topic in computer vision. Previous research mainly focuses on producing a colored image to match the original one. However, since many colors share the same gray value, an input grayscale image could be diversely colored while maintaining its reality. In this paper, we design a novel solution for unsupervised diverse colorization. Specifically, we leverage conditional generative adversarial networks to model the distribution of real-world item colors, in which we develop a fully convolutional generator with multi-layer noise to enhance diversity, with multi-layer condition concatenation to maintain reality, and with stride 1 to keep spatial information. With such a novel network architecture, the model yields highly competitive performance on the open LSUN bedroom dataset. The Turing test of 80 humans further indicates our generated color schemes are highly convincible.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes