Automatic Image Colorization with Convolutional Neural Networks and Generative Adversarial Networks
This addresses the challenge of adding colors to grayscale images for applications like color restoration and animation, but it is incremental as it builds on existing methods.
The paper tackles the ill-posed problem of automatic image colorization by exploring methods based on classification and adversarial learning, building on prior works with modifications for specific scenarios and comparisons.
Image colorization, the task of adding colors to grayscale images, has been the focus of significant research efforts in computer vision in recent years for its various application areas such as color restoration and automatic animation colorization [15, 1]. The colorization problem is challenging as it is highly ill-posed with two out of three image dimensions lost, resulting in large degrees of freedom. However, semantics of the scene as well as the surface texture could provide important cues for colors: the sky is typically blue, the clouds are typically white and the grass is typically green, and there are huge amounts of training data available for learning such priors since any colored image could serve as a training data point [20]. Colorization is initially formulated as a regression task[5], which ignores the multi-modal nature of color prediction. In this project, we explore automatic image colorization via classification and adversarial learning. We will build our models on prior works, apply modifications for our specific scenario and make comparisons.