Histogram-guided Video Colorization Structure with Spatial-Temporal Connection
This work addresses video colorization for applications in media restoration and enhancement, but it appears incremental as it builds on existing methods with hybrid improvements.
The paper tackles the challenge of maintaining temporal consistency while ensuring high-quality colorization in video colorization, and the proposed ST-HVC method achieves excellent performance quantitatively and qualitatively on two video datasets.
Video colorization, aiming at obtaining colorful and plausible results from grayish frames, has aroused a lot of interest recently. Nevertheless, how to maintain temporal consistency while keeping the quality of colorized results remains challenging. To tackle the above problems, we present a Histogram-guided Video Colorization with Spatial-Temporal connection structure (named ST-HVC). To fully exploit the chroma and motion information, the joint flow and histogram module is tailored to integrate the histogram and flow features. To manage the blurred and artifact, we design a combination scheme attending to temporal detail and flow feature combination. We further recombine the histogram, flow and sharpness features via a U-shape network. Extensive comparisons are conducted with several state-of-the-art image and video-based methods, demonstrating that the developed method achieves excellent performance both quantitatively and qualitatively in two video datasets.