IVCVMar 29, 2021

Best-Buddy GANs for Highly Detailed Image Super-Resolution

arXiv:2103.15295v391 citations
Originality Highly original
AI Analysis

This work addresses the challenge of producing realistic details in super-resolution for applications like image enhancement and restoration, offering a novel approach to improve flexibility and detail generation.

The paper tackles the single image super-resolution problem by proposing Best-Buddy GANs (Beby-GAN) to generate more realistic and detailed high-resolution images from low-resolution inputs, achieving state-of-the-art results with improved perceptual quality and reduced artifacts.

We consider the single image super-resolution (SISR) problem, where a high-resolution (HR) image is generated based on a low-resolution (LR) input. Recently, generative adversarial networks (GANs) become popular to hallucinate details. Most methods along this line rely on a predefined single-LR-single-HR mapping, which is not flexible enough for the SISR task. Also, GAN-generated fake details may often undermine the realism of the whole image. We address these issues by proposing best-buddy GANs (Beby-GAN) for rich-detail SISR. Relaxing the immutable one-to-one constraint, we allow the estimated patches to dynamically seek the best supervision during training, which is beneficial to producing more reasonable details. Besides, we propose a region-aware adversarial learning strategy that directs our model to focus on generating details for textured areas adaptively. Extensive experiments justify the effectiveness of our method. An ultra-high-resolution 4K dataset is also constructed to facilitate future super-resolution research.

Code Implementations2 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes