CVNov 27, 2017

Discriminative Region Proposal Adversarial Networks for High-Quality Image-to-Image Translation

arXiv:1711.09554v360 citations
Originality Incremental advance
AI Analysis

This addresses the problem of improving visual fidelity in image-to-image translation for applications like computer vision and graphics, though it is incremental as it builds on existing GAN-based approaches.

The paper tackles the challenge of achieving high-quality, high-resolution, and photorealistic image-to-image translation by proposing Discriminative Region Proposal Adversarial Networks (DRPAN), which iteratively identifies and refines local artifacts to outperform state-of-the-art methods in perceptual and quantitative evaluations.

Image-to-image translation has been made much progress with embracing Generative Adversarial Networks (GANs). However, it's still very challenging for translation tasks that require high quality, especially at high-resolution and photorealism. In this paper, we present Discriminative Region Proposal Adversarial Networks (DRPAN) for high-quality image-to-image translation. We decompose the procedure of image-to-image translation task into three iterated steps, first is to generate an image with global structure but some local artifacts (via GAN), second is using our DRPnet to propose the most fake region from the generated image, and third is to implement "image inpainting" on the most fake region for more realistic result through a reviser, so that the system (DRPAN) can be gradually optimized to synthesize images with more attention on the most artifact local part. Experiments on a variety of image-to-image translation tasks and datasets validate that our method outperforms state-of-the-arts for producing high-quality translation results in terms of both human perceptual studies and automatic quantitative measures.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes