CVIVDec 31, 2020

FGF-GAN: A Lightweight Generative Adversarial Network for Pansharpening via Fast Guided Filter

arXiv:2101.00062v226 citations
Originality Incremental advance
AI Analysis

This work provides an incremental improvement for remote sensing image enhancement by offering a more efficient pansharpening method.

This paper addresses the challenge of pansharpening, which involves fusing high-resolution panchromatic images with low-resolution multi-spectral images to produce high-resolution multi-spectral images. The proposed FGF-GAN achieves high-quality HRMS images with fewer parameters compared to existing methods.

Pansharpening is a widely used image enhancement technique for remote sensing. Its principle is to fuse the input high-resolution single-channel panchromatic (PAN) image and low-resolution multi-spectral image and to obtain a high-resolution multi-spectral (HRMS) image. The existing deep learning pansharpening method has two shortcomings. First, features of two input images need to be concatenated along the channel dimension to reconstruct the HRMS image, which makes the importance of PAN images not prominent, and also leads to high computational cost. Second, the implicit information of features is difficult to extract through the manually designed loss function. To this end, we propose a generative adversarial network via the fast guided filter (FGF) for pansharpening. In generator, traditional channel concatenation is replaced by FGF to better retain the spatial information while reducing the number of parameters. Meanwhile, the fusion objects can be highlighted by the spatial attention module. In addition, the latent information of features can be preserved effectively through adversarial training. Numerous experiments illustrate that our network generates high-quality HRMS images that can surpass existing methods, and with fewer parameters.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes