CVDec 29, 2022

Efficient Image Super-Resolution with Feature Interaction Weighted Hybrid Network

arXiv:2212.14181v232 citationsh-index: 53Has Code
Originality Incremental advance
AI Analysis

This work addresses image super-resolution for applications requiring low computational costs, representing an incremental improvement over prior methods.

The paper tackles the problem of lightweight image super-resolution by addressing intermediate feature loss in existing methods, proposing a Feature Interaction Weighted Hybrid Network (FIWHN) that achieves a favorable balance between performance and efficiency.

Lightweight image super-resolution aims to reconstruct high-resolution images from low-resolution images using low computational costs. However, existing methods result in the loss of middle-layer features due to activation functions. To minimize the impact of intermediate feature loss on reconstruction quality, we propose a Feature Interaction Weighted Hybrid Network (FIWHN), which comprises a series of Wide-residual Distillation Interaction Block (WDIB) as the backbone. Every third WDIB forms a Feature Shuffle Weighted Group (FSWG) by applying mutual information shuffle and fusion. Moreover, to mitigate the negative effects of intermediate feature loss, we introduce Wide Residual Weighting units within WDIB. These units effectively fuse features of varying levels of detail through a Wide-residual Distillation Connection (WRDC) and a Self-Calibrating Fusion (SCF). To compensate for global feature deficiencies, we incorporate a Transformer and explore a novel architecture to combine CNN and Transformer. We show that our FIWHN achieves a favorable balance between performance and efficiency through extensive experiments on low-level and high-level tasks. Codes will be available at \url{https://github.com/IVIPLab/FIWHN}.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes