Single Image Super-Resolution via a Holistic Attention Network
This work addresses the challenge of preserving informative features in super-resolution for image processing applications, representing an incremental improvement.
The authors tackled the problem of single image super-resolution by proposing a holistic attention network (HAN) that models interdependencies among layers, channels, and positions, achieving favorable performance against state-of-the-art methods.
Informative features play a crucial role in the single image super-resolution task. Channel attention has been demonstrated to be effective for preserving information-rich features in each layer. However, channel attention treats each convolution layer as a separate process that misses the correlation among different layers. To address this problem, we propose a new holistic attention network (HAN), which consists of a layer attention module (LAM) and a channel-spatial attention module (CSAM), to model the holistic interdependencies among layers, channels, and positions. Specifically, the proposed LAM adaptively emphasizes hierarchical features by considering correlations among layers. Meanwhile, CSAM learns the confidence at all the positions of each channel to selectively capture more informative features. Extensive experiments demonstrate that the proposed HAN performs favorably against the state-of-the-art single image super-resolution approaches.