HMANet: Hybrid Multi-Axis Aggregation Network for Image Super-Resolution
This work addresses a bottleneck in super-resolution for computer vision applications, offering an incremental improvement over existing Transformer-based approaches.
The paper tackles the problem of limited spatial range in Transformer-based super-resolution methods by proposing HMANet, a Hybrid Multi-Axis Aggregation network that combines channel attention and self-attention to enhance feature fusion. Experimental results show it outperforms state-of-the-art methods on benchmark datasets.
Transformer-based methods have demonstrated excellent performance on super-resolution visual tasks, surpassing conventional convolutional neural networks. However, existing work typically restricts self-attention computation to non-overlapping windows to save computational costs. This means that Transformer-based networks can only use input information from a limited spatial range. Therefore, a novel Hybrid Multi-Axis Aggregation network (HMA) is proposed in this paper to exploit feature potential information better. HMA is constructed by stacking Residual Hybrid Transformer Blocks(RHTB) and Grid Attention Blocks(GAB). On the one side, RHTB combines channel attention and self-attention to enhance non-local feature fusion and produce more attractive visual results. Conversely, GAB is used in cross-domain information interaction to jointly model similar features and obtain a larger perceptual field. For the super-resolution task in the training phase, a novel pre-training method is designed to enhance the model representation capabilities further and validate the proposed model's effectiveness through many experiments. The experimental results show that HMA outperforms the state-of-the-art methods on the benchmark dataset. We provide code and models at https://github.com/korouuuuu/HMA.