CVJun 19, 2024

ECAFormer: Low-light Image Enhancement using Cross Attention

arXiv:2406.13281v35 citations
Originality Incremental advance
AI Analysis

This work addresses the problem of detail loss in low-light images for computer vision applications, presenting an incremental advancement in method design.

The paper tackles low-light image enhancement by proposing ECAFormer, a transformer-based architecture that uses cross-attention to improve feature interaction across scales, achieving a nearly 3% PSNR improvement over prior methods.

Low-light image enhancement (LLIE) is critical in computer vision. Existing LLIE methods often fail to discover the underlying relationships between different sub-components, causing the loss of complementary information between multiple modules and network layers, ultimately resulting in the loss of image details. To beat this shortage, we design a hierarchical mutual Enhancement via a Cross Attention transformer (ECAFormer), which introduces an architecture that enables concurrent propagation and interaction of multiple features. The model preserves detailed information by introducing a Dual Multi-head self-attention (DMSA), which leverages visual and semantic features across different scales, allowing them to guide and complement each other. Besides, a Cross-Scale DMSA block is introduced to capture the residual connection, integrating cross-layer information to further enhance image detail. Experimental results show that ECAFormer reaches competitive performance across multiple benchmarks, yielding nearly a 3% improvement in PSNR over the suboptimal method, demonstrating the effectiveness of information interaction in LLIE.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes