Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining
This work addresses image deraining for computer vision applications, presenting an incremental improvement by integrating existing techniques like squeeze-and-excitation and recurrent networks into a novel architecture.
The paper tackles the problem of removing rain streaks from single images to improve visibility for computer vision algorithms, proposing a deep network that combines dilated convolutional neural networks, squeeze-and-excitation blocks, and recurrent neural networks, and it outperforms state-of-the-art methods on synthetic and real-world datasets.
Rain streaks can severely degrade the visibility, which causes many current computer vision algorithms fail to work. So it is necessary to remove the rain from images. We propose a novel deep network architecture based on deep convolutional and recurrent neural networks for single image deraining. As contextual information is very important for rain removal, we first adopt the dilated convolutional neural network to acquire large receptive field. To better fit the rain removal task, we also modify the network. In heavy rain, rain streaks have various directions and shapes, which can be regarded as the accumulation of multiple rain streak layers. We assign different alpha-values to various rain streak layers according to the intensity and transparency by incorporating the squeeze-and-excitation block. Since rain streak layers overlap with each other, it is not easy to remove the rain in one stage. So we further decompose the rain removal into multiple stages. Recurrent neural network is incorporated to preserve the useful information in previous stages and benefit the rain removal in later stages. We conduct extensive experiments on both synthetic and real-world datasets. Our proposed method outperforms the state-of-the-art approaches under all evaluation metrics. Codes and supplementary material are available at our project webpage: https://xialipku.github.io/RESCAN .