QSAM-Net: Rain streak removal by quaternion neural network with self-attention module
It addresses degraded image quality in remote sensing and surveillance for applications requiring near real-time performance, though it is incremental as it builds on existing neural network approaches.
The paper tackles the problem of rain streak removal in images by proposing QSAM-Net, a quaternion neural network with a self-attention module, which reduces parameters by a factor of 3.98 compared to prior methods and improves visual quality, object detection accuracy, and training speed.
Images captured in real-world applications in remote sensing, image or video retrieval, and outdoor surveillance suffer degraded quality introduced by poor weather conditions. Conditions such as rain and mist, introduce artifacts that make visual analysis challenging and limit the performance of high-level computer vision methods. For time-critical applications where a rapid response is necessary, it becomes crucial to develop algorithms that automatically remove rain, without diminishing the quality of the image contents. This article aims to develop a novel quaternion multi-stage multiscale neural network with a self-attention module called QSAM-Net to remove rain streaks. The novelty of this algorithm is that it requires significantly fewer parameters by a factor of 3.98, over prior methods, while improving visual quality. This is demonstrated by the extensive evaluation and benchmarking on synthetic and real-world rainy images. This feature of QSAM-Net makes the network suitable for implementation on edge devices and applications requiring near real-time performance. The experiments demonstrate that by improving the visual quality of images. In addition, object detection accuracy and training speed are also improved.