CVMay 16, 2024

Driving-Video Dehazing with Non-Aligned Regularization for Safety Assistance

arXiv:2405.09996v227 citationsh-index: 26CVPR
Originality Incremental advance
AI Analysis

This addresses the problem of poor visibility in driving videos for safety assistance, though it is incremental as it builds on existing dehazing techniques with a novel matching approach.

The paper tackles the challenge of real driving-video dehazing by proposing a non-aligned regularization strategy that uses clear frames as references to supervise a video dehazing network, achieving superior performance over state-of-the-art methods.

Real driving-video dehazing poses a significant challenge due to the inherent difficulty in acquiring precisely aligned hazy/clear video pairs for effective model training, especially in dynamic driving scenarios with unpredictable weather conditions. In this paper, we propose a pioneering approach that addresses this challenge through a nonaligned regularization strategy. Our core concept involves identifying clear frames that closely match hazy frames, serving as references to supervise a video dehazing network. Our approach comprises two key components: reference matching and video dehazing. Firstly, we introduce a non-aligned reference frame matching module, leveraging an adaptive sliding window to match high-quality reference frames from clear videos. Video dehazing incorporates flow-guided cosine attention sampler and deformable cosine attention fusion modules to enhance spatial multiframe alignment and fuse their improved information. To validate our approach, we collect a GoProHazy dataset captured effortlessly with GoPro cameras in diverse rural and urban road environments. Extensive experiments demonstrate the superiority of the proposed method over current state-of-the-art methods in the challenging task of real driving-video dehazing. Project page.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes