EvTurb: Event Camera Guided Turbulence Removal
This addresses image quality issues for computer vision tasks in turbulent environments, representing a novel approach by integrating event cameras.
The paper tackles the problem of atmospheric turbulence degrading image quality by introducing blur and tilt distortions, proposing EvTurb, an event-guided framework that decouples these effects using high-speed event streams, and it surpasses state-of-the-art methods while being computationally efficient.
Atmospheric turbulence degrades image quality by introducing blur and geometric tilt distortions, posing significant challenges to downstream computer vision tasks. Existing single-image and multi-frame methods struggle with the highly ill-posed nature of this problem due to the compositional complexity of turbulence-induced distortions. To address this, we propose EvTurb, an event guided turbulence removal framework that leverages high-speed event streams to decouple blur and tilt effects. EvTurb decouples blur and tilt effects by modeling event-based turbulence formation, specifically through a novel two-step event-guided network: event integrals are first employed to reduce blur in the coarse outputs. This is followed by employing a variance map, derived from raw event streams, to eliminate the tilt distortion for the refined outputs. Additionally, we present TurbEvent, the first real-captured dataset featuring diverse turbulence scenarios. Experimental results demonstrate that EvTurb surpasses state-of-the-art methods while maintaining computational efficiency.