Learning Blind Motion Deblurring
This addresses the issue of blurry videos from handheld cameras, which is a common problem for smartphone users, but the approach is incremental as it builds on existing neural network methods.
The paper tackles the problem of blind motion deblurring in videos by proposing a method to generate realistic training data and a recurrent network that uses temporal information, demonstrating its effectiveness on real-world examples.
As handheld video cameras are now commonplace and available in every smartphone, images and videos can be recorded almost everywhere at anytime. However, taking a quick shot frequently yields a blurry result due to unwanted camera shake during recording or moving objects in the scene. Removing these artifacts from the blurry recordings is a highly ill-posed problem as neither the sharp image nor the motion blur kernel is known. Propagating information between multiple consecutive blurry observations can help restore the desired sharp image or video. Solutions for blind deconvolution based on neural networks rely on a massive amount of ground-truth data which is hard to acquire. In this work, we propose an efficient approach to produce a significant amount of realistic training data and introduce a novel recurrent network architecture to deblur frames taking temporal information into account, which can efficiently handle arbitrary spatial and temporal input sizes. We demonstrate the versatility of our approach in a comprehensive comparison on a number of challening real-world examples.