Fast Optical Flow using Dense Inverse Search
This addresses the need for real-time optical flow in applications like tracking and activity detection, offering a significant speed improvement while maintaining accuracy.
The paper tackles the problem of high time complexity in optical flow extraction by proposing a fast method with competitive accuracy, achieving speeds of 300-600Hz on a single CPU core, which is orders of magnitude faster than state-of-the-art methods.
Most recent works in optical flow extraction focus on the accuracy and neglect the time complexity. However, in real-life visual applications, such as tracking, activity detection and recognition, the time complexity is critical. We propose a solution with very low time complexity and competitive accuracy for the computation of dense optical flow. It consists of three parts: 1) inverse search for patch correspondences; 2) dense displacement field creation through patch aggregation along multiple scales; 3) variational refinement. At the core of our Dense Inverse Search-based method (DIS) is the efficient search of correspondences inspired by the inverse compositional image alignment proposed by Baker and Matthews in 2001. DIS is competitive on standard optical flow benchmarks with large displacements. DIS runs at 300Hz up to 600Hz on a single CPU core, reaching the temporal resolution of human's biological vision system. It is order(s) of magnitude faster than state-of-the-art methods in the same range of accuracy, making DIS ideal for visual applications.