PatchBatch: a Batch Augmented Loss for Optical Flow
This addresses optical flow estimation for computer vision applications, representing an incremental improvement with specific technical innovations.
The paper tackles optical flow computation by proposing a pipeline using Siamese CNNs for descriptor computation and an innovative batch-augmented loss function, achieving state-of-the-art performance on challenging benchmarks.
We propose a new pipeline for optical flow computation, based on Deep Learning techniques. We suggest using a Siamese CNN to independently, and in parallel, compute the descriptors of both images. The learned descriptors are then compared efficiently using the L2 norm and do not require network processing of patch pairs. The success of the method is based on an innovative loss function that computes higher moments of the loss distributions for each training batch. Combined with an Approximate Nearest Neighbor patch matching method and a flow interpolation technique, state of the art performance is obtained on the most challenging and competitive optical flow benchmarks.