CVMar 19, 2018

Deja Vu: Motion Prediction in Static Images

arXiv:1803.06951v255 citations
AI Analysis

This addresses the challenge of inferring motion from still images for computer vision applications, representing a novel approach rather than an incremental improvement.

The paper tackles the problem of predicting motion from single static images by learning from video data, assuming similar appearance indicates similar motion patterns. The method demonstrates feasibility and provides valuable information for applications like action recognition and motion saliency.

This paper proposes motion prediction in single still images by learning it from a set of videos. The building assumption is that similar motion is characterized by similar appearance. The proposed method learns local motion patterns given a specific appearance and adds the predicted motion in a number of applications. This work (i) introduces a novel method to predict motion from appearance in a single static image, (ii) to that end, extends of the Structured Random Forest with regression derived from first principles, and (iii) shows the value of adding motion predictions in different tasks such as: weak frame-proposals containing unexpected events, action recognition, motion saliency. Illustrative results indicate that motion prediction is not only feasible, but also provides valuable information for a number of applications.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes