Deep Learning for Video Classification and Captioning
It provides a survey of methods and benchmarks for video understanding, addressing the need to process large-scale video data, but is incremental as it focuses on reviewing existing research.
This paper reviews deep learning approaches for video classification, which labels video clips by semantic content, and video captioning, which generates descriptive sentences to capture video dynamics.
Accelerated by the tremendous increase in Internet bandwidth and storage space, video data has been generated, published and spread explosively, becoming an indispensable part of today's big data. In this paper, we focus on reviewing two lines of research aiming to stimulate the comprehension of videos with deep learning: video classification and video captioning. While video classification concentrates on automatically labeling video clips based on their semantic contents like human actions or complex events, video captioning attempts to generate a complete and natural sentence, enriching the single label as in video classification, to capture the most informative dynamics in videos. In addition, we also provide a review of popular benchmarks and competitions, which are critical for evaluating the technical progress of this vibrant field.