Inception-inspired LSTM for Next-frame Video Prediction
This addresses video prediction for applications like autonomous vehicles or robotics, but it is incremental as it combines existing inception and LSTM ideas.
The paper tackles video frame prediction by proposing an unsupervised deep-learning method called Inception-based LSTM, which outperforms convolutional LSTM on KITTI and KTH datasets, with Inception LSTM showing better prediction performance but higher computational cost than Inception v2 LSTM.
The problem of video frame prediction has received much interest due to its relevance to many computer vision applications such as autonomous vehicles or robotics. Supervised methods for video frame prediction rely on labeled data, which may not always be available. In this paper, we provide a novel unsupervised deep-learning method called Inception-based LSTM for video frame prediction. The general idea of inception networks is to implement wider networks instead of deeper networks. This network design was shown to improve the performance of image classification. The proposed method is evaluated on both Inception-v1 and Inception-v2 structures. The proposed Inception LSTM methods are compared with convolutional LSTM when applied using PredNet predictive coding framework for both the KITTI and KTH data sets. We observed that the Inception based LSTM outperforms the convolutional LSTM. Also, Inception LSTM has better prediction performance compared to Inception v2 LSTM. However, Inception v2 LSTM has a lower computational cost compared to Inception LSTM.