Extending Temporal Data Augmentation for Video Action Recognition
This work addresses the need for better data augmentation techniques in video action recognition, though it appears incremental as it builds on existing temporal augmentation methods.
The paper tackled the problem of under-explored temporal data augmentation for video action recognition by proposing novel enhancements to strengthen spatial-temporal relationships, achieving improved Top-1 and Top-5 results on UCF-101 and HMDB-51 datasets.
Pixel space augmentation has grown in popularity in many Deep Learning areas, due to its effectiveness, simplicity, and low computational cost. Data augmentation for videos, however, still remains an under-explored research topic, as most works have been treating inputs as stacks of static images rather than temporally linked series of data. Recently, it has been shown that involving the time dimension when designing augmentations can be superior to its spatial-only variants for video action recognition. In this paper, we propose several novel enhancements to these techniques to strengthen the relationship between the spatial and temporal domains and achieve a deeper level of perturbations. The video action recognition results of our techniques outperform their respective variants in Top-1 and Top-5 settings on the UCF-101 and the HMDB-51 datasets.