VS-Net: Multiscale Spatiotemporal Features for Lightweight Video Salient Document Detection
This addresses the need for efficient VSDD in resource-constrained settings, offering a practical solution for computer vision applications, though it appears incremental as it builds on existing techniques with specific enhancements.
The paper tackles the problem of Video Salient Document Detection (VSDD) by proposing VS-Net, a lightweight model that uses multi-scale spatiotemporal features to highlight document regions in videos, achieving state-of-the-art performance on the MIDV-500 dataset with improved time and robustness measures.
Video Salient Document Detection (VSDD) is an essential task of practical computer vision, which aims to highlight visually salient document regions in video frames. Previous techniques for VSDD focus on learning features without considering the cooperation among and across the appearance and motion cues and thus fail to perform in practical scenarios. Moreover, most of the previous techniques demand high computational resources, which limits the usage of such systems in resource-constrained settings. To handle these issues, we propose VS-Net, which captures multi-scale spatiotemporal information with the help of dilated depth-wise separable convolution and Approximation Rank Pooling. VS-Net extracts the key features locally from each frame across embedding sub-spaces and forwards the features between adjacent and parallel nodes, enhancing model performance globally. Our model generates saliency maps considering both the background and foreground simultaneously, making it perform better in challenging scenarios. The immense experiments regulated on the benchmark MIDV-500 dataset show that the VS-Net model outperforms state-of-the-art approaches in both time and robustness measures.