DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detection
This work addresses efficiency and accuracy challenges in skeleton-based video anomaly detection, which is important for surveillance and security applications, but it is incremental as it builds on existing TCN-GCN and normalizing flow approaches.
The paper tackles the problem of limited receptive fields and cross-dimension interactions in lightweight skeleton-based video anomaly detection models by proposing a Dual Attention Module (DAM) integrated into a normalizing flow framework (DA-Flow), achieving competitive or better performance than state-of-the-art methods with the fewest parameters, as shown by micro AUC metrics.
Cooperation between temporal convolutional networks (TCN) and graph convolutional networks (GCN) as a processing module has shown promising results in skeleton-based video anomaly detection (SVAD). However, to maintain a lightweight model with low computational and storage complexity, shallow GCN and TCN blocks are constrained by small receptive fields and a lack of cross-dimension interaction capture. To tackle this limitation, we propose a lightweight module called the Dual Attention Module (DAM) for capturing cross-dimension interaction relationships in spatio-temporal skeletal data. It employs the frame attention mechanism to identify the most significant frames and the skeleton attention mechanism to capture broader relationships across fixed partitions with minimal parameters and flops. Furthermore, the proposed Dual Attention Normalizing Flow (DA-Flow) integrates the DAM as a post-processing unit after GCN within the normalizing flow framework. Simulations show that the proposed model is robust against noise and negative samples. Experimental results show that DA-Flow reaches competitive or better performance than the existing state-of-the-art (SOTA) methods in terms of the micro AUC metric with the fewest number of parameters. Moreover, we found that even without training, simply using random projection without dimensionality reduction on skeleton data enables substantial anomaly detection capabilities.