CVOct 19, 2021

Synthetic Temporal Anomaly Guided End-to-End Video Anomaly Detection

arXiv:2110.09768v168 citations
Originality Incremental advance
AI Analysis

This work addresses the issue of autoencoders reconstructing anomalies in video anomaly detection, which is an incremental improvement for surveillance and security applications.

The paper tackles the problem of video anomaly detection by proposing a method to improve autoencoder performance using synthetic temporal anomalies, achieving state-of-the-art results on three challenging datasets.

Due to the limited availability of anomaly examples, video anomaly detection is often seen as one-class classification (OCC) problem. A popular way to tackle this problem is by utilizing an autoencoder (AE) trained only on normal data. At test time, the AE is then expected to reconstruct the normal input well while reconstructing the anomalies poorly. However, several studies show that, even with normal data only training, AEs can often start reconstructing anomalies as well which depletes their anomaly detection performance. To mitigate this, we propose a temporal pseudo anomaly synthesizer that generates fake-anomalies using only normal data. An AE is then trained to maximize the reconstruction loss on pseudo anomalies while minimizing this loss on normal data. This way, the AE is encouraged to produce distinguishable reconstructions for normal and anomalous frames. Extensive experiments and analysis on three challenging video anomaly datasets demonstrate the effectiveness of our approach to improve the basic AEs in achieving superiority against several existing state-of-the-art models.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes