CVAILGAug 16, 2017

Limiting the Reconstruction Capability of Generative Neural Network using Negative Learning

arXiv:1708.08985v154 citations
AI Analysis

This addresses anomaly detection for applications like obstacle detection, but it appears incremental as it builds on existing generative models.

The paper tackles the problem of limiting generative neural networks to produce only a single type of input, using negative learning to improve anomaly detection, with results showing significant performance improvements.

Generative models are widely used for unsupervised learning with various applications, including data compression and signal restoration. Training methods for such systems focus on the generality of the network given limited amount of training data. A less researched type of techniques concerns generation of only a single type of input. This is useful for applications such as constraint handling, noise reduction and anomaly detection. In this paper we present a technique to limit the generative capability of the network using negative learning. The proposed method searches the solution in the gradient direction for the desired input and in the opposite direction for the undesired input. One of the application can be anomaly detection where the undesired inputs are the anomalous data. In the results section we demonstrate the features of the algorithm using MNIST handwritten digit dataset and latter apply the technique to a real-world obstacle detection problem. The results clearly show that the proposed learning technique can significantly improve the performance for anomaly detection.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes