Auxiliary Network: Scalable and agile online learning for dynamic system with inconsistently available inputs
This addresses the challenge of dynamic systems with unreliable input features, which is incremental as it builds on existing online learning methods.
The paper tackles the problem of streaming classification with inconsistently available inputs by proposing Auxiliary Network (Aux-Net), a scalable and agile deep learning model that uses a weighted ensemble of classifiers, achieving efficacy on a public dataset.
Streaming classification methods assume the number of input features is fixed and always received. But in many real-world scenarios demand is some input features are reliable while others are unreliable or inconsistent. In this paper, we propose a novel deep learning-based model called Auxiliary Network (Aux-Net), which is scalable and agile. It employs a weighted ensemble of classifiers to give a final outcome. The Aux-Net model is based on the hedging algorithm and online gradient descent. It employs a model of varying depth in an online setting using single pass learning. Aux-Net is a foundational work towards scalable neural network model for a dynamic complex environment requiring ad hoc or inconsistent input data. The efficacy of Aux-Net is shown on public dataset.