Adaptive Learning Method of Recurrent Temporal Deep Belief Network to Analyze Time Series Data
This work addresses the challenge of optimizing deep learning architectures for time series data, which is an incremental improvement for researchers in machine learning and data analysis.
The authors tackled the problem of finding optimal network structures for deep belief networks (DBNs) in time series analysis by embedding an adaptive learning method into recurrent temporal RBMs, resulting in higher classification capability compared to conventional methods.
Deep Learning has the hierarchical network architecture to represent the complicated features of input patterns. Such architecture is well known to represent higher learning capability compared with some conventional models if the best set of parameters in the optimal network structure is found. We have been developing the adaptive learning method that can discover the optimal network structure in Deep Belief Network (DBN). The learning method can construct the network structure with the optimal number of hidden neurons in each Restricted Boltzmann Machine and with the optimal number of layers in the DBN during learning phase. The network structure of the learning method can be self-organized according to given input patterns of big data set. In this paper, we embed the adaptive learning method into the recurrent temporal RBM and the self-generated layer into DBN. In order to verify the effectiveness of our proposed method, the experimental results are higher classification capability than the conventional methods in this paper.