Online Sequential Extreme Learning Machines: Features Combined From Hundreds of Midlayers
This work addresses the problem of efficient and accurate learning in neural networks for researchers and practitioners, though it appears incremental as it builds upon existing online sequential extreme learning machine methods.
The paper tackles the challenge of improving inference accuracy and learning speed in feedforward networks by developing a hierarchical online sequential learning algorithm (H-OS-ELM) that combines features from hundreds of midlayers, resulting in enhanced computational efficiency and generalization performance.
In this paper, we develop an algorithm called hierarchal online sequential learning algorithm (H-OS-ELM) for single feed feedforward network with features combined from hundreds of midlayers, the algorithm can learn chunk by chunk with fixed or varying block size, we believe that the diverse selectivity of neurons in top layers which consists of encoded distributed information produced by the other neurons offers better computational advantage over inference accuracy. Thus this paper proposes a Hierarchical model framework combined with Online-Sequential learning algorithm, Firstly the model consists of subspace feature extractor which consists of subnetwork neuron, using the sub-features which is result of the feature extractor in first layer of the hierarchy we get rid of irrelevant factors which are of no use for the learning and iterate this process so that to recast the the subfeatures into the hierarchical model to be processed into more acceptable cognition. Secondly by using OS-Elm we are using non-iterative style for learning we are implementing a network which is wider and shallow which plays a important role in generalizing the overall performance which in turn boosts up the learning speed