LGAOJun 14, 2021

Next Generation Reservoir Computing

arXiv:2106.07688v2597 citations
Originality Incremental advance
AI Analysis

This is an incremental improvement for researchers in dynamical systems and time-series analysis, offering a more efficient and interpretable alternative.

The paper tackled the limitations of traditional reservoir computing, such as random matrices and many metaparameters, by showing that nonlinear vector autoregression outperforms it on benchmark tasks with even shorter training data and time.

Reservoir computing is a best-in-class machine learning algorithm for processing information generated by dynamical systems using observed time-series data. Importantly, it requires very small training data sets, uses linear optimization, and thus requires minimal computing resources. However, the algorithm uses randomly sampled matrices to define the underlying recurrent neural network and has a multitude of metaparameters that must be optimized. Recent results demonstrate the equivalence of reservoir computing to nonlinear vector autoregression, which requires no random matrices, fewer metaparameters, and provides interpretable results. Here, we demonstrate that nonlinear vector autoregression excels at reservoir computing benchmark tasks and requires even shorter training data sets and training time, heralding the next generation of reservoir computing.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes