Time-Series Forecasting and Sequence Learning Using Memristor-based Reservoir System
This work addresses the problem of local processing and learning for time-series data on edge devices, offering an incremental improvement in energy efficiency and robustness.
The authors tackled the challenge of efficient time-series forecasting on resource-constrained edge devices by developing a memristor-based echo state network accelerator, achieving a 247X reduction in energy consumption compared to a CMOS digital design while maintaining reasonable robustness with device failure below 10%.
Pushing the frontiers of time-series information processing in the ever-growing domain of edge devices with stringent resources has been impeded by the systems' ability to process information and learn locally on the device. Local processing and learning of time-series information typically demand intensive computations and massive storage as the process involves retrieving information and tuning hundreds of parameters back in time. In this work, we developed a memristor-based echo state network accelerator that features efficient temporal data processing and in-situ online learning. The proposed design is benchmarked using various datasets involving real-world tasks, such as forecasting the load energy consumption and weather conditions. The experimental results illustrate that the hardware model experiences a marginal degradation in performance as compared to the software counterpart. This is mainly attributed to the limited precision and dynamic range of network parameters when emulated using memristor devices. The proposed system is evaluated for lifespan, robustness, and energy-delay product. It is observed that the system demonstrates reasonable robustness for device failure below 10%, which may occur due to stuck-at faults. Furthermore, 247X reduction in energy consumption is achieved when compared to a custom CMOS digital design implemented at the same technology node.