xLSTM-Mixer: Multivariate Time Series Forecasting by Mixing via Scalar Memories
This work addresses forecasting challenges in fields with time series data by proposing a novel hybrid model, though it is incremental as it combines existing recurrent and mixing techniques.
The paper tackled multivariate time series forecasting by introducing xLSTM-Mixer, which integrates temporal and multivariate patterns through a mixing architecture, achieving superior long-term performance with low memory usage compared to state-of-the-art methods.
Time series data is prevalent across numerous fields, necessitating the development of robust and accurate forecasting models. Capturing patterns both within and between temporal and multivariate components is crucial for reliable predictions. We introduce xLSTM-Mixer, a model designed to effectively integrate temporal sequences, joint time-variate information, and multiple perspectives for robust forecasting. Our approach begins with a linear forecast shared across variates, which is then refined by xLSTM blocks. They serve as key elements for modeling the complex dynamics of challenging time series data. xLSTM-Mixer ultimately reconciles two distinct views to produce the final forecast. Our extensive evaluations demonstrate its superior long-term forecasting performance compared to recent state-of-the-art methods while requiring very little memory. A thorough model analysis provides further insights into its key components and confirms its robustness and effectiveness. This work contributes to the resurgence of recurrent models in forecasting by combining them, for the first time, with mixing architectures.