TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting
This work addresses the challenge of long-term forecasting in multivariate time series for applications requiring efficient and scalable models, representing an incremental improvement through architectural innovation.
The paper tackles long-term time-series forecasting by introducing TimeMachine, a model that uses a quadruple-Mamba architecture to capture long-term dependencies with linear scalability and small memory footprints, achieving superior performance in accuracy, scalability, and memory efficiency on benchmark datasets.
Long-term time-series forecasting remains challenging due to the difficulty in capturing long-term dependencies, achieving linear scalability, and maintaining computational efficiency. We introduce TimeMachine, an innovative model that leverages Mamba, a state-space model, to capture long-term dependencies in multivariate time series data while maintaining linear scalability and small memory footprints. TimeMachine exploits the unique properties of time series data to produce salient contextual cues at multi-scales and leverage an innovative integrated quadruple-Mamba architecture to unify the handling of channel-mixing and channel-independence situations, thus enabling effective selection of contents for prediction against global and local contexts at different scales. Experimentally, TimeMachine achieves superior performance in prediction accuracy, scalability, and memory efficiency, as extensively validated using benchmark datasets. Code availability: https://github.com/Atik-Ahamed/TimeMachine