Unlocking the Potential of Linear Networks for Irregular Multivariate Time Series Forecasting
This addresses forecasting challenges in industries like finance and healthcare where data is often irregular, representing a novel method for a known bottleneck rather than an incremental improvement.
The paper tackled the problem of forecasting irregular multivariate time series with variable sampling intervals and missing values by introducing AiT, a model that uses an adaptive linear network and Transformer module, resulting in an 11% improvement in prediction accuracy and a 52% reduction in runtime compared to state-of-the-art methods.
Time series forecasting holds significant importance across various industries, including finance, transportation, energy, healthcare, and climate. Despite the widespread use of linear networks due to their low computational cost and effectiveness in modeling temporal dependencies, most existing research has concentrated on regularly sampled and fully observed multivariate time series. However, in practice, we frequently encounter irregular multivariate time series characterized by variable sampling intervals and missing values. The inherent intra-series inconsistency and inter-series asynchrony in such data hinder effective modeling and forecasting with traditional linear networks relying on static weights. To tackle these challenges, this paper introduces a novel model named AiT. AiT utilizes an adaptive linear network capable of dynamically adjusting weights according to observation time points to address intra-series inconsistency, thereby enhancing the accuracy of temporal dependencies modeling. Furthermore, by incorporating the Transformer module on variable semantics embeddings, AiT efficiently captures variable correlations, avoiding the challenge of inter-series asynchrony. Comprehensive experiments across four benchmark datasets demonstrate the superiority of AiT, improving prediction accuracy by 11% and decreasing runtime by 52% compared to existing state-of-the-art methods.