TimePerceiver: An Encoder-Decoder Framework for Generalized Time-Series Forecasting
This addresses the challenge of holistic modeling in time-series forecasting for researchers and practitioners, offering a novel approach that integrates encoding, decoding, and training, though it appears incremental in its architectural innovations.
The paper tackles the problem of time-series forecasting by proposing TimePerceiver, a unified encoder-decoder framework that generalizes to diverse prediction objectives like extrapolation and interpolation, and it consistently and significantly outperforms prior state-of-the-art baselines across multiple benchmark datasets.
In machine learning, effective modeling requires a holistic consideration of how to encode inputs, make predictions (i.e., decoding), and train the model. However, in time-series forecasting, prior work has predominantly focused on encoder design, often treating prediction and training as separate or secondary concerns. In this paper, we propose TimePerceiver, a unified encoder-decoder forecasting framework that is tightly aligned with an effective training strategy. To be specific, we first generalize the forecasting task to include diverse temporal prediction objectives such as extrapolation, interpolation, and imputation. Since this generalization requires handling input and target segments that are arbitrarily positioned along the temporal axis, we design a novel encoder-decoder architecture that can flexibly perceive and adapt to these varying positions. For encoding, we introduce a set of latent bottleneck representations that can interact with all input segments to jointly capture temporal and cross-channel dependencies. For decoding, we leverage learnable queries corresponding to target timestamps to effectively retrieve relevant information. Extensive experiments demonstrate that our framework consistently and significantly outperforms prior state-of-the-art baselines across a wide range of benchmark datasets. The code is available at https://github.com/efficient-learning-lab/TimePerceiver.