LGJul 1

TiRex-2: Generalizing TiRex to Multivariate Data and Streaming

arXiv:2607.0120419.4
Predicted impact top 4% in LG · last 90 daysOriginality Highly original
AI Analysis

For practitioners needing real-time multivariate forecasting with covariates, TiRex-2 provides a scalable, streaming-capable foundation model with strong zero-shot performance.

TiRex-2 is a recurrent xLSTM-based time series foundation model that achieves state-of-the-art zero-shot multivariate forecasting with constant per-patch inference cost under streaming, outperforming prior models on GIFT-Eval and fev-bench.

We introduce TiRex-2, a recurrent xLSTM-based time series foundation model that generalizes the univariate TiRex to multivariate forecasting with both past and future covariates. Real-world forecasting is inherently sequential: observations arrive continuously, variables evolve jointly, and a subset of covariates is known ahead of time. Existing Transformer-based time series foundation models capture cross-variate dependencies but incur quadratic complexity in context length and require full-history recomputation as new observations arrive. TiRex-2 addresses these limitations through a memory-centric recurrent design that operates at constant per-patch cost under streaming. The model combines a bidirectional time mixer with an asymmetric grouped-attention variate mixer, enabling the integration of future-known covariates while preserving strict causality over target variables. To our knowledge, this is the first time series foundation model that achieves this combination of properties. To support scalable multivariate pretraining, we propose a synthetic coupling pipeline that composes diverse multivariate samples on the fly from large univariate corpora. Empirically, TiRex-2 achieves state-of-the-art zero-shot performance on GIFT-Eval and fev-bench, remains stable when streamed to arbitrary context lengths, and maintains constant inference cost per patch. The model uses 38.4M active parameters in univariate mode, with an additional 44.1M parameters activated for multivariate forecasting.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes