LGJul 19, 2021

Long-term series forecasting with Query Selector -- efficient model of sparse attention

arXiv:2107.08687v28 citations
Originality Incremental advance
AI Analysis

This addresses the challenge of efficient long-term forecasting for time-series analysis, likely incremental as it builds on existing Transformer modifications.

The authors tackled the problem of long-term time-series forecasting by proposing Query Selector, an efficient deterministic algorithm for sparse attention in Transformers, achieving state-of-the-art results on ETT, Helpdesk, and BPI'12 datasets.

Various modifications of TRANSFORMER were recently used to solve time-series forecasting problem. We propose Query Selector - an efficient, deterministic algorithm for sparse attention matrix. Experiments show it achieves state-of-the art results on ETT, Helpdesk and BPI'12 datasets.

Code Implementations2 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes