CLOct 13, 2022

LSG Attention: Extrapolation of pretrained Transformers to long sequences

arXiv:2210.15497v134 citationsh-index: 11Has Code
Originality Incremental advance
AI Analysis

This addresses the computational bottleneck for researchers and practitioners using Transformers on long sequences, offering an incremental improvement over existing sparse attention methods.

The paper tackles the quadratic complexity limitation of Transformer self-attention by introducing the LSG architecture with Local, Sparse, and Global attention, showing it is fast, efficient, and competitive in classification and summarization on long documents, and can adapt pretrained models to longer sequences without additional training.

Transformer models achieve state-of-the-art performance on a wide range of NLP tasks. They however suffer from a prohibitive limitation due to the self-attention mechanism, inducing $O(n^2)$ complexity with regard to sequence length. To answer this limitation we introduce the LSG architecture which relies on Local, Sparse and Global attention. We show that LSG attention is fast, efficient and competitive in classification and summarization tasks on long documents. Interestingly, it can also be used to adapt existing pretrained models to efficiently extrapolate to longer sequences with no additional training. Along with the introduction of the LSG attention mechanism, we propose tools to train new models and adapt existing ones based on this mechanism.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes