STING: Self-attention based Time-series Imputation Networks using GAN
This work addresses the challenge of handling missing data in time series for applications requiring accurate predictions, representing an incremental improvement over existing deep learning methods.
The paper tackles the problem of imputing missing values in multivariate time series data by proposing STING, a method that combines generative adversarial networks, bidirectional recurrent neural networks, and a novel attention mechanism, and it demonstrates improved imputation accuracy and downstream task performance on three real-world datasets.
Time series data are ubiquitous in real-world applications. However, one of the most common problems is that the time series data could have missing values by the inherent nature of the data collection process. So imputing missing values from multivariate (correlated) time series data is imperative to improve a prediction performance while making an accurate data-driven decision. Conventional works for imputation simply delete missing values or fill them based on mean/zero. Although recent works based on deep neural networks have shown remarkable results, they still have a limitation to capture the complex generation process of the multivariate time series. In this paper, we propose a novel imputation method for multivariate time series data, called STING (Self-attention based Time-series Imputation Networks using GAN). We take advantage of generative adversarial networks and bidirectional recurrent neural networks to learn latent representations of the time series. In addition, we introduce a novel attention mechanism to capture the weighted correlations of the whole sequence and avoid potential bias brought by unrelated ones. Experimental results on three real-world datasets demonstrate that STING outperforms the existing state-of-the-art methods in terms of imputation accuracy as well as downstream tasks with the imputed values therein.