Alternating proximal gradient method for sparse nonnegative Tucker decomposition
For practitioners analyzing multi-way data (e.g., EEG, face recognition), this method provides a scalable and convergent solution for sparse nonnegative Tucker decomposition.
This paper proposes an alternating proximal gradient method for sparse nonnegative Tucker decomposition, achieving superior performance over state-of-the-art methods on synthetic and real-world data with both partial and full observations.
Multi-way data arises in many applications such as electroencephalography (EEG) classification, face recognition, text mining and hyperspectral data analysis. Tensor decomposition has been commonly used to find the hidden factors and elicit the intrinsic structures of the multi-way data. This paper considers sparse nonnegative Tucker decomposition (NTD), which is to decompose a given tensor into the product of a core tensor and several factor matrices with sparsity and nonnegativity constraints. An alternating proximal gradient method (APG) is applied to solve the problem. The algorithm is then modified to sparse NTD with missing values. Per-iteration cost of the algorithm is estimated scalable about the data size, and global convergence is established under fairly loose conditions. Numerical experiments on both synthetic and real world data demonstrate its superiority over a few state-of-the-art methods for (sparse) NTD from partial and/or full observations. The MATLAB code along with demos are accessible from the author's homepage.