A theoretical contribution to the fast implementation of null linear discriminant analysis method using random matrix multiplication with scatter matrices
This work is an incremental improvement for researchers in dimensionality reduction, addressing a specific computational issue in null LDA.
The paper tackles the problem of rank deficiency in the fast implementation of null linear discriminant analysis using random matrix multiplication, providing a theoretical condition to ensure full column rank and preserve discriminant information.
The null linear discriminant analysis method is a competitive approach for dimensionality reduction. The implementation of this method, however, is computationally expensive. Recently, a fast implementation of null linear discriminant analysis method using random matrix multiplication with scatter matrices was proposed. However, if the random matrix is chosen arbitrarily, the orientation matrix may be rank deficient, and some useful discriminant information will be lost. In this paper, we investigate how to choose the random matrix properly, such that the two criteria of the null LDA method are satisfied theoretically. We give a necessary and sufficient condition to guarantee full column rank of the orientation matrix. Moreover, the geometric characterization of the condition is also described.