Principal Component Analysis versus Factor Analysis
This work addresses a specific methodological issue in statistical analysis, offering incremental improvements for researchers using PCA and FA.
The paper tackles the problem of determining the number of principal components in PCA and factors in FA by proposing a new criterion and efficient algorithm, which were adapted and modified to improve variance representation in both methods.
The article discusses selected problems related to both principal component analysis (PCA) and factor analysis (FA). In particular, both types of analysis were compared. A vector interpretation for both PCA and FA has also been proposed. The problem of determining the number of principal components in PCA and factors in FA was discussed in detail. A new criterion for determining the number of factors and principal components is discussed, which will allow to present most of the variance of each of the analyzed primary variables. An efficient algorithm for determining the number of factors in FA, which complies with this criterion, was also proposed. This algorithm was adapted to find the number of principal components in PCA. It was also proposed to modify the PCA algorithm using a new method of determining the number of principal components. The obtained results were discussed.