Smart PCA (2009)

Abstract

PCA can be smarter and makes more sensible projections. In this paper, we propose smart PCA, an extension to
standard PCA to regularize and incorporate external knowledge into model estimation. Based on the probabilistic
interpretation of PCA, the inverse Wishart distribution can be used as the informative conjugate prior for the
population covariance, and useful knowledge is carried by the prior hyperparameters. We design the
hyperparameters to smoothly combine the information from both the domain knowledge and the data itself. The
Bayesian point estimation of principal components is in closed form. In empirical studies, smart PCA shows clear
improvement on three different criteria: image reconstruction errors, the perceptual quality of the
reconstructed images, and the pattern recognition performance.

Full text

Download (application/pdf, 133.2 kB)

Approximate BibTeX Entry

@inproceedings{SmartPCA_IJCAI09,
    Year = {2009},
    Booktitle = {IJCAI 2009},
    Author = { Yi Zhang },
    Title = {Smart PCA}
}