Learning Robust Locality Preserving Projection via p-Order Minimization
Hua Wang, Feiping Nie, Heng Huang
AAAI - 2015
Locality preserving projection (LPP) is an effective dimensionality reduction method based on manifold learning, which is defined over the graph weighted squared l2-norm distances in the projected subspace. Since squared l2-norm distance is prone to outliers, it is desirable to develop a robust LPP method. In this paper, motivated by existing studies that improve the robustness of statistical learning models via l1 -norm or not-squared l2 -norm formulations, we propose a robust LPP (rLPP) formulation to minimize the p-th order of the l2-norm distances, which can better tolerate large outlying data samples because it suppress the introduced biased more than the l1-norm or not squared l2-norm minimizations. However, solving the formulated objective is very challenging because it not only non-smooth but also non-convex. As an important theoretical contribution of this work, we systematically derive an efficient iterative algorithm to solve the general p-th order l2-norm minimization problem, which, to the best of our knowledge, is solved for the first time in literature. Extensive empirical evaluations on the proposed rLPP method have been performed, in which our new method outperforms the related state-of-the-art methods in a variety of experimental settings and demonstrate its effectiveness in seeking better subspaces on both noiseless and noisy data.
Links
- View publications from Hua Wang
- View publications presented in AAAI
- View publications in the project, Mining Materials Genome Data for Prediction and Guidance of Nanoparticle Synthesis
- View publications researching Embeddings
- View publications researching Optimization
- View publications researching Robust Learning Models
Cite this paper
MLA
Wang, Hua, Feiping Nie, and Heng Huang. "Learning robust locality preserving projection via p-order minimization." Twenty-Ninth AAAI Conference on Artificial Intelligence. 2015.
BibTeX
@inproceedings{wang2015learning,
title={Learning robust locality preserving projection via p-order minimization},
author={Wang, Hua and Nie, Feiping and Huang, Heng},
booktitle={Twenty-Ninth AAAI Conference on Artificial Intelligence},
year={2015}
}