Globally and Locally Consistent Unsupervised Projection

Hua Wang, Feiping Nie, Heng Huang

AAAI - 2014

In this paper, we propose an unsupervised projection method for feature extraction to preserve both global and local consistencies of the input data in the projected space. Traditional unsupervised feature extraction methods, such as principal component analysis (PCA) and locality preserving projections (LPP), can only explore either the global or local geometric structures of the input data, but not the both at the same time. In our new method, we introduce a new measurement using the neighborhood data variances to assess the data locality, by which we propose to learn an optimal projection by rewarding both the global and local structures of the input data. The formulated optimization problem is challenging to solve, because it ends up a trace ratio minimization problem. In this paper, as an important theoretical contribution, we propose a simple yet efficient optimization algorithm to solve the trace ratio problem with theoretically proved convergence. Extensive experiments have been performed on six benchmark data sets, where the promising results validate the proposed method.

Links

  • View publications from Hua Wang
  • View publications presented in AAAI
  • View publications researching Embeddings

Cite this paper

MLA Copied to clipboard!
Wang, Hua, Feiping Nie, and Heng Huang. "Globally and locally consistent unsupervised projection." Twenty-Eighth AAAI Conference on Artificial Intelligence. 2014.
BibTeX Copied to clipboard!
@inproceedings{wang2014globally,
  title={Globally and locally consistent unsupervised projection},
  author={Wang, Hua and Nie, Feiping and Huang, Heng},
  booktitle={Twenty-Eighth AAAI Conference on Artificial Intelligence},
  year={2014}
}