Kernel-based discriminative elastic embedding algorithm (original) (raw)

Abstract

A nonlinear version of discriminative elastic embedding (DEE) algorithm is presented, called kernel discriminative elastic embedding (KDEE). In this paper, we concretely fulfill the following works: (1) class labels and linear projection matrix are integrated into the kernel-based objective function; (2) two different strategies are adopted for optimizing the objective function of KDEE, and accordingly the final algorithms are termed as KDEE1 and KDEE2 respectively; (3) a deliberately selected Laplacian search direction is adopted in KDEE1 for faster convergence. Experimental results on several publicly available databases demonstrate that the proposed algorithm achieves powerful pattern revealing capability for complex manifold data.

Access this article

Log in via an institution

Subscribe and save

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Alfaro CA, Aydın B, Bullitt E, Ladha A, Valencia CE (2014) Dimension reduction in principal component analysis for trees. Computational Statistics & Data Analysis 74:157–179
    Article MathSciNet Google Scholar
  2. Yang W, Wu H (2014) Regularized complete linear discriminant analysis. Neurocomputing 137:185–191
    Article Google Scholar
  3. Chen Y, Xu XH, Lai JH (2011) Optimal locality preserving projection for face recognition. Neurocomputing 74(18):3941–3945
    Article Google Scholar
  4. Sugiyama M (2007) Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis. J Mach Learn Res 8(1):1027–1061
    MATH Google Scholar
  5. Timofte R, Van Gool L (2012) Iterative Nearest Neighbors for Classification and Dimensionality Reduction. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), USA
  6. Timofte R, Van Gool L (2015) Iterative Nearest Neighbors. Pattern Recognition 48:60–72
    Article Google Scholar
  7. Tenenbaum JB, De Silva V, Langford JC, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290:2319–2323
    Article Google Scholar
  8. Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326
    Article Google Scholar
  9. Ma X, Zabaras N (2011) Kernel principal component analysis for stochastic input model generation. J Comput Phys 230:7311–7331
    Article MathSciNet MATH Google Scholar
  10. Shu-Po B, Qiao J, Li J-B (2014) Kernel common discriminant-based multimodal image sensor data classification. Measurement 48:128–135
    Article Google Scholar
  11. Hinton G, Roweis ST (2003) Stochastic neighbor embedding, Advances in Neural Information Processing Systems 15. MIT Press, pp 833–840
  12. Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9 9(11):2579–2605
    MATH Google Scholar
  13. Wang W, Qiu H, Huang Q, Zheng J (2014) Kernel Discriminative Stochastic Neighbor Embedding. Journal of Computer-Aided Design & Computer Graphics 26:623–631
    Google Scholar
  14. Carreira-Perpiñan MA (2010) The elastic embedding algorithm for dimensionality reduction. In: 27th International Conference on Machine Learning, pp 167–174
  15. Zheng JW, Zhang HK, Cattani C, Wang WL Dimensionality reduction by supervised neighbor embedding using laplacian search, Computational and Mathematical Methods in Medicine, in press
  16. Yang W, Wang KQ, Zuo WM (2012) Fast neighborhood component analysis. Neurocomputing 83:31–37
    Article Google Scholar
  17. Nocedal J, Wright S (2006) Numerical Optimization, 2nd edn. Springer

Download references

Acknowledgments

The authors would like to thank the anonymous reviewers for their constructive comments and suggestions. This project was supported in part by the Provincial Science Foundation of Zhejiang(LY15F030014), National Natural Science Foundation of China(61379123), Zhejiang Provincial Natural Science Foundation(LY13F030011), Zhejiang Provincial Natural Science Foundation(LQ14F030003), The School of Natural Science Foundation(1401119023408) and National Science and Technology Support Plan(2012BAD10B0101).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China
    Jianwei Zheng, Hong Qiu, Wanliang Wang & Chenchen Kong
  2. College of Electrical and Information Engineering, Quzhou University, Quzhou, China
    Hailun Wang

Authors

  1. Jianwei Zheng
  2. Hong Qiu
  3. Wanliang Wang
  4. Chenchen Kong
  5. Hailun Wang

Corresponding author

Correspondence toJianwei Zheng.

Rights and permissions

About this article

Cite this article

Zheng, J., Qiu, H., Wang, W. et al. Kernel-based discriminative elastic embedding algorithm.Appl Intell 44, 449–456 (2016). https://doi.org/10.1007/s10489-015-0709-3

Download citation

Keywords