From Indefinite to Positive Semi-Definite Matrices (original) (raw)

Abstract

Similarity based classification methods use positive semi-definite (PSD) similarity matrices. When several data representations (or metrics) are available, they should be combined to build a single similarity matrix. Often the resulting combination is an indefinite matrix and can not be used to train the classifier. In this paper we introduce new methods to build a PSD matrix from an indefinite matrix. The obtained matrices are used as input kernels to train Support Vector Machines (SVMs) for classification tasks. Experimental results on artificial and real data sets are reported.

Chapter PDF

Similar content being viewed by others

Introduction

Chapter © 2018

References

  1. Blake, C.L., Merz, C.J.: UCI repository of Machine Learning databases. University of Carolina, Irvine, Department of Information and Computer Sciences (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
  2. Cox, T.F., Cox, M.A.A.: Multidimensional Scaling. Chapman and Hall, Boca Raton (1994)
    MATH Google Scholar
  3. Goldfarb, L.: A new approach to Pattern Recognition. Progress in Pattern Recognition 2, 241–402 (1985)
    MathSciNet Google Scholar
  4. Hayes, J.F., Hill, W.G.: Modification of estimates of parameters in the construction of genetic selection indices (“Bending”). Biometrics 37, 483–493 (1981)
    Article MathSciNet Google Scholar
  5. Highman, N.: Computing the nearest correlation matrix- a problem from finance. IMA Journal of Numerical Analysis 22, 329–343 (2002)
    Article MathSciNet Google Scholar
  6. Jorjani, H., Klei, L., Emanuelson, U.: A simple method fot weighted bending of genetic (co)variance matrices. J. Dairy Sci. 86, 677–679 (2003)
    Article Google Scholar
  7. Luenberger, D.G.: Optimization by Vector Space Methods. Wiley, New York (1969)
    MATH Google Scholar
  8. Martín de Diego, I., Moguerza, J.M., Muñoz, A.: Combining Kernel Information for Support Vector Classification. In: Roli, F., Kittler, J., Windeatt, T. (eds.) MCS 2004. LNCS, vol. 3077, pp. 102–111. Springer, Heidelberg (2004)
    Chapter Google Scholar
  9. de Diego, I.M., Muñoz, A., Moguerza, J.M.: Methods for the Combination of Kernel Matrices within a Support Vector Framework (submitted)
    Google Scholar
  10. Moguerza, J.M., Muñoz, A., Martín de Diego, I.: Improving Support Vector Classification via the Combination of Multiple Sources of Information. In: Fred, A., Caelli, T.M., Duin, R.P.W., Campilho, A.C., de Ridder, D. (eds.) SSPR&SPR 2004. LNCS, vol. 3138, pp. 592–600. Springer, Heidelberg (2004)
    Chapter Google Scholar
  11. Muñoz, A., Martín de Diego, I., Moguerza, J.M.: Support Vector Machine Classifiers for Assymetric Proximities. In: Kaynak, O., Alpaydın, E., Oja, E., Xu, L. (eds.) ICANN 2003 and ICONIP 2003. LNCS, vol. 2714, pp. 217–224. Springer, Heidelberg (2003)
    Chapter Google Scholar
  12. Pekalska, E., Paclík, P., Duin, R.P.W.: A Generalized Kernel Approach to Dissimilarity-based Classification. JMLR, Special Issue on Kernel Methods 2(2), 175–211 (2002)
    MATH Google Scholar
  13. Pekalska, E., Duin, R.P.W., Günter, S., Bunke, H.: On Not Making Dissimilarities Euclidean. In: Fred, A., Caelli, T.M., Duin, R.P.W., Campilho, A.C., de Ridder, D. (eds.) SSPR&SPR 2004. LNCS, vol. 3138, pp. 1145–1154. Springer, Heidelberg (2004)
    Chapter Google Scholar
  14. von Neumann, J.: The Geometry of Orthogonal Spaces. Functional operators-vol. II. Annals of Math. Studies, vol. 22. Princeton University Press, Princeton (1950)
    Google Scholar

Download references

Author information

Authors and Affiliations

  1. University Carlos III de Madrid, c/ Madrid 126, 28903, Getafe, Spain
    Alberto Muñoz
  2. University Rey Juan Carlos, c/ Tulipán s/n, 28933, Móstoles, Spain
    Isaac Martí n de Diego

Authors

  1. Alberto Muñoz
  2. Isaac Martí n de Diego

Editor information

Editors and Affiliations

  1. Hong Kong University of Science and Technology,
    Dit-Yan Yeung
  2. Department of Computer Science, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
    James T. Kwok
  3. Instituto de Telecomunicações, Instituto Superior Técnico, Lisbon, Portugal
    Ana Fred
  4. Department of Electrical and Electronic Engineering, University of Cagliari, Piazza d’Armi, 09123, Cagliari, Italy
    Fabio Roli
  5. Faculty of Electrical Engineering, Mathematics and Computer Science, Information and Communication Theory Group, Delft University of Technology, Delft, The Netherlands
    Dick de Ridder

Rights and permissions

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Muñoz, A., de Diego, I.M.n. (2006). From Indefinite to Positive Semi-Definite Matrices. In: Yeung, DY., Kwok, J.T., Fred, A., Roli, F., de Ridder, D. (eds) Structural, Syntactic, and Statistical Pattern Recognition. SSPR /SPR 2006. Lecture Notes in Computer Science, vol 4109. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11815921\_84

Download citation

Keywords

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Publish with us