Soft Clustering for Nonparametric Probability Density Function Estimation (original) (raw)

Abstract

We present a nonparametric probability density estimation model. The classical Parzen window approach builds a spherical Gaussian density around every input sample. Our method has a first stage where hard neighbourhoods are determined for every sample. Then soft clusters are considered to merge the information coming from several hard neighbourhoods. Our proposal estimates the local principal directions to yield a specific Gaussian mixture component for each soft cluster. This leads to outperform other proposals where local parameter selection is not allowed and/or there are no smoothing strategies, like the manifold Parzen windows.

Preview

Unable to display preview. Download preview PDF.

References

  1. Bishop, C.: Neural Networks for Pattern Recognition. Oxford University Press, Oxford (1995)
    Google Scholar
  2. Silverman, B.: Density Estimation for Statistics and Data Analysis. Chapman and Hall, New York (1986)
    MATH Google Scholar
  3. Vapnik, V.N.: Statistical Learning Theory. John Wiley & Sons, New York (1998)
    MATH Google Scholar
  4. Izenman, A.J.: Recent developments in nonparametric density estimation. Journal of the American Statistical Association 86(413), 205–224 (1991)
    Article MATH Google Scholar
  5. Lejeune, M., Sarda, P.: Smooth estimators of distribution and density functions. Computational Statistics & Data Analysis 14, 457–471 (1992)
    Article MATH Google Scholar
  6. Hjort, N.L., Jones, M.C.: Locally Parametric Nonparametric Density Estimation. Annals of Statistics 24(4), 1619–1647 (1996)
    Article MATH Google Scholar
  7. Hastie, T., Loader, C.: Local regression: Automatic kernel carpentry. Statistical Science 8, 120–143 (1993)
    Google Scholar
  8. McLachlan, G., Peel, D.: Finite Mixture Models. Wiley, Chichester (2000)
    MATH Google Scholar
  9. Parzen, E.: On the Estimation of a Probability Density Function and Mode. Annals of Mathematical Statistics 33, 1065–1076 (1962)
    Google Scholar
  10. Vincent, P., Bengio, Y.: Manifold Parzen Windows. Advances in Neural Information Processing Systems 15, 825–832 (2003)
    Google Scholar
  11. Bezdek, J.C.: Numerical taxonomy with fuzzysets. J. Math. Biol. 1, 57–71 (1974)
    Article MATH Google Scholar
  12. Tipping, M.E., Bishop, C.M.: Mixtures of Probabilistic Principal Components Analyzers. Neural Computation 11, 443–482 (1999)
    Article Google Scholar
  13. Newman, D.J., Hettich, S., Blake, C.L., Merz, C.J.: UCI Repository of machine learning databases. University of California, Department of Information and Computer Science, Irvine, CA (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html

Download references

Author information

Authors and Affiliations

  1. School of Computer Engineering, University of Málaga, Campus de Teatinos, s/n. 29071, Málaga, Spain
    Ezequiel López-Rubio, Juan Miguel Ortiz-de-Lazcano-Lobato, Domingo López-Rodríguez & María del Carmen Vargas-González

Authors

  1. Ezequiel López-Rubio
  2. Juan Miguel Ortiz-de-Lazcano-Lobato
  3. Domingo López-Rodríguez
  4. María del Carmen Vargas-González

Editor information

Joaquim Marques de Sá Luís A. Alexandre Włodzisław Duch Danilo Mandic

Rights and permissions

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

López-Rubio, E., Ortiz-de-Lazcano-Lobato, J.M., López-Rodríguez, D., del Carmen Vargas-González, M. (2007). Soft Clustering for Nonparametric Probability Density Function Estimation. In: de Sá, J.M., Alexandre, L.A., Duch, W., Mandic, D. (eds) Artificial Neural Networks – ICANN 2007. ICANN 2007. Lecture Notes in Computer Science, vol 4668. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74690-4\_72

Download citation

Keywords

Publish with us