Using Co-training and Self-training in Semi-supervised Multiple Classifier Systems (original) (raw)

Abstract

Multiple classifier systems have been originally proposed for supervised classification tasks, and few works have dealt with semi-supervised multiple classifiers. However, there are important pattern recognition applications, such as multi-sensor remote sensing and multi-modal biometrics, which demand semi-supervised multiple classifier systems able to exploit both labelled and unlabelled data. In this paper, the use, in multiple classifier systems, of two well known semi-supervised learning methods, namely, co-training and self-training, is investigated by experiments. Reported results on benchmarking data sets show that co-training and self-training allow exploiting unlabelled data in different types of multiple classifiers systems.

Chapter PDF

Similar content being viewed by others

References

  1. Roli, F.: Semi-supervised Multiple Classifier Systems: Background and Research Directions. In: Oza, N.C., Polikar, R., Kittler, J., Roli, F. (eds.) MCS 2005. LNCS, vol. 3541, pp. 1–11. Springer, Heidelberg (2005)
    Chapter Google Scholar
  2. D’Alchè-Buc, F., Grandvalet, Y., Ambroise, C.: Semi-supervised marginboost. In: Neural Information Processing Systems Foundation, NIPS 2002 (2002)
    Google Scholar
  3. Bennet, K., Demiriz, A., Maclin, R.: Exploiting unlabeled data in ensemble methods. In: Proc. 8th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining, pp. 289–296 (2002)
    Google Scholar
  4. El Gayar, N.: An Experimental Study of a Self-Supervised Classifier Ensemble. International Journal of Information Technology 1(1) (2004)
    Google Scholar
  5. Zhou, Y., Goldman, S.: Democratic Co-Learning. In: Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2004), pp. 594–602 (2004)
    Google Scholar
  6. Zhu, X.: Semi-supervised learning literature survey, Technical report, Computer Sciences TR 1530, Univ. Wisconsis, Madison, USA (January 2006)
    Google Scholar
  7. Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proc. of the Workshop on Computational Learning Theory, pp. 92–100 (1998)
    Google Scholar
  8. Kittler, J., Hatef, M., Duin, R.P.W., Matas, J.: On Combining Classifiers. IEEE Trans. on Patt. Anal. and Machine Intell. 20(3), 226–239 (1998)
    Article Google Scholar
  9. Skurichina, M., Duin, R.P.W.: Bagging, Boosting and the Random Subspace Method for Linear Classifiers. Pattern Analysis & Applications 5, 121–135 (2002)
    Article MATH MathSciNet Google Scholar
  10. Giacinto, G., Roli, F., Bruzzone, L.: Combination of neural and statistical algorithms for supervised classification of remote-sensing images. Pattern Recongition Letters 21(5), 385–397 (2000)
    Article Google Scholar
  11. Solyman, M., El Gayar, N.F.: A Co-training Approach for Semi-supervised Multiple Classifiers. In: INFO 2006, 4th Int. Conference, Cairo, Egypt, March 25-27 (in press, 2006)
    Google Scholar

Download references

Author information

Authors and Affiliations

  1. Dept. of Electrical and Electronic Engineering, University of Cagliari, Piazza d’Armi, 09123, Cagliari, Italy
    Luca Didaci & Fabio Roli

Authors

  1. Luca Didaci
  2. Fabio Roli

Editor information

Editors and Affiliations

  1. Hong Kong University of Science and Technology,
    Dit-Yan Yeung
  2. Department of Computer Science, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
    James T. Kwok
  3. Instituto de Telecomunicações, Instituto Superior Técnico, Lisbon, Portugal
    Ana Fred
  4. Department of Electrical and Electronic Engineering, University of Cagliari, Piazza d’Armi, 09123, Cagliari, Italy
    Fabio Roli
  5. Faculty of Electrical Engineering, Mathematics and Computer Science, Information and Communication Theory Group, Delft University of Technology, Delft, The Netherlands
    Dick de Ridder

Rights and permissions

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Didaci, L., Roli, F. (2006). Using Co-training and Self-training in Semi-supervised Multiple Classifier Systems. In: Yeung, DY., Kwok, J.T., Fred, A., Roli, F., de Ridder, D. (eds) Structural, Syntactic, and Statistical Pattern Recognition. SSPR /SPR 2006. Lecture Notes in Computer Science, vol 4109. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11815921\_57

Download citation

Keywords

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Publish with us