Adaptive Bayes (original) (raw)

Abstract

Several researchers have studied the application of Machine Learning techniques to the task of user modeling. As most of them pointed out, this task requires learning algorithms that should work on-line, incorporate new information incrementality, and should exhibit the capacity to deal with concept-drift. In this paper we present Adaptive Bayes, an extension to the well-known naive-Bayes, one of the most common used learning algorithms for the task of user modeling. Adaptive Bayes is an incremental learning algorithm that could work on-line. We have evaluated Adaptive Bayes on both frameworks. Using a set of benchmark problems from the UCI repository [2], and using several evaluation statistics, all the adaptive systems show significant advantages in comparison against their non-adaptive versions.

Preview

Unable to display preview. Download preview PDF.

References

  1. John Binder, Daphne Koller, Stuart Russel, and Keiji Kanazawa. Adaptive probabilistic networks with hidden variables. Machine Learning, 29:213–243, 1997.
    Article MATH Google Scholar
  2. C. Blake, E. Keogh, and C. J. Merz. UCI repository of Machine Learning databases, 1999.
    Google Scholar
  3. Pedro Domingos and Michael Pazzani. On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning, 29:103–129, 1997.
    Article MATH Google Scholar
  4. J. Dougherty, R. Kohavi, and M. Sahami. Supervised and unsupervised discretization of continuous features. In A. Prieditis and S. Russel, editors, Machine Learning Proc. of 12th International Conference. Morgan Kaufmann, 1995.
    Google Scholar
  5. R. O. Duda and P. E. Hart. Pattern Classification and Scene Analysis. New York, Willey and Sons, 1973.
    MATH Google Scholar
  6. J. Gama. Iterative Bayes. In S. Arikawa and K. Furukawa, editors, Discovery Science-Second International Conference. LNAI 1721, Springer Verlag, 1999.
    Google Scholar
  7. I. Kononenko. Semi-naive Bayesian classifier. In Y. Kodratoff, editor, European Working Session on Learning-EWSL91. LNAI 482 Springer Verlag, 1991.
    Google Scholar
  8. P. Langley. Induction of recursive Bayesian classifiers. In P. Brazdil, editor, Proc. of European Conf. on Machine Learning. LNAI 667, Springer Verlag, 1993.
    Google Scholar
  9. Tom Mitchell. Machine Learning. MacGraw-Hill Companies, Inc., 1997.
    Google Scholar
  10. Kamal Nigam, Andrew Kachites Mccallum, Sebastian Thrun, and Tom Mitchell. Text Classification from Labeled and Unlabeled Documents using EM. Machine Learning, 39:1–32, 2000.
    Article Google Scholar
  11. Michael Pazzani and Daniel Billsus. Learning and revising user profiles: the identification of interesting web sites. Machine Learning, 27:313, 1997.
    Article Google Scholar
  12. Brian D. Ripley. Pattern Recognition and Neural Networks. Cambridge University Press, 1996.
    Google Scholar
  13. Mia Stern, Joseph Beck, and Beverly Woolf. Naive bayes classifiers for user modelling. In Proceedings of the User Modelling Conference. Morgan Kaufmann, 1999.
    Google Scholar
  14. G. Webb, M. Pazzani, and D. Billsus. Machine learning for user modelling. User Modelling and User-adapted Interaction, 11:19–29, 2001.
    Article MATH Google Scholar

Download references

Author information

Authors and Affiliations

  1. LIACC, FEP - University of Porto, Rua Campo Alegre, 823, 4150, Porto, Portugal
    João Gama
  2. Department of Mathematics, University of Aveiro, Aveiro, Portugal
    Gladys Castillo

Authors

  1. João Gama
  2. Gladys Castillo

Editor information

Editors and Affiliations

  1. Telefónica Investigación y Desarrollo, Emilio Vargas 6, 28043, Madrid, Spain
    Francisco J. Garijo
  2. Dpto. Lenguajes y Sistemas Informáticos, Universidad de Sevilla, ETS Ingeniería Informática, 41012, Seville, Spain
    José C. Riquelme & Miguel Toro &

Rights and permissions

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gama, J., Castillo, G. (2002). Adaptive Bayes. In: Garijo, F.J., Riquelme, J.C., Toro, M. (eds) Advances in Artificial Intelligence — IBERAMIA 2002. IBERAMIA 2002. Lecture Notes in Computer Science(), vol 2527. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36131-6\_78

Download citation

Keywords

Publish with us