Eduardo Guzmán | Universidad de Málaga (original) (raw)
Papers by Eduardo Guzmán
International Journal of Artificial Intelligence in Education, 2004
Student assessment is a very important issue in educational settings. The goal of this work is to... more Student assessment is a very important issue in educational settings. The goal of this work is to develop a web-based tool to assist teachers and instructors in the assessment process. Our system is called SIETTE, and its theoretical bases are Computer Adaptive Testing and Item Response Theory. With SIETTE, teachers worldwide can define their tests, and their students can take these tests on-line. The tests are generated according to teachers' specifications and are adaptive, that is, the questions are selected intelligently to fit the student's level of knowledge. In this way, we obtain more accurate estimations of student's knowledge with significantly shorter tests. By using the computer, larger question databases can be stored, selection algorithms can be performed efficiently, and questions can include multimedia content. The use of Java applets allows the inclusion of executable content in question stem and/or answers, so the student can interact with the system by means of this applet. In this way, new possibilities are added to Computer Adaptive Tests, such as using traditional multiple-choice questions together with questions whose answer is evaluated by the applet itself.
Lecture Notes in Computer Science, 2006
In this paper we present a proposal for introducing hint adaptive selection in an adaptive web-ba... more In this paper we present a proposal for introducing hint adaptive selection in an adaptive web-based testing environment. To this end, a discussion of some aspects concerning the adaptive selection mechanism for hints is presented, which results in the statement of two axioms that such hints must fulfil. Then, an empirical study with real students is presented, whose goal is to evaluate a tentative bank of items with their associated hints to determine the usefulness of such hints for different knowledge levels and to calibrate both test items and hints.
Inteligencia Artificial Revista Iberoamericana De Inteligencia Artificial, 2007
En este artículo se presenta una propuesta para la introducción de mecanismos adaptativos para la... more En este artículo se presenta una propuesta para la introducción de mecanismos adaptativos para la elección de ayudas, en un entorno de evaluación basado en tests adaptativos. El artículo comienza con una discusión sobre aspectos relativos a mecanismos de selección adaptativos de pistas, que resultan en la definición de dos axiomas que tales pistas deben cumplir. Posteriormente, se presenta una evaluación empírica preliminar con estudiantes reales, cuyo objetivo es evaluar un banco inicial de preguntas con sus respectivas pistas, para determinar siéstas son realmenteútiles. La evaluación se llevará a cabo a partir de los resultados obtenidos tras administrar un test a muestra poblacional formada por alumnos reales con diferentes niveles de conocimiento.
This project is part of a long-term research and development effort to build a new generation of ... more This project is part of a long-term research and development effort to build a new generation of resources that support the student in an e-Learning web based environment. The research goals include the definition of new components for automatic assessment, open learner modelling, and adaptive recommendation of learning tasks. The development goals are substantiated in the construction of web based applications and services that can be integrated in a mush up architecture to build an intelligent and domain independent learning management system.
This paper presents a proposal of a framework for the integration of web-based educational system... more This paper presents a proposal of a framework for the integration of web-based educational systems. It is part of an on-going research work (MEDEA project), whose final goal is to develop a general framework to build open Intelligent Tutoring Systems (ITS). We understand "open system" as a set of autonomous educational modules which communicate between themselves, following high-level pre-established protocols. Each module can be an intelligent component with its own instruction strategies, or other components like support tools, web pages, etc. In the second case, the adaptive capabilities are left to the ITS instructor core. The architecture opens up the possibility to include new web-based components.
Virtual Environments for Teaching and Learning, 2002
Artificial Intelligence in Education, 2005
Abstract This paper is a first attempt to relate quantitative, unidimensional models to the fine-... more Abstract This paper is a first attempt to relate quantitative, unidimensional models to the fine-grained models usually found in the AI-ED community. More concretely, we define a certain type of qualitative student models that take into account the strict prerequisite relation, and show how a quantitative model arises from it in a natural way.
Frontiers in Artificial Intelligence and Applications, 2009
The SIETTE collaborative environment allows students to take tests together in small groups. Indi... more The SIETTE collaborative environment allows students to take tests together in small groups. Individuals can communicate and hold discussions to solve test questions. This paper describes the summative evaluation of the SIETTE collaborative environment and the relationship between the collaboration and the actual improve ment which occurs in the student knowledge level. We conclude that under certain conditions improvement occurs and can be measured.
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2006
In this paper we present a proposal for introducing hint adaptive selection in an adaptive web-ba... more In this paper we present a proposal for introducing hint adaptive selection in an adaptive web-based testing environment. To this end, a discussion of some aspects concerning the adaptive selection mechanism for hints is presented, which results in the statement of two axioms that such hints must fulfil. Then, an empirical study with real students is presented, whose goal is to evaluate a tentative bank of items with their associated hints to determine the usefulness of such hints for different knowledge levels and to calibrate both test items and hints.
Frontiers in Artificial Intelligence and Applications, 2009
One of the most popular student modeling techniques currently available is Constraint Based Model... more One of the most popular student modeling techniques currently available is Constraint Based Modeling (CBM), which is based on Ohlsson's theory of learning from performance errors. It focuses on the domain principles to correct faulty knowledge and assumes that a student will reach a correct solution without violating these fundamental domain concepts. However, even though this is a powerful and computationally simple technique, most student models of CBM-based tutors handle simple long-term models or based on heuristics to quantitatively estimate the knowledge measured. In this paper we propose a student knowledge diagnosis model which combines CBM with the Item Response Theory (IRT). IRT is a probabilistic and data-driven theory which guarantees accurate and invariant student knowledge estimations. By means of this synergy between CBM and IRT we suggest the construction of long-term student models composed of the estimations of their knowledge. This paper also includes an experiment we have carried out with real students, which explores the validity of the diagnoses made with our model.
Lecture Notes in Computer Science, 2010
The Item Response Theory (IRT) is a statistical mechanism successfully used since the beginning o... more The Item Response Theory (IRT) is a statistical mechanism successfully used since the beginning of the 20th century to infer student knowledge through tests. Nevertheless, existing well-founded techniques to assess procedural tasks are generally complex and applied to well-defined tasks. In this paper, we describe how, using a set of techniques we have developed based on IRT, it is possible to infer declarative student knowledge through procedural tasks. We describe how these techniques have been used with undergraduate students, in the object oriented programming domain, through ill-defined procedural exercises.
Lecture Notes in Computer Science, 2004
R. Conejo et al. (Eds.): CAEPIA-TTIA 2003, LNAI 3040, pp. 676685, 2004. © Springer-Verlag Berlin... more R. Conejo et al. (Eds.): CAEPIA-TTIA 2003, LNAI 3040, pp. 676685, 2004. © Springer-Verlag Berlin Heidelberg 2004 ... TAPLI: An Adaptive Web-Based Learning Environment for Linear Programming ... Eva Millán, Emilio García-Hervás, Eduardo Guzmán De los Riscos, ...
Lecture Notes in Computer Science, 2003
... developed by our team for systems like EPLAR [4] (a problem solver for simplex problems), ILE... more ... developed by our team for systems like EPLAR [4] (a problem solver for simplex problems), ILESA [3] (a system capable of generating problems at the right level of difficulty based on the student model and also of coaching students while solving a problem ) and SIETTE [2] (a ...
INTELIGENCIA ARTIFICIAL, 2007
En este artıculo se presenta una propuesta para la introducción de mecanismos adaptativos para la... more En este artıculo se presenta una propuesta para la introducción de mecanismos adaptativos para la elección de ayudas, en un entorno de evaluación basado en tests adaptativos. El artıculo comienza con una discusión sobre aspectos relativos a mecanismos de selección ...
Lecture Notes in Computer Science, 2013
Lecture Notes in Computer Science, 2000
Socratic dialogues has been widely uses as a way of implement an ITS. The idea behind it is that ... more Socratic dialogues has been widely uses as a way of implement an ITS. The idea behind it is that the teaching and learning process should be based upon a personal reflection that can be obtained posing the right question on a guided dialogue. This methodology assumes that the knowledge acquisition is a discovering process in which both the teacher and the student plays an active role. This tutorial strategy has been developed as a part of a web based ITS architecture for declarative domains and it has been applied to the botanical domain. In this paper we describe this component, the knowledge representation that support it and the web interface used
International Journal of Artificial Intelligence in Education, 2004
Student assessment is a very important issue in educational settings. The goal of this work is to... more Student assessment is a very important issue in educational settings. The goal of this work is to develop a web-based tool to assist teachers and instructors in the assessment process. Our system is called SIETTE, and its theoretical bases are Computer Adaptive Testing and Item Response Theory. With SIETTE, teachers worldwide can define their tests, and their students can take these tests on-line. The tests are generated according to teachers' specifications and are adaptive, that is, the questions are selected intelligently to fit the student's level of knowledge. In this way, we obtain more accurate estimations of student's knowledge with significantly shorter tests. By using the computer, larger question databases can be stored, selection algorithms can be performed efficiently, and questions can include multimedia content. The use of Java applets allows the inclusion of executable content in question stem and/or answers, so the student can interact with the system by means of this applet. In this way, new possibilities are added to Computer Adaptive Tests, such as using traditional multiple-choice questions together with questions whose answer is evaluated by the applet itself.
Lecture Notes in Computer Science, 2006
In this paper we present a proposal for introducing hint adaptive selection in an adaptive web-ba... more In this paper we present a proposal for introducing hint adaptive selection in an adaptive web-based testing environment. To this end, a discussion of some aspects concerning the adaptive selection mechanism for hints is presented, which results in the statement of two axioms that such hints must fulfil. Then, an empirical study with real students is presented, whose goal is to evaluate a tentative bank of items with their associated hints to determine the usefulness of such hints for different knowledge levels and to calibrate both test items and hints.
Inteligencia Artificial Revista Iberoamericana De Inteligencia Artificial, 2007
En este artículo se presenta una propuesta para la introducción de mecanismos adaptativos para la... more En este artículo se presenta una propuesta para la introducción de mecanismos adaptativos para la elección de ayudas, en un entorno de evaluación basado en tests adaptativos. El artículo comienza con una discusión sobre aspectos relativos a mecanismos de selección adaptativos de pistas, que resultan en la definición de dos axiomas que tales pistas deben cumplir. Posteriormente, se presenta una evaluación empírica preliminar con estudiantes reales, cuyo objetivo es evaluar un banco inicial de preguntas con sus respectivas pistas, para determinar siéstas son realmenteútiles. La evaluación se llevará a cabo a partir de los resultados obtenidos tras administrar un test a muestra poblacional formada por alumnos reales con diferentes niveles de conocimiento.
This project is part of a long-term research and development effort to build a new generation of ... more This project is part of a long-term research and development effort to build a new generation of resources that support the student in an e-Learning web based environment. The research goals include the definition of new components for automatic assessment, open learner modelling, and adaptive recommendation of learning tasks. The development goals are substantiated in the construction of web based applications and services that can be integrated in a mush up architecture to build an intelligent and domain independent learning management system.
This paper presents a proposal of a framework for the integration of web-based educational system... more This paper presents a proposal of a framework for the integration of web-based educational systems. It is part of an on-going research work (MEDEA project), whose final goal is to develop a general framework to build open Intelligent Tutoring Systems (ITS). We understand "open system" as a set of autonomous educational modules which communicate between themselves, following high-level pre-established protocols. Each module can be an intelligent component with its own instruction strategies, or other components like support tools, web pages, etc. In the second case, the adaptive capabilities are left to the ITS instructor core. The architecture opens up the possibility to include new web-based components.
Virtual Environments for Teaching and Learning, 2002
Artificial Intelligence in Education, 2005
Abstract This paper is a first attempt to relate quantitative, unidimensional models to the fine-... more Abstract This paper is a first attempt to relate quantitative, unidimensional models to the fine-grained models usually found in the AI-ED community. More concretely, we define a certain type of qualitative student models that take into account the strict prerequisite relation, and show how a quantitative model arises from it in a natural way.
Frontiers in Artificial Intelligence and Applications, 2009
The SIETTE collaborative environment allows students to take tests together in small groups. Indi... more The SIETTE collaborative environment allows students to take tests together in small groups. Individuals can communicate and hold discussions to solve test questions. This paper describes the summative evaluation of the SIETTE collaborative environment and the relationship between the collaboration and the actual improve ment which occurs in the student knowledge level. We conclude that under certain conditions improvement occurs and can be measured.
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2006
In this paper we present a proposal for introducing hint adaptive selection in an adaptive web-ba... more In this paper we present a proposal for introducing hint adaptive selection in an adaptive web-based testing environment. To this end, a discussion of some aspects concerning the adaptive selection mechanism for hints is presented, which results in the statement of two axioms that such hints must fulfil. Then, an empirical study with real students is presented, whose goal is to evaluate a tentative bank of items with their associated hints to determine the usefulness of such hints for different knowledge levels and to calibrate both test items and hints.
Frontiers in Artificial Intelligence and Applications, 2009
One of the most popular student modeling techniques currently available is Constraint Based Model... more One of the most popular student modeling techniques currently available is Constraint Based Modeling (CBM), which is based on Ohlsson's theory of learning from performance errors. It focuses on the domain principles to correct faulty knowledge and assumes that a student will reach a correct solution without violating these fundamental domain concepts. However, even though this is a powerful and computationally simple technique, most student models of CBM-based tutors handle simple long-term models or based on heuristics to quantitatively estimate the knowledge measured. In this paper we propose a student knowledge diagnosis model which combines CBM with the Item Response Theory (IRT). IRT is a probabilistic and data-driven theory which guarantees accurate and invariant student knowledge estimations. By means of this synergy between CBM and IRT we suggest the construction of long-term student models composed of the estimations of their knowledge. This paper also includes an experiment we have carried out with real students, which explores the validity of the diagnoses made with our model.
Lecture Notes in Computer Science, 2010
The Item Response Theory (IRT) is a statistical mechanism successfully used since the beginning o... more The Item Response Theory (IRT) is a statistical mechanism successfully used since the beginning of the 20th century to infer student knowledge through tests. Nevertheless, existing well-founded techniques to assess procedural tasks are generally complex and applied to well-defined tasks. In this paper, we describe how, using a set of techniques we have developed based on IRT, it is possible to infer declarative student knowledge through procedural tasks. We describe how these techniques have been used with undergraduate students, in the object oriented programming domain, through ill-defined procedural exercises.
Lecture Notes in Computer Science, 2004
R. Conejo et al. (Eds.): CAEPIA-TTIA 2003, LNAI 3040, pp. 676685, 2004. © Springer-Verlag Berlin... more R. Conejo et al. (Eds.): CAEPIA-TTIA 2003, LNAI 3040, pp. 676685, 2004. © Springer-Verlag Berlin Heidelberg 2004 ... TAPLI: An Adaptive Web-Based Learning Environment for Linear Programming ... Eva Millán, Emilio García-Hervás, Eduardo Guzmán De los Riscos, ...
Lecture Notes in Computer Science, 2003
... developed by our team for systems like EPLAR [4] (a problem solver for simplex problems), ILE... more ... developed by our team for systems like EPLAR [4] (a problem solver for simplex problems), ILESA [3] (a system capable of generating problems at the right level of difficulty based on the student model and also of coaching students while solving a problem ) and SIETTE [2] (a ...
INTELIGENCIA ARTIFICIAL, 2007
En este artıculo se presenta una propuesta para la introducción de mecanismos adaptativos para la... more En este artıculo se presenta una propuesta para la introducción de mecanismos adaptativos para la elección de ayudas, en un entorno de evaluación basado en tests adaptativos. El artıculo comienza con una discusión sobre aspectos relativos a mecanismos de selección ...
Lecture Notes in Computer Science, 2013
Lecture Notes in Computer Science, 2000
Socratic dialogues has been widely uses as a way of implement an ITS. The idea behind it is that ... more Socratic dialogues has been widely uses as a way of implement an ITS. The idea behind it is that the teaching and learning process should be based upon a personal reflection that can be obtained posing the right question on a guided dialogue. This methodology assumes that the knowledge acquisition is a discovering process in which both the teacher and the student plays an active role. This tutorial strategy has been developed as a part of a web based ITS architecture for declarative domains and it has been applied to the botanical domain. In this paper we describe this component, the knowledge representation that support it and the web interface used