Potential Uses Of On Line Performance Assessments In Engineering Education: Measuring Complex Learning Outcomes And Processes (original) (raw)

2001 Annual Conference Proceedings

Modern engineering education is undergoing significant changes, particularly in the way engineering schools are adopting problem-based instruction to meet the changing demands of practice. Increasingly, engineering schools are requiring students to work on team projects that are open-ended with loosely specified requirements, produce professional-quality reports and presentations, consider ethics and the impact of their field on society, and develop lifelong learning practices. While there exist numerous implementations of courses adopting these methods to purportedly improve student learning, measuring the impact of problem-based instruction remains challenging. The existing evidence generally suffers from methodological shortcomings such as reliance on students' self-reported perceptions of learning (vs. more direct measures of learning), use of instructors' anecdotal reports of impact (vs. experimental manipulation), use of untested (vs. validated) measures, and small sample sizes. This paper discusses the potential role of computer-based performance assessments in evaluating student learning on complex, open-ended problem-solving tasks. The discussion is framed within the research on computer-based performance assessments developed at the National Center for Research on Evaluation, Standards, and Student Testing (CRESST). Examples of three kinds of on-line performance assessments are presented as well as lessons learned. I. Changes in Modern Engineering Education Modern engineering education is undergoing significant changes, notably in the way engineering schools are adopting problem-based instruction to meet the changing demands of engineering practice 1-7. Mastery of technical content is no longer sufficient. Increasingly, engineering schools are requiring students to work on team projects that are open-ended with loosely specified requirements, produce professional-quality reports and presentations, consider ethics and the impact of their field on society, and develop lifelong learning practices. An implicit goal of this shift in curricula is to produce graduates who will be ready to assume engineering tasks upon graduation-that is, with the skills to develop solutions to problems under