Assessing the Assessment : using psychometrics to establish reliability and validity of portfolio assessment (original) (raw)
Handledare: Ann-Christin Haffling 'credibility' (internal validity) for the assessment structure. Reliability Reliability is the criteria equivalent to instrumental measurement precision, the consistency of repeated tests or the reproducibility and repeatability (2, 11). In portfolio assessment it can be enhanced by standardization of portfolio content, definition of analytical assessment criteria, clear guidelines to students (12) and discussion and negotiation between examiners (13). Reliability can also be improved by a personal examiner interview (12). In the assessment of portfolios, the inter-rater-reliability is the main issue. The terminology and the tools for analysis of inter-rater reliability are not definite (14). The intersecting area in medical teaching of medical and social science offers a field for discussion. Clear-cut methods and procedures must be established, for the portfolio to be regarded as a good summative assessment tool. Definitions and methods Recently guidelines for inter-rater reliability and agreement have been proposed (15), albeit in the field of medical science. However, these guidelines can be used to improve reporting in the field of medical education.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.