Evaluations of situational judgement tests to assess non-academic attributes in selection - PubMed (original) (raw)
Evaluations of situational judgement tests to assess non-academic attributes in selection
Fiona Patterson et al. Med Educ. 2012 Sep.
Abstract
Objectives: This paper presents a systematic review of the emerging international research evidence for the use of situational judgement tests (SJTs) for testing important non-academic attributes (such as empathy, integrity and resilience) in selection processes.
Methods: Several databases (e.g. MEDLINE, PsycINFO, Web of Science) were searched to retrieve empirical studies relating to SJTs published between 1990 and 2010. Personal contact with experts in the field was made to identify any unpublished research or work in progress to obtain the most current material. Finally, reference lists were checked to access other relevant journal articles and further research. All research studies were required to meet specific inclusion criteria selected by two independent reviewers.
Results: Over 1000 citations were identified during the initial literature search; following the review of abstracts, full-text copies of 76 articles were retrieved and evaluated. A total of 39 articles that adequately met the inclusion criteria were included in the final review. The research evidence shows that, compared with personality and IQ tests, SJTs have good levels of reliability, predictive validity and incremental validity for testing a range of professional attributes, such as empathy and integrity.
Conclusions: SJTs can be designed to test a broad range of non-academic constructs depending on the selection context. As a relatively low-fidelity assessment, SJTs are a cost-efficient methodology compared with high-fidelity assessments of non-academic attributes, such as those used in objective structured clinical examinations. In general, SJTs are found to demonstrate less adverse impact than IQ tests and are positively received by candidates. Further research is required to explore theoretical developments and the underlying construct validity of SJTs.
© Blackwell Publishing Ltd 2012.
Comment in
- Situational judgement tests: the role of coaching.
Rostom H, Watson R, Leaver L. Rostom H, et al. Med Educ. 2013 Feb;47(2):219. doi: 10.1111/medu.12070. Med Educ. 2013. PMID: 23323662 No abstract available. - Situational judgement tests represent a measurement method and can be designed to minimise coaching effects.
Patterson F, Ashworth V, Kerrin M, O'Neill P. Patterson F, et al. Med Educ. 2013 Feb;47(2):220-1. doi: 10.1111/medu.12100. Med Educ. 2013. PMID: 23323663 No abstract available.
Similar articles
- The educational effects of portfolios on undergraduate student learning: a Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11.
Buckley S, Coleman J, Davison I, Khan KS, Zamora J, Malick S, Morley D, Pollard D, Ashcroft T, Popovic C, Sayers J. Buckley S, et al. Med Teach. 2009 Apr;31(4):282-98. doi: 10.1080/01421590902889897. Med Teach. 2009. PMID: 19404891 - Education support services for improving school engagement and academic performance of children and adolescents with a chronic health condition.
Barnett T, Tollit M, Ratnapalan S, Sawyer SM, Kelaher M. Barnett T, et al. Cochrane Database Syst Rev. 2023 Feb 8;2(2):CD011538. doi: 10.1002/14651858.CD011538.pub2. Cochrane Database Syst Rev. 2023. PMID: 36752365 Free PMC article. - How effective are selection methods in medical education? A systematic review.
Patterson F, Knight A, Dowell J, Nicholson S, Cousans F, Cleland J. Patterson F, et al. Med Educ. 2016 Jan;50(1):36-60. doi: 10.1111/medu.12817. Med Educ. 2016. PMID: 26695465 - The measurement and monitoring of surgical adverse events.
Bruce J, Russell EM, Mollison J, Krukowski ZH. Bruce J, et al. Health Technol Assess. 2001;5(22):1-194. doi: 10.3310/hta5220. Health Technol Assess. 2001. PMID: 11532239 - The effectiveness of interventions to treat severe acute malnutrition in young children: a systematic review.
Picot J, Hartwell D, Harris P, Mendes D, Clegg AJ, Takeda A. Picot J, et al. Health Technol Assess. 2012;16(19):1-316. doi: 10.3310/hta16190. Health Technol Assess. 2012. PMID: 22480797 Free PMC article.
Cited by
- Medical student selection criteria and junior doctor workplace performance.
Sladek RM, Burdeniuk C, Jones A, Forsyth K, Bond MJ. Sladek RM, et al. BMC Med Educ. 2019 Oct 21;19(1):384. doi: 10.1186/s12909-019-1829-y. BMC Med Educ. 2019. PMID: 31638981 Free PMC article. - Validity of constructed-response situational judgment tests in training programs for the health professions: A systematic review and meta-analysis protocol.
Mortaz Hejri S, Ho JL, Pan X, Park YS, Sam AH, Mangardich H, MacIntosh A. Mortaz Hejri S, et al. PLoS One. 2023 Jan 26;18(1):e0280493. doi: 10.1371/journal.pone.0280493. eCollection 2023. PLoS One. 2023. PMID: 36701397 Free PMC article. - Incorporating a situational judgement test in residency selections: clinical, educational and organizational outcomes.
Saxena A, Desanghere L, Dore K, Reiter H. Saxena A, et al. BMC Med Educ. 2024 Mar 26;24(1):339. doi: 10.1186/s12909-024-05310-8. BMC Med Educ. 2024. PMID: 38532412 Free PMC article. - Evaluation of two selection tests for recruitment into radiology specialty training.
Patterson F, Knight A, McKnight L, Booth TC. Patterson F, et al. BMC Med Educ. 2016 Jul 11;16:170. doi: 10.1186/s12909-016-0687-0. BMC Med Educ. 2016. PMID: 27400783 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Research Materials
Miscellaneous