Evaluations of situational judgement tests to assess non-academic attributes in selection - PubMed (original) (raw)
Review
Evaluations of situational judgement tests to assess non-academic attributes in selection
Fiona Patterson et al. Med Educ. 2012 Sep.
Abstract
Objectives: This paper presents a systematic review of the emerging international research evidence for the use of situational judgement tests (SJTs) for testing important non-academic attributes (such as empathy, integrity and resilience) in selection processes.
Methods: Several databases (e.g. MEDLINE, PsycINFO, Web of Science) were searched to retrieve empirical studies relating to SJTs published between 1990 and 2010. Personal contact with experts in the field was made to identify any unpublished research or work in progress to obtain the most current material. Finally, reference lists were checked to access other relevant journal articles and further research. All research studies were required to meet specific inclusion criteria selected by two independent reviewers.
Results: Over 1000 citations were identified during the initial literature search; following the review of abstracts, full-text copies of 76 articles were retrieved and evaluated. A total of 39 articles that adequately met the inclusion criteria were included in the final review. The research evidence shows that, compared with personality and IQ tests, SJTs have good levels of reliability, predictive validity and incremental validity for testing a range of professional attributes, such as empathy and integrity.
Conclusions: SJTs can be designed to test a broad range of non-academic constructs depending on the selection context. As a relatively low-fidelity assessment, SJTs are a cost-efficient methodology compared with high-fidelity assessments of non-academic attributes, such as those used in objective structured clinical examinations. In general, SJTs are found to demonstrate less adverse impact than IQ tests and are positively received by candidates. Further research is required to explore theoretical developments and the underlying construct validity of SJTs.
© Blackwell Publishing Ltd 2012.
Comment in
- Situational judgement tests: the role of coaching.
Rostom H, Watson R, Leaver L. Rostom H, et al. Med Educ. 2013 Feb;47(2):219. doi: 10.1111/medu.12070. Med Educ. 2013. PMID: 23323662 No abstract available. - Situational judgement tests represent a measurement method and can be designed to minimise coaching effects.
Patterson F, Ashworth V, Kerrin M, O'Neill P. Patterson F, et al. Med Educ. 2013 Feb;47(2):220-1. doi: 10.1111/medu.12100. Med Educ. 2013. PMID: 23323663 No abstract available.
Similar articles
- Situational judgement tests in medical education and training: Research, theory and practice: AMEE Guide No. 100.
Patterson F, Zibarras L, Ashworth V. Patterson F, et al. Med Teach. 2016;38(1):3-17. doi: 10.3109/0142159X.2015.1072619. Epub 2015 Aug 27. Med Teach. 2016. PMID: 26313700 Review. - Situational judgement tests for selection: Traditional vs construct-driven approaches.
Tiffin PA, Paton LW, O'Mara D, MacCann C, Lang JWB, Lievens F. Tiffin PA, et al. Med Educ. 2020 Feb;54(2):105-115. doi: 10.1111/medu.14011. Epub 2019 Dec 23. Med Educ. 2020. PMID: 31872483 - How effective are selection methods in medical education? A systematic review.
Patterson F, Knight A, Dowell J, Nicholson S, Cousans F, Cleland J. Patterson F, et al. Med Educ. 2016 Jan;50(1):36-60. doi: 10.1111/medu.12817. Med Educ. 2016. PMID: 26695465 Review. - The educational value of situational judgement tests (SJTs) when used during undergraduate medical training: A systematic review and narrative synthesis.
Sahota GS, Fisher V, Patel B, JuJ K, Taggar JS. Sahota GS, et al. Med Teach. 2023 Sep;45(9):997-1004. doi: 10.1080/0142159X.2023.2168183. Epub 2023 Jan 28. Med Teach. 2023. PMID: 36708605 - Could situational judgement tests be used for selection into dental foundation training?
Patterson F, Ashworth V, Mehra S, Falcon H. Patterson F, et al. Br Dent J. 2012 Jul 13;213(1):23-6. doi: 10.1038/sj.bdj.2012.560. Br Dent J. 2012. PMID: 22790752
Cited by
- Opening the black box of selection.
Schreurs S, Cleutjens K, Collares CF, Cleland J, Oude Egbrink MGA. Schreurs S, et al. Adv Health Sci Educ Theory Pract. 2020 May;25(2):363-382. doi: 10.1007/s10459-019-09925-1. Epub 2019 Oct 9. Adv Health Sci Educ Theory Pract. 2020. PMID: 31598883 Free PMC article. - Evaluation of a Situational Judgement Test to Develop Non-Academic Skills in Pharmacy Students.
Patterson F, Galbraith K, Flaxman C, Kirkpatrick CMJ. Patterson F, et al. Am J Pharm Educ. 2019 Dec;83(10):7074. doi: 10.5688/ajpe7074. Am J Pharm Educ. 2019. PMID: 32001871 Free PMC article. - Influence of response instructions and response format on applicant perceptions of a situational judgement test for medical school selection.
De Leng WE, Stegers-Jager KM, Born MP, Themmen APN. De Leng WE, et al. BMC Med Educ. 2018 Nov 26;18(1):282. doi: 10.1186/s12909-018-1390-0. BMC Med Educ. 2018. PMID: 30477494 Free PMC article. - A scoping review of admission criteria and selection methods in nursing education.
Zamanzadeh V, Ghahramanian A, Valizadeh L, Bagheriyeh F, Lynagh M. Zamanzadeh V, et al. BMC Nurs. 2020 Dec 14;19(1):121. doi: 10.1186/s12912-020-00510-1. BMC Nurs. 2020. PMID: 33317532 Free PMC article. - Development and testing of a summative video-based e-examination in relation to an OSCE for measuring communication-related factual and procedural knowledge of medical students.
Ludwig S, Behling L, Schmidt U, Fischbeck S. Ludwig S, et al. GMS J Med Educ. 2021 Mar 15;38(3):Doc70. doi: 10.3205/zma001466. eCollection 2021. GMS J Med Educ. 2021. PMID: 33824906 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Research Materials
Miscellaneous