Enriched rater training using Internet based technologies: a comparison to traditional rater training in a multi-site depression trial - PubMed (original) (raw)
Randomized Controlled Trial
Enriched rater training using Internet based technologies: a comparison to traditional rater training in a multi-site depression trial
Kenneth A Kobak et al. J Psychiatr Res. 2006 Apr.
Abstract
Objective: The evaluation and training of raters who conduct efficacy evaluations in clinical trials is an important methodological variable that is often overlooked. Few rater training programs focus on teaching and assessing applied clinical skills, and even fewer have been empirically examined for efficacy. The goal of this study was to develop a comprehensive, standardized, interactive rater training program using new technologies, and to compare the relative effectiveness of this approach to "traditional" rater training in a multi-center clinical trial.
Method: 12 sites from a 22 site multi-center study were randomly selected to participate (6=traditional, 6=enriched). Traditional training consisted of an overview of scoring conventions, watching and scoring videotapes with discussion, and observation of interviews in small groups with feedback. Enriched training consisted of an interactive web tutorial, and live, remote observation of trainees conducting interviews with real or standardized patients, via video- or teleconference. Outcome measures included a didactic exam on conceptual knowledge and blinded ratings of trainee's audiotaped interviews.
Results: A significant difference was found between enriched and traditional training on pre-to-post training improvement on didactic knowledge, t(27)=4.2, p<0.0001. Enriched trainees clinical skills also improved significantly more than traditional trainees, t(56)=2.1, p=0.035. All trainees found the applied training helpful, and wanted similar web tutorials with other scales.
Conclusions: Results support the efficacy of enriched rater training in improving both conceptual knowledge and applied skills. Remote technologies enhance training efforts, and make training accessible and cost-effective. Future rater training efforts should be subject to empirical evaluation, and include training on applied skills.
Comment in
- Response to letter from Lipsitz et al.
Khan A, Faucett J, Brown WA. Khan A, et al. J Psychiatr Res. 2014 Oct;57:180-1. doi: 10.1016/j.jpsychires.2014.06.016. Epub 2014 Jun 26. J Psychiatr Res. 2014. PMID: 25012188 No abstract available. - Effects of structured interview guides and rater monitoring in clinical trials.
Lipsitz JD, Kobak K, Williams JB, Engelhardt N. Lipsitz JD, et al. J Psychiatr Res. 2014 Oct;57:178-9. doi: 10.1016/j.jpsychires.2014.06.014. Epub 2014 Jul 5. J Psychiatr Res. 2014. PMID: 25062754 No abstract available.
Similar articles
- Development of a standardized training program for the Hamilton Depression Scale using internet-based technologies: results from a pilot study.
Kobak KA, Lipsitz JD, Feiger A. Kobak KA, et al. J Psychiatr Res. 2003 Nov-Dec;37(6):509-15. doi: 10.1016/s0022-3956(03)00056-6. J Psychiatr Res. 2003. PMID: 14563382 - PANSS rater training using Internet and videoconference: results from a pilot study.
Kobak KA, Opler MG, Engelhardt N. Kobak KA, et al. Schizophr Res. 2007 May;92(1-3):63-7. doi: 10.1016/j.schres.2007.01.011. Epub 2007 Mar 1. Schizophr Res. 2007. PMID: 17336501 Clinical Trial. - A new approach to rater training and certification in a multicenter clinical trial.
Kobak KA, Lipsitz JD, Williams JB, Engelhardt N, Bellew KM. Kobak KA, et al. J Clin Psychopharmacol. 2005 Oct;25(5):407-12. doi: 10.1097/01.jcp.0000177666.35016.a0. J Clin Psychopharmacol. 2005. PMID: 16160614 - Rater Training in Medical Education: A Scoping Review.
Vergis A, Leung C, Roberston R. Vergis A, et al. Cureus. 2020 Nov 6;12(11):e11363. doi: 10.7759/cureus.11363. Cureus. 2020. PMID: 33304696 Free PMC article. Review. - [Using Technology to Optimize the Training of Mental Health Providers in Evidence-Based Treatment: State of Knowledge].
Bond S, Binet É, Pudelko B. Bond S, et al. Sante Ment Que. 2021 Spring;46(1):71-95. Sante Ment Que. 2021. PMID: 34597489 Review. French.
Cited by
- Web-based training in early autism screening: results from a pilot study.
Kobak KA, Stone WL, Ousley OY, Swanson A. Kobak KA, et al. Telemed J E Health. 2011 Oct;17(8):640-4. doi: 10.1089/tmj.2011.0029. Telemed J E Health. 2011. PMID: 21939382 Free PMC article. - Why do so many drugs for Alzheimer's disease fail in development? Time for new methods and new practices?
Becker RE, Greig NH, Giacobini E. Becker RE, et al. J Alzheimers Dis. 2008 Oct;15(2):303-25. doi: 10.3233/jad-2008-15213. J Alzheimers Dis. 2008. PMID: 18953116 Free PMC article. Review. - Neuropsychiatric clinical trials: should they accommodate real-world practices or set standards for clinical practices?
Becker RE, Greig NH. Becker RE, et al. J Clin Psychopharmacol. 2009 Feb;29(1):56-64. doi: 10.1097/JCP.0b013e318192e2fa. J Clin Psychopharmacol. 2009. PMID: 19142109 Free PMC article. - Modifying a cognitive behavioral suicide prevention treatment for adults with schizophrenia spectrum disorders in community mental health.
Bornheimer LA, Li Verdugo J, Holzworth J, Im V, Smith FN, Sliwa H, Taylor SF, King CA, Florence T, Tarrier N, Himle JA. Bornheimer LA, et al. Psychiatry Res. 2022 May;311:114505. doi: 10.1016/j.psychres.2022.114505. Epub 2022 Mar 7. Psychiatry Res. 2022. PMID: 35290884 Free PMC article. - Effect of rater training on reliability and accuracy of mini-CEX scores: a randomized, controlled trial.
Cook DA, Dupras DM, Beckman TJ, Thomas KG, Pankratz VS. Cook DA, et al. J Gen Intern Med. 2009 Jan;24(1):74-9. doi: 10.1007/s11606-008-0842-3. Epub 2008 Nov 11. J Gen Intern Med. 2009. PMID: 19002533 Free PMC article. Clinical Trial.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical