Effects of Postgraduate Medical Education “Boot Camps” on Clinical Skills, Knowledge, and Confidence: A Meta-Analysis (original) (raw)
Related papers
Journal of Surgical Education
Preparatory training for new trainees beginning residency has been used by a variety of programs across the country. To improve the clinical orientation process for our new postgraduate year (PGY)-1 residents, we developed an intensive preparatory training curriculum inclusive of cognitive and procedural skills, training activities considered essential for early PGY-1 clinical management. We define our surgical PGY-1 Boot Camp as preparatory simulation-based training implemented at the onset of internship for introduction of skills necessary for basic surgical patient problem assessment and management. This orientation process includes exposure to simulated patient care encounters and technical skills training essential to new resident education. We report educational results of 4 successive years of Boot Camp training. Results were analyzed to determine if performance evidenced at onset of training was predictive of later educational outcomes.Learners were PGY-1 residents, in both categorical and preliminary positions, at our medium-sized surgical residency program. Over a 4-year period, from July 2007 to July 2010, all 30 PGY-1 residents starting surgical residency at our institution underwent specific preparatory didactic and skills training over a 9-week period. This consisted of mandatory weekly 1-hour and 3-hour sessions in the Simulation Center, representing a 4-fold increase in time in simulation laboratory training compared with the remainder of the year. Training occurred in 8 procedural skills areas (instrument use, knot-tying, suturing, laparoscopic skills, airway management, cardiopulmonary resuscitation, central venous catheter, and chest tube insertion) and in simulated patient care (shock, surgical emergencies, and respiratory, cardiac, and trauma management) using a variety of high- and low-tech simulation platforms. Faculty and senior residents served as instructors. All educational activities were structured to include preparatory materials, pretraining briefing sessions, and immediate in-training or post-training review and debriefing. Baseline cognitive skills were assessed with written tests on basic patient management. Post-Boot Camp tests similarly evaluated cognitive skills. Technical skills were assessed using a variety of task-specific instruments, and expressed as a mean score for all activities for each resident. All measurements were expressed as percent (%) best possible score. Cognitive and technical performance in Boot Camp was compared with subsequent clinical and core curriculum evaluations including weekly quiz scores, annual American Board of Surgery In-Training Examination (ABSITE) scores, program in-training evaluations (New Innovations, Uniontown, Ohio), and operative assessment instrument scores (OP-Rate, Baystate Medical Center, Springfield, Massachusetts) for the remainder of the PGY-1 year.Performance data were available for 30 PGY-1 residents over 4 years. Baseline cognitive skills were lower for the first year of Boot Camp as compared with subsequent years (71 ± 13, 83 ± 9, 84 ± 11, and 86 ± 6, respectively; p = 0.028, analysis of variance; ANOVA). Performance improved between pretests and final testing (81 ± 11 vs 89 ± 7; p < 0.001 paired t test). There was statistically significant correlation between Boot Camp final cognitive test results and American Board of Surgery In-Training Examination scores (p = 0.01; n = 22), but not quite significant for weekly curriculum quiz scores (p = 0.055; n = 22) and New Innovations cognitive assessments (p = 0.09; n = 25). Statistically significant correlation was also noted between Boot Camp mean overall skills and New Innovations technical skills assessments (p = 0.002; n = 25) and OP-Rate assessments (p = 0.01; n = 12).Individual simulation-based Boot Camp performance scores for cognitive and procedural skills assessments in PGY-1 residents correlate with subjective and objective clinical performance evaluations. This concurrent correlation with multiple traditional evaluation methods used to express competency in our residency program supports the use of Boot Camp performance measures as needs assessment tools as well as adjuncts to cumulative resident evaluation data.
Pediatric Emergency Care, 2016
Objectives Residents beginning their specialization in pediatrics and emergency medicine (EM) are rapidly involved in oncall duties. Early acquisition of crisis resource management by novice residents is essential for patient safety, but traditional training may be insufficient. Our aim was to investigate the impact of a 2-day simulation-based course on residents to manage pediatric and neonatal patients. Methods First year residents participated in the course. They completed two questionnaires concerning perceived stress and self-efficacy in technical skills (TSs) and non-TSs (NTSs) at 3 times: before (T0), after (T1), and 6 weeks after the course (T2). Results Eleven pediatric and 5 EM residents participated. At T0, stress about “communicating with parents” (P = 0.022) and “coordinating the team” (P = .037) was significantly higher among pediatric compared with EM residents; self-efficacy was not different between the specialities. After training, perceived stress about “managing ...
Cureus, 2016
The transition from medical student to intern is a challenging process characterized by a steep learning curve. Focused courses targeting skills necessary for success as a resident have increased self-perceived preparedness, confidence, and medical knowledge. Our aim was to create a brief educational intervention for 4th-year medical students entering pediatric, family practice, and medicine/pediatric residencies to target skills necessary for an internship. The curriculum used a combination of didactic presentations, small group discussions, roleplaying, facilitated debriefing, and simulation-based education. Participants completed an objective structured clinical exam requiring synthesis and application of multiple boot camp elements before and after the elective. Participants completed anonymous surveys assessing self-perceived preparedness for an internship, overall and in regards to specific skills, before the elective and after the course. Participants were asked to provide feedback about the course. Using checklists to assess performance, students showed an improvement in performing infant lumbar punctures (47.2% vs 77.0%; p < 0.01, 95% CI for the difference 0.2, 0.4%) and providing signout (2.5 vs. 3.9 (5-point scale) p < 0.01, 95% CI for the difference 0.6, 2.3). They did not show an improvement in communication with a parent. Participants demonstrated an increase in self-reported preparedness for all targeted skills, except for obtaining consults and interprofessional communication. There was no increase in reported overall preparedness. All participants agreed with the statements, "The facilitators presented the material in an effective manner," "I took away ideas I plan to implement in internship," and "I think all students should participate in a similar experience." When asked to assess the usefulness of individual modules, all except order writing received a mean Likert score > 4. A focused boot camp addressing key knowledge and skills required for pediatric-related residencies was well received and led to improved performance of targeted skills and increased self-reported preparedness in many targeted domains.
2021
IntroductionExpectation of competence from interns and residents from outset stresses the need for bridging the gap between undergraduate and post-graduate worlds, in terms of clinical skills. Worldwide, simulation-based boot camps ease this transition and equip novice trainees with essential foundation knowledge, technical skills, and effective communication. This study describes the introduction, change management process, and analyzes effectiveness of first-ever boot camp in Pakistan aimed at improving self-efficacy of PGME interns and residents. A boot camp of 4 days duration was conducted in December 2018 at The Aga Khan University Hospital (AKUH) for newly inducted PGME interns and residents. 40 residents and 68 interns completed a self-administered self-efficacy questionnaire after boot camp.ResultsThere was a significant overall improvement in self-efficacy of trainees across all skills. Self-efficacy improved most in CVC insertion, hospital management software) and communic...
Evaluation of medical student retention of clinical skills following simulation training
BMC Medical Education
Background: Adequate clinical skills training is a challenge for present day medical education. Simulation Based Education (SBE) is playing an increasingly important role in healthcare education worldwide to teach invasive procedures. The impact of this teaching on students along with retention of what is taught is not fully understood. The purpose of this study was to evaluate the retention levels of practical skills taught and assessed by SBE and to explore the degree of retraining required to restore decayed performance. In exploring this aim, the study further investigates how skilled performance decays over time and which dimensions of clinical skills were more likely to decay. Methods: Study participants were 51 final year medical students. They were provided with online pre-course videos and procedural guides asynchronously with repeatedly access. 7 of the skills taught over 2 years using task trainers were selected. Following demonstration from faculty, students practiced in small groups with faculty facilitated supervision and peer support prior to formal testing. Score sheets with itemised procedure checklists detailing the minimum passing standard (MPS) for each skill were designed. To test retention of skills, 18 months later, there was an unannounced test to demonstrate proficiency in the skills. Students were asked to complete a questionnaire indicating how many times and where they had practiced or performed the skills. Results: 55% of the students were deficient in 3 or more skills and 4% were not competent in 5 or more skills. A significant number of students had never practiced some skills following the initial teaching session. A relationship was noted with the number of times students self-declared that they had practiced and their performance. Decay is evident in both psychomotor and cognitive domains of the skills. Conclusion: A curriculum with deliberate practice significantly increases the competence of students in defined clinical skills. Deliberate practice of clinical skills, under supervision of an engaged instructor, is a key component of the mastery model. Experiences and assessments in the clinical setting need to be augmented with focus on direct observation and focused feedback to reinforce the skills acquired in the simulated setting.
Advances in Simulation, 2021
Background Simulation-based mastery learning (SBML) is an effective, evidence-based methodology for procedural skill acquisition, but its application may be limited by its resource intensive nature. To address this issue, an enhanced SBML programme has been developed by the addition of both pre-learning and peer learning components. These components allowed the enhanced programme to be scaled up and delivered to 106 postgraduate doctors participating in a national educational teaching programme. Methods The pre-learning component consisted of an online reading pack and videos. The peer learning component consisted of peer-assisted deliberate practice and peer observation of assessment and feedback within the SBML session. Anonymised pre- and post-course questionnaires were completed by learners who participated in the enhanced programme. A mixture of quantitative and qualitative data was obtained. Results Questionnaires were distributed to and completed by 50 learners. Both sections...
This paper reports on a research project conducted at the Advanced Clinical Skills Centre, University of Auckland, to determine whether the provision of a carefully engineered integrated virtual reality simulator for male and female urinary catheter insertion would increase student confidence levels and competency for those two skills. We present a literature review that demonstrates the increasing importance of simulation in medical education whilst detailing the perceived benefits and drawbacks of using simulations in medical education. We then present our research methodology including student numbers, procedures followed during the research, forms of evaluation carried out during the research and the current research stage. We conclude with the difficulties encountered in our study and a statement concerning the current status of our research. Research Background The Advanced Clinical Skills Centre at the University of Auckland offers courses at all levels in clinical procedures including: Advanced Cardiac Life Support (ACLS), crisis management in anaesthesia, open and laparoscopic surgery, general surgery, gynaecology, orthopaedics, general practice, theatre nursing and other disciplines. Modern methods used in an attempt to foster improved skill acquisition in the area of medical education include the provision of video material, multimedia presentations and use of post training course simulations (Issenberg et al., 2007). Simulation is becoming increasingly recognized as a method for training