Jonathan Rubright - Academia.edu (original) (raw)
Uploads
Papers by Jonathan Rubright
Movement disorders : official journal of the Movement Disorder Society, Jan 7, 2015
The aim of this work was to describe the development and psychometric analysis of the Penn Parkin... more The aim of this work was to describe the development and psychometric analysis of the Penn Parkinson's Daily Activities Questionnaire. The questionnaire is an item response theory-based tool for rating cognitive instrumental activities of daily living in PD. Candidate items for the Penn Parkinson's Daily Activities Questionnaire were developed through literature review and focus groups of patients and knowledgeable informants. Item selection and calibration of item-response theory parameters were performed using responses from a cohort of PD patients and knowledgeable informants (n = 388). In independent cohorts of PD patients and knowledgeable informants, assessments of test-retest reliability (n = 50), and construct validity (n = 68) of the questionnaire were subsequently performed. Construct validity was assessed by correlating questionnaire scores with measures of motor function, cognition, an existing activities of daily living measure, and directly observed daily funct...
The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry, 2010
Early and progressive cognitive impairments of patients with Alzheimer disease (AD) hinder their ... more Early and progressive cognitive impairments of patients with Alzheimer disease (AD) hinder their capacity to provide informed consent. Unfortunately, the limited research on techniques to improve capacity has shown mixed results. Therefore, the authors tested whether a memory and organizational aid improves the performance of patients with AD on measures of capacity and competency to give informed consent. Patients with AD randomly assigned to standard consent or standard plus a memory and organizational aid. Memory and organizational aid summarized the content of information mandated under the informed consent disclosure requirements of the Common Rule at a sixth grade reading level. Three psychiatrists without access to patient data independently reviewed MacArthur Competence Assessment Tool for Clinical Research (MacCAT-CR) interview transcripts to judge whether the patient was capable of providing informed consent. The agreement of at least two of the three experts defined a par...
Journal of Surgical Education, 2012
The purpose of this study was to explore the relationship between qualifying examination (QE) and... more The purpose of this study was to explore the relationship between qualifying examination (QE) and certifying examination (CE) results and to determine whether an appropriate cut-point on the QE would predict success on the CE. The scaled American Board of Surgery (ABS) QE scores of all first-time examinees from 2006 to 2010 were retrospectively matched to their first-time CE pass/fail decisions. Contingency tables illustrating the QE-CE relationship were constructed and appropriate correlational statistics were computed. A receiver operating characteristic (ROC) curve analysis was constructed, with sensitivity and 1-specificity calculated for each possible QE cut-point used to predicted CE pass/fail classifications. Additionally, the area under the curve (AUC) was calculated. All first-time American Board of Surgery examinees for the Surgery Qualifying Examination from 2006 to 2010. A total of 4385 surgeons were analyzed, with QE scores averaging 82.1 ± 5.8 (range, 58-99) and 82.8% of surgeons passing the CE on their first attempt. Contingency tables suggest a moderate relationship between QE and CE performance, although correlation indexes are low (phi = 0.13, point-biserial = 0.23). For the ROC analysis, the AUC = 0.674 (95% CI; 0.654-0.695) provides a better than chance pass/fail classification (p < 0.001), yet does not meet the minimum threshold for acceptability as a predictive test. No QE cut-point accurately predicted CE pass/fail decisions. While a moderate relationship between QE scores and CE performance is evident, correlations suggest that the 2 examinations measure different abilities. The low AUC value on the ROC analysis, along with poor predictability at all possible cut-points, show that no appropriate cut-point on the QE predicts success on the CE. These data add to the validity of both tests by providing evidence that distinct latent traits are being measured by both tests.
Journal of Empirical Research on Human Research Ethics: An International Journal, 2011
Alzheimer's & Dementia, 2007
Alzheimer's & Dementia, 2008
Surgery, 2012
The American Board of Surgery (ABS) Qualifying Examination (QE) represents an important step alon... more The American Board of Surgery (ABS) Qualifying Examination (QE) represents an important step along the pathway to board certification. We investigated whether candidates who delayed taking the QE had worse performance on the examination. QE pass rates and equated scaled scores for all first-time examinees from 2006 to 2010 (n = 5,193) were reviewed. After eliminating examinees who could not be matched to final ABS In-Training Examination (ABSITE) scores, the remaining cohort (n = 4,909) was analyzed by comparing those who took the exam immediately after residency (Immediate, n = 4,488) to those who delayed for 1 or more years (Delay, n = 421). The Immediate group had a mean first-time QE pass rate of 87% compared to 57% for those who delayed 1 year and 48% for those who delayed 2 or more years (P < .001). Regression analysis demonstrated that delay in taking the QE remained a significant determinant of exam failure after controlling for ABSITE scores (odds ratio = 0.35; 95% CI, 0.29-0.43; P = .001). Undergraduate medical education and postresidency training did not affect the results. The Delay group had lower equated scaled scores, a greater ultimate failure rate on the QE, and was more likely to fail the ABS Certifying Examination on the first attempt. These results demonstrate that candidates who delayed taking the QE immediately are at extremely high risk for exam failure and failure to achieve board certification. These findings presumably are due to deterioration of knowledge over time, but they also may represent characteristics of the Delay group that are currently undefined.
Movement disorders : official journal of the Movement Disorder Society, Jan 7, 2015
The aim of this work was to describe the development and psychometric analysis of the Penn Parkin... more The aim of this work was to describe the development and psychometric analysis of the Penn Parkinson's Daily Activities Questionnaire. The questionnaire is an item response theory-based tool for rating cognitive instrumental activities of daily living in PD. Candidate items for the Penn Parkinson's Daily Activities Questionnaire were developed through literature review and focus groups of patients and knowledgeable informants. Item selection and calibration of item-response theory parameters were performed using responses from a cohort of PD patients and knowledgeable informants (n = 388). In independent cohorts of PD patients and knowledgeable informants, assessments of test-retest reliability (n = 50), and construct validity (n = 68) of the questionnaire were subsequently performed. Construct validity was assessed by correlating questionnaire scores with measures of motor function, cognition, an existing activities of daily living measure, and directly observed daily funct...
The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry, 2010
Early and progressive cognitive impairments of patients with Alzheimer disease (AD) hinder their ... more Early and progressive cognitive impairments of patients with Alzheimer disease (AD) hinder their capacity to provide informed consent. Unfortunately, the limited research on techniques to improve capacity has shown mixed results. Therefore, the authors tested whether a memory and organizational aid improves the performance of patients with AD on measures of capacity and competency to give informed consent. Patients with AD randomly assigned to standard consent or standard plus a memory and organizational aid. Memory and organizational aid summarized the content of information mandated under the informed consent disclosure requirements of the Common Rule at a sixth grade reading level. Three psychiatrists without access to patient data independently reviewed MacArthur Competence Assessment Tool for Clinical Research (MacCAT-CR) interview transcripts to judge whether the patient was capable of providing informed consent. The agreement of at least two of the three experts defined a par...
Journal of Surgical Education, 2012
The purpose of this study was to explore the relationship between qualifying examination (QE) and... more The purpose of this study was to explore the relationship between qualifying examination (QE) and certifying examination (CE) results and to determine whether an appropriate cut-point on the QE would predict success on the CE. The scaled American Board of Surgery (ABS) QE scores of all first-time examinees from 2006 to 2010 were retrospectively matched to their first-time CE pass/fail decisions. Contingency tables illustrating the QE-CE relationship were constructed and appropriate correlational statistics were computed. A receiver operating characteristic (ROC) curve analysis was constructed, with sensitivity and 1-specificity calculated for each possible QE cut-point used to predicted CE pass/fail classifications. Additionally, the area under the curve (AUC) was calculated. All first-time American Board of Surgery examinees for the Surgery Qualifying Examination from 2006 to 2010. A total of 4385 surgeons were analyzed, with QE scores averaging 82.1 ± 5.8 (range, 58-99) and 82.8% of surgeons passing the CE on their first attempt. Contingency tables suggest a moderate relationship between QE and CE performance, although correlation indexes are low (phi = 0.13, point-biserial = 0.23). For the ROC analysis, the AUC = 0.674 (95% CI; 0.654-0.695) provides a better than chance pass/fail classification (p < 0.001), yet does not meet the minimum threshold for acceptability as a predictive test. No QE cut-point accurately predicted CE pass/fail decisions. While a moderate relationship between QE scores and CE performance is evident, correlations suggest that the 2 examinations measure different abilities. The low AUC value on the ROC analysis, along with poor predictability at all possible cut-points, show that no appropriate cut-point on the QE predicts success on the CE. These data add to the validity of both tests by providing evidence that distinct latent traits are being measured by both tests.
Journal of Empirical Research on Human Research Ethics: An International Journal, 2011
Alzheimer's & Dementia, 2007
Alzheimer's & Dementia, 2008
Surgery, 2012
The American Board of Surgery (ABS) Qualifying Examination (QE) represents an important step alon... more The American Board of Surgery (ABS) Qualifying Examination (QE) represents an important step along the pathway to board certification. We investigated whether candidates who delayed taking the QE had worse performance on the examination. QE pass rates and equated scaled scores for all first-time examinees from 2006 to 2010 (n = 5,193) were reviewed. After eliminating examinees who could not be matched to final ABS In-Training Examination (ABSITE) scores, the remaining cohort (n = 4,909) was analyzed by comparing those who took the exam immediately after residency (Immediate, n = 4,488) to those who delayed for 1 or more years (Delay, n = 421). The Immediate group had a mean first-time QE pass rate of 87% compared to 57% for those who delayed 1 year and 48% for those who delayed 2 or more years (P < .001). Regression analysis demonstrated that delay in taking the QE remained a significant determinant of exam failure after controlling for ABSITE scores (odds ratio = 0.35; 95% CI, 0.29-0.43; P = .001). Undergraduate medical education and postresidency training did not affect the results. The Delay group had lower equated scaled scores, a greater ultimate failure rate on the QE, and was more likely to fail the ABS Certifying Examination on the first attempt. These results demonstrate that candidates who delayed taking the QE immediately are at extremely high risk for exam failure and failure to achieve board certification. These findings presumably are due to deterioration of knowledge over time, but they also may represent characteristics of the Delay group that are currently undefined.