John Engberg - Academia.edu (original) (raw)

Papers by John Engberg

Research paper thumbnail of Optimal Allocation of Seats in the Presence of Peer Effects: Evidence from a Job Training Program

Journal of Labor Economics, 2022

Research paper thumbnail of Trends in Impact on Student Outcomes

Research paper thumbnail of What Two New Studies Reveal About Restorative Justice in Middle School

Research paper thumbnail of Nurse Aide Retention in Nursing Homes

The Gerontologist, 2020

Background and Objectives The association of nurse aide retention with three quality indicators i... more Background and Objectives The association of nurse aide retention with three quality indicators is examined. Retention is defined as the proportion of staff continuously employed in the same facility for a defined period of time. Research Design and Methods Data used in this investigation came from survey responses from 3,550 nursing facilities, Certification and Survey Provider Enhanced Reporting data, and the Area Resource File. Staffing characteristics, quality indicators, facility, and market information from these data sources were all measured in 2016. Nurse aide retention was measured at 1, 2, and 3 years of employment. The quality indicators examined were a count of all deficiency citations, quality of care deficiency citations, and J, K, L deficiency citations. Negative binomial regression analyses were used to study the associations between the three different retention measures and these three quality indicators. Results The 1-, 2-, and 3-year nurse aide retention measure...

Research paper thumbnail of Improving Teaching Effectiveness: Final Report: The Intensive Partnerships for Effective Teaching Through 20152016

The Intensive Partnerships for Effective Teaching initiative was a multiyear effort to dramatical... more The Intensive Partnerships for Effective Teaching initiative was a multiyear effort to dramatically improve student outcomes by increasing students' access to effective teaching. Researchers from the RAND Corporation and the American Institutes for Research conducted a six-year evaluation of the initiative, documenting the policies and practices each site enacted and their effects on student outcomes. This is the final evaluation report.

Research paper thumbnail of Validity Evidence Supporting Use of Anchoring Vignettes to Measure Teaching Practice

Educational Assessment, 2019

ABSTRACT High-quality measures of instructional practice are essential for research and evaluatio... more ABSTRACT High-quality measures of instructional practice are essential for research and evaluation of innovative instructional policies and programs. However, existing measures have generally proven inadequate because of cost and validity issues. This paper addresses two potential drawbacks of survey self-report measures: variation in teachers’ interpretation of response scales and their interpretation of survey questions. To address these drawbacks, researchers tested out use of “anchoring vignettes“ in teacher surveys to capture information about teaching practice, and they gathered validity evidence in regard to their use as a tool for adjusting teachers’ survey self-reports about their instructional practices for research purposes, or potentially to inform professional development. Data from 65 teachers in grades 4-9 responding to our survey suggested that vignette adjustments were reliable and valid for some instructional practices more than others. For some instructional practices, researchers found significant and high correlations between teachers’ adjusted survey self-rating, through use of anchoring vignettes, and previous observation ratings of teachers’ instruction, including ratings from several widely-used observation rubrics. These results suggest that anchoring vignettes may provide an efficient, cost-effective method for gathering data on teachers’ instruction.

Research paper thumbnail of RAND Review

Research paper thumbnail of A day at a time: Predicting smoking lapse from daily urge

Journal of Abnormal Psychology, 1997

Smokers who recently quit (N = 214) monitored smoking urges for up to 26 days after quitting. Com... more Smokers who recently quit (N = 214) monitored smoking urges for up to 26 days after quitting. Computers administered 4-5 assessments daily at random times; participants rated urges on waking and when they experienced temptation episodes. Urge intensity after cessation did not generally exceed urges reported during baseline ad lib smoking. Urge intensity and temptation frequency consistently declined over the quit period. Controlling for urge intensity at baseline, all daily urge intensity measures predicted lapse the following day in proportional hazards survival analyses. Average duration of temptation episodes also predicted lapses; frequency of temptation did not. To isolate the effect of day-to-day variations in urges, participants' nicotine dependence and urge intensity on quit day were controlled for. Only urge intensity at waking still predicted lapse risk; this was not because of this measured being closer in time to the day's lapses. Among lapsers, urge intensity at waking and in temptations rose preceding a lapse.

Research paper thumbnail of Dynamic effects of self-efficacy on smoking lapse and relapse

Health Psychology, 2000

Self-efficacy (SE) is thought to be critical to success in smoking cessation both as an individua... more Self-efficacy (SE) is thought to be critical to success in smoking cessation both as an individual difference and as a dynamic process after a quit attempt. In this study, 214 smokers used palm-top computers to record day-to-day variations in SE during 4 weeks after quitting. SE remained at high and stable levels prior to a 1st lapse but decreased and became more variable thereafter. The authors used event history models with time-varying covariates to assess the effect of daily SE on lapse and relapse risk. Daily SE measures predicted an initial lapse on the subsequent day. However, this relationship was accounted for by stable baseline differences in SE (assessed by questionnaire), rather than by day-to-day dynamics in SE. Progression from 1st lapse to relapse was also examined. In this instance, daily SE predicted subsequent relapse risk, even when baseline SE and concurrent smoking were accounted for, suggesting the importance of SE dynamics for this stage of the relapse process.

Research paper thumbnail of HMO market structure and performance: 1985-1995

Health Affairs, 1997

A decade of HMO data confirm the perception: Hospital days are declining among HMO patients, whil... more A decade of HMO data confirm the perception: Hospital days are declining among HMO patients, while use of ambulatory care is up.

Research paper thumbnail of Closing Schools in a Shrinking District

Research paper thumbnail of The Effects of Arkansas Master Settlement Spending on Disparities in Smoking

American Journal of Public Health, 2012

Research paper thumbnail of Reducing substance use improves adolescents’ school attendance

Addiction, 2006

Substance use initiation and frequency are associated with reduced educational attainments among ... more Substance use initiation and frequency are associated with reduced educational attainments among adolescents. We examined if decreases in substance use substantially improve youths' school attendance. A total of 1084 US adolescents followed quarterly for 1 year after entering substance abuse treatment. Random and fixed effects regression models were used to differentiate the lagged effects of drug use from other time-varying and time-invariant covariates. Self-reports of alcohol, marijuana, stimulants, sedatives, hallucinogens and other drug use were used to predict subsequent school attendance, after controlling for demographic and drug use history characteristics, problem indices and other covariates. Reductions in the frequency of alcohol, stimulants and other drug use and the elimination of marijuana use were each associated independently with increased likelihoods of school attendance. Because years of completed schooling is highly correlated with long-term social and economic outcomes, the possibility that reductions in substance use may improve school attendance has significant implications for the cost-effectiveness of substance abuse treatment and other interventions designed to reduce adolescents' substance use.

Research paper thumbnail of Decomposing changes in the black-white earnings gap: 1969 to 1979

Research paper thumbnail of Organizational characteristics associated with staff turnover in nursing homes

Purpose: The association between certified nurse aide, licensed practical nurse, and registered n... more Purpose: The association between certified nurse aide, licensed practical nurse, and registered nurse turnover and the organizational characteristics of nursing homes are examined. Design and Meth-ods: Hypotheses for eight organizational character-istics are examined (staffing levels, top management turnover, resident case mix, facility quality, owner-ship, chain membership, size, and Medicaid census), using Online Survey, Certification, and Reporting (known as OSCAR) data. Turnover information came

Research paper thumbnail of Job Satisfaction of Nurse Aides in Nursing Homes: Intent to Leave and Turnover

nurse aides and intent to leave and actual turnover after 1 year is examined. Design and Methods:... more nurse aides and intent to leave and actual turnover after 1 year is examined. Design and Methods: Data came from a random sample of 72 nursing homes from 5 states (Colorado, Florida, Michigan, New York, and Oregon). From these nursing homes, we collected 1,779 surveys from nurse aides (a response rate of 62%). We used a job satisfaction instrument specifically developed for use with nurse aides, as well as previously validated measures of intent to leave and turnover. We used ordered logistic regression and logistic regression to examine the data. Results: High overall job satisfaction was as-sociated with low scores on thinking about leaving, thinking about a job search, searching for a job, and turnover. In examining the association between the job satisfaction subscales and intent to leave and turnover, we found that high Work Schedule subscale scores, high Training subscale scores, and high Rewards subscale scores were associated with low scores on thinking about leaving, thinki...

Research paper thumbnail of State enterprise zones and local housing markets

In the past two decades, more than 40 states have implemented enterprise zone programs to encoura... more In the past two decades, more than 40 states have implemented enterprise zone programs to encourage business activity and revitalize distressed communities. Previous evaluations (predominantly at the zone or state level) on the impact of these programs have been inconclusive. We argue that property values are an ideal outcome measure, since any wealth created by these programs should be capitalized into the local housing market. We examine the impact of zones on the growth in housing values in 22 states, using a large sample of small cities both with and without enterprise zones. We use variation in the timing of zone designation to differentiate the impact of zone designation from that of unobserved, preexisting conditions ham-pering growth in zone locations. We find that, on average, zones do not increase housing values, al-though they do have a positive impact in tight housing markets.

Research paper thumbnail of State Variability in Indicators of Quality of Care in Nursing Facilities

Background. The objective of this research was to profile and compare state-level physical restra... more Background. The objective of this research was to profile and compare state-level physical restraint use, urethral catheterization, contractures, pressure ulcers, and psychoactive medication use as indicators of quality of care in nursing facilities. Methods. Using nationally representative data from the Online Survey, Certification, and Reporting system for 2000 (N 17,072), we calculated predicted quality scores using risk-adjusted models based on aggregate resident variables generated by hierarchical linear regression models for each of the five quality indicators. Results. We observed significant variation in both the actual and risk-adjusted quality measures. The average risk-adjusted physical restraint quality score ranged from 8.4 % to 12.8%; the average risk-adjusted catheterization quality score ranged from 3.6 % to 7.7%; the average risk-adjusted contractures quality score ranged from 19.0 % to 31.6%; the average risk-adjusted pressure ulcer quality score ranged from 3.8 % ...

Research paper thumbnail of Response Formats and Satisfaction Surveys for Elders

Purpose: A factor common to the results of many satisfaction surveys of elders is a lack of respo... more Purpose: A factor common to the results of many satisfaction surveys of elders is a lack of response variability. Increasing response variability may be useful if satisfaction surveys of elders are to be productively used in the future. In this paper, we first examine elders ’ preferences between five response formats and then examine the response variability of these five commonly used formats. Design and Methods: Satisfaction, demographic, and Short-Form 36 Health Survey data were self-reported by patients in four outpatient surgery centers during 1998 and 1999. We used six different survey instruments randomly given to 3,122 elders. Five instruments varied in response format (5-item Likert format, 5-item satisfaction format, 5-item valuation format, 4-item Chernoff faces, and 10-item visual analogue format). The sixth survey used all five different response sets, and then it asked for the respondents ’ preferences among the different response sets. Results: A total of 2,450 quest...

Research paper thumbnail of Assessing the Short-term Impact of the New York City Renewal Schools Program

In this internal report prepared for the New York City Chancellor's Office, we estimate shortterm... more In this internal report prepared for the New York City Chancellor's Office, we estimate shortterm impacts of the New York City Renewal Schools Program based on the first two full years of program implementation. We utilize a novel method of multiple rating regression discontinuity design (MRRDD) that leverages the selection criteria used to select schools as Renewal or non-Renewal Schools. Our analysis suggests that the Renewal Schools program is helping to improve student attendance while reducing chronic absenteeism, while also increasing the amount of credits earned among high schools students. We also found evidence suggesting that among high school students, the program impact was strongest at schools with greater levels of student economic needs.

Research paper thumbnail of Optimal Allocation of Seats in the Presence of Peer Effects: Evidence from a Job Training Program

Journal of Labor Economics, 2022

Research paper thumbnail of Trends in Impact on Student Outcomes

Research paper thumbnail of What Two New Studies Reveal About Restorative Justice in Middle School

Research paper thumbnail of Nurse Aide Retention in Nursing Homes

The Gerontologist, 2020

Background and Objectives The association of nurse aide retention with three quality indicators i... more Background and Objectives The association of nurse aide retention with three quality indicators is examined. Retention is defined as the proportion of staff continuously employed in the same facility for a defined period of time. Research Design and Methods Data used in this investigation came from survey responses from 3,550 nursing facilities, Certification and Survey Provider Enhanced Reporting data, and the Area Resource File. Staffing characteristics, quality indicators, facility, and market information from these data sources were all measured in 2016. Nurse aide retention was measured at 1, 2, and 3 years of employment. The quality indicators examined were a count of all deficiency citations, quality of care deficiency citations, and J, K, L deficiency citations. Negative binomial regression analyses were used to study the associations between the three different retention measures and these three quality indicators. Results The 1-, 2-, and 3-year nurse aide retention measure...

Research paper thumbnail of Improving Teaching Effectiveness: Final Report: The Intensive Partnerships for Effective Teaching Through 20152016

The Intensive Partnerships for Effective Teaching initiative was a multiyear effort to dramatical... more The Intensive Partnerships for Effective Teaching initiative was a multiyear effort to dramatically improve student outcomes by increasing students' access to effective teaching. Researchers from the RAND Corporation and the American Institutes for Research conducted a six-year evaluation of the initiative, documenting the policies and practices each site enacted and their effects on student outcomes. This is the final evaluation report.

Research paper thumbnail of Validity Evidence Supporting Use of Anchoring Vignettes to Measure Teaching Practice

Educational Assessment, 2019

ABSTRACT High-quality measures of instructional practice are essential for research and evaluatio... more ABSTRACT High-quality measures of instructional practice are essential for research and evaluation of innovative instructional policies and programs. However, existing measures have generally proven inadequate because of cost and validity issues. This paper addresses two potential drawbacks of survey self-report measures: variation in teachers’ interpretation of response scales and their interpretation of survey questions. To address these drawbacks, researchers tested out use of “anchoring vignettes“ in teacher surveys to capture information about teaching practice, and they gathered validity evidence in regard to their use as a tool for adjusting teachers’ survey self-reports about their instructional practices for research purposes, or potentially to inform professional development. Data from 65 teachers in grades 4-9 responding to our survey suggested that vignette adjustments were reliable and valid for some instructional practices more than others. For some instructional practices, researchers found significant and high correlations between teachers’ adjusted survey self-rating, through use of anchoring vignettes, and previous observation ratings of teachers’ instruction, including ratings from several widely-used observation rubrics. These results suggest that anchoring vignettes may provide an efficient, cost-effective method for gathering data on teachers’ instruction.

Research paper thumbnail of RAND Review

Research paper thumbnail of A day at a time: Predicting smoking lapse from daily urge

Journal of Abnormal Psychology, 1997

Smokers who recently quit (N = 214) monitored smoking urges for up to 26 days after quitting. Com... more Smokers who recently quit (N = 214) monitored smoking urges for up to 26 days after quitting. Computers administered 4-5 assessments daily at random times; participants rated urges on waking and when they experienced temptation episodes. Urge intensity after cessation did not generally exceed urges reported during baseline ad lib smoking. Urge intensity and temptation frequency consistently declined over the quit period. Controlling for urge intensity at baseline, all daily urge intensity measures predicted lapse the following day in proportional hazards survival analyses. Average duration of temptation episodes also predicted lapses; frequency of temptation did not. To isolate the effect of day-to-day variations in urges, participants' nicotine dependence and urge intensity on quit day were controlled for. Only urge intensity at waking still predicted lapse risk; this was not because of this measured being closer in time to the day's lapses. Among lapsers, urge intensity at waking and in temptations rose preceding a lapse.

Research paper thumbnail of Dynamic effects of self-efficacy on smoking lapse and relapse

Health Psychology, 2000

Self-efficacy (SE) is thought to be critical to success in smoking cessation both as an individua... more Self-efficacy (SE) is thought to be critical to success in smoking cessation both as an individual difference and as a dynamic process after a quit attempt. In this study, 214 smokers used palm-top computers to record day-to-day variations in SE during 4 weeks after quitting. SE remained at high and stable levels prior to a 1st lapse but decreased and became more variable thereafter. The authors used event history models with time-varying covariates to assess the effect of daily SE on lapse and relapse risk. Daily SE measures predicted an initial lapse on the subsequent day. However, this relationship was accounted for by stable baseline differences in SE (assessed by questionnaire), rather than by day-to-day dynamics in SE. Progression from 1st lapse to relapse was also examined. In this instance, daily SE predicted subsequent relapse risk, even when baseline SE and concurrent smoking were accounted for, suggesting the importance of SE dynamics for this stage of the relapse process.

Research paper thumbnail of HMO market structure and performance: 1985-1995

Health Affairs, 1997

A decade of HMO data confirm the perception: Hospital days are declining among HMO patients, whil... more A decade of HMO data confirm the perception: Hospital days are declining among HMO patients, while use of ambulatory care is up.

Research paper thumbnail of Closing Schools in a Shrinking District

Research paper thumbnail of The Effects of Arkansas Master Settlement Spending on Disparities in Smoking

American Journal of Public Health, 2012

Research paper thumbnail of Reducing substance use improves adolescents’ school attendance

Addiction, 2006

Substance use initiation and frequency are associated with reduced educational attainments among ... more Substance use initiation and frequency are associated with reduced educational attainments among adolescents. We examined if decreases in substance use substantially improve youths' school attendance. A total of 1084 US adolescents followed quarterly for 1 year after entering substance abuse treatment. Random and fixed effects regression models were used to differentiate the lagged effects of drug use from other time-varying and time-invariant covariates. Self-reports of alcohol, marijuana, stimulants, sedatives, hallucinogens and other drug use were used to predict subsequent school attendance, after controlling for demographic and drug use history characteristics, problem indices and other covariates. Reductions in the frequency of alcohol, stimulants and other drug use and the elimination of marijuana use were each associated independently with increased likelihoods of school attendance. Because years of completed schooling is highly correlated with long-term social and economic outcomes, the possibility that reductions in substance use may improve school attendance has significant implications for the cost-effectiveness of substance abuse treatment and other interventions designed to reduce adolescents' substance use.

Research paper thumbnail of Decomposing changes in the black-white earnings gap: 1969 to 1979

Research paper thumbnail of Organizational characteristics associated with staff turnover in nursing homes

Purpose: The association between certified nurse aide, licensed practical nurse, and registered n... more Purpose: The association between certified nurse aide, licensed practical nurse, and registered nurse turnover and the organizational characteristics of nursing homes are examined. Design and Meth-ods: Hypotheses for eight organizational character-istics are examined (staffing levels, top management turnover, resident case mix, facility quality, owner-ship, chain membership, size, and Medicaid census), using Online Survey, Certification, and Reporting (known as OSCAR) data. Turnover information came

Research paper thumbnail of Job Satisfaction of Nurse Aides in Nursing Homes: Intent to Leave and Turnover

nurse aides and intent to leave and actual turnover after 1 year is examined. Design and Methods:... more nurse aides and intent to leave and actual turnover after 1 year is examined. Design and Methods: Data came from a random sample of 72 nursing homes from 5 states (Colorado, Florida, Michigan, New York, and Oregon). From these nursing homes, we collected 1,779 surveys from nurse aides (a response rate of 62%). We used a job satisfaction instrument specifically developed for use with nurse aides, as well as previously validated measures of intent to leave and turnover. We used ordered logistic regression and logistic regression to examine the data. Results: High overall job satisfaction was as-sociated with low scores on thinking about leaving, thinking about a job search, searching for a job, and turnover. In examining the association between the job satisfaction subscales and intent to leave and turnover, we found that high Work Schedule subscale scores, high Training subscale scores, and high Rewards subscale scores were associated with low scores on thinking about leaving, thinki...

Research paper thumbnail of State enterprise zones and local housing markets

In the past two decades, more than 40 states have implemented enterprise zone programs to encoura... more In the past two decades, more than 40 states have implemented enterprise zone programs to encourage business activity and revitalize distressed communities. Previous evaluations (predominantly at the zone or state level) on the impact of these programs have been inconclusive. We argue that property values are an ideal outcome measure, since any wealth created by these programs should be capitalized into the local housing market. We examine the impact of zones on the growth in housing values in 22 states, using a large sample of small cities both with and without enterprise zones. We use variation in the timing of zone designation to differentiate the impact of zone designation from that of unobserved, preexisting conditions ham-pering growth in zone locations. We find that, on average, zones do not increase housing values, al-though they do have a positive impact in tight housing markets.

Research paper thumbnail of State Variability in Indicators of Quality of Care in Nursing Facilities

Background. The objective of this research was to profile and compare state-level physical restra... more Background. The objective of this research was to profile and compare state-level physical restraint use, urethral catheterization, contractures, pressure ulcers, and psychoactive medication use as indicators of quality of care in nursing facilities. Methods. Using nationally representative data from the Online Survey, Certification, and Reporting system for 2000 (N 17,072), we calculated predicted quality scores using risk-adjusted models based on aggregate resident variables generated by hierarchical linear regression models for each of the five quality indicators. Results. We observed significant variation in both the actual and risk-adjusted quality measures. The average risk-adjusted physical restraint quality score ranged from 8.4 % to 12.8%; the average risk-adjusted catheterization quality score ranged from 3.6 % to 7.7%; the average risk-adjusted contractures quality score ranged from 19.0 % to 31.6%; the average risk-adjusted pressure ulcer quality score ranged from 3.8 % ...

Research paper thumbnail of Response Formats and Satisfaction Surveys for Elders

Purpose: A factor common to the results of many satisfaction surveys of elders is a lack of respo... more Purpose: A factor common to the results of many satisfaction surveys of elders is a lack of response variability. Increasing response variability may be useful if satisfaction surveys of elders are to be productively used in the future. In this paper, we first examine elders ’ preferences between five response formats and then examine the response variability of these five commonly used formats. Design and Methods: Satisfaction, demographic, and Short-Form 36 Health Survey data were self-reported by patients in four outpatient surgery centers during 1998 and 1999. We used six different survey instruments randomly given to 3,122 elders. Five instruments varied in response format (5-item Likert format, 5-item satisfaction format, 5-item valuation format, 4-item Chernoff faces, and 10-item visual analogue format). The sixth survey used all five different response sets, and then it asked for the respondents ’ preferences among the different response sets. Results: A total of 2,450 quest...

Research paper thumbnail of Assessing the Short-term Impact of the New York City Renewal Schools Program

In this internal report prepared for the New York City Chancellor's Office, we estimate shortterm... more In this internal report prepared for the New York City Chancellor's Office, we estimate shortterm impacts of the New York City Renewal Schools Program based on the first two full years of program implementation. We utilize a novel method of multiple rating regression discontinuity design (MRRDD) that leverages the selection criteria used to select schools as Renewal or non-Renewal Schools. Our analysis suggests that the Renewal Schools program is helping to improve student attendance while reducing chronic absenteeism, while also increasing the amount of credits earned among high schools students. We also found evidence suggesting that among high school students, the program impact was strongest at schools with greater levels of student economic needs.