Leonard bickman | Vanderbilt University (original) (raw)

Uploads

Papers by Leonard bickman

Research paper thumbnail of Improving Mental Health Services: A 50-Year Journey from Randomized Experiments to Artificial Intelligence and Precision Mental Health

Administration and Policy in Mental Health and Mental Health Services Research

This conceptual paper describes the current state of mental health services, identifies critical ... more This conceptual paper describes the current state of mental health services, identifies critical problems, and suggests how to solve them. I focus on the potential contributions of artificial intelligence and precision mental health to improving mental health services. Toward that end, I draw upon my own research, which has changed over the last half century, to highlight the need to transform the way we conduct mental health services research. I identify exemplars from the emerging literature on artificial intelligence and precision approaches to treatment in which there is an attempt to personalize or fit the treatment to the client in order to produce more effective interventions. Keywords Mental health services • Artificial intelligence • Machine learning • Precision mental health • Randomized clinical trials (RCTs) • Precision medicine "AI will bring many wonders. It may also destabilize everything from nuclear détente to human friendships. We need to think much harder about how to adapt... it is changing human knowledge, perception and reality-and, in so doing, changing the course of human history. We seek to understand it and its consequences and encourage others across the disciplines to do the same."-Kissinger et al. 2019, pp. 24-26 "AI is one of the most profound things we're working on as humanity. It's more profound than fire or electricity."-Alphabet CEO Sundar Pichai, in Thompson and Bodoni 2020. This article is part of a special issue, Festschrift for Leonard Bickman: The Future of Children's Mental Health Services.

Research paper thumbnail of Improving Deployment-Related Primary Care Provider Assessments of PTSD and Mental Health Conditions

This project addresses the need for research on service delivery approaches for Service Members w... more This project addresses the need for research on service delivery approaches for Service Members with combat-related physical or psychiatric symptoms, including Posttraumatic Stress Disorder (PTSD) and/or post-concussive symptoms. As a primary care encounter, the post-deployment health reassessment (PDHRA) process is critical to force health protection efforts. The project will develop and test the efficacy of a focused training and feedback intervention for health care providers designed to increase Service member reports of behavioral health concerns and Service member acceptance of a referral for further assessment. The project has two goals. (1) Develop an evidence-based training program for providers who deliver deployment related assessments. (2) Evaluate the feasibility and efficacy of a targeted training and feedback program on primary care provider interviews and clinical communication patterns related to Service member behavioral health condition identification and referrals. To accomplish these aims, a training workshop that incorporates experiential learning strategies and evidence-supported characteristics of high quality communication training programs was piloted at 4 sites, reaching 23 providers. Multi-method and multi-reporter data include survey data (Service members and providers), program manager interviews, and electronic health data. Preliminary analyses indicate positive impact of the workshop: (a) rated as acceptable and feasible by participating providers; (b) increased providers' patient-centered communication skills and expected behaviors during PDHRA interview as rated by Service members; (c) increased providers' identification of BH concerns in context of PDHRA encounters where Service members anonymously reported BH concerns; and (d) affected PDHRA provider documentation, with more concerns and One Source referrals yet fewer medical referrals. Further analyses, including covariates, are planned for year five.

Research paper thumbnail of Problems in Using Diagnosis in Child and Adolescent Mental Health Services Research

Journal of Methods and Measurement in the Social Sciences

This paper presents results from a three-part study on diagnosis of children with affective and b... more This paper presents results from a three-part study on diagnosis of children with affective and behavior disorders. We examined the reliability, discriminant, and predictive validity of common diagnoses used in mental health services research using a research diagnostic interview. Results suggest four problems: a) some diagnoses demonstrate internal consistency only slightly better than symptoms chosen at random; b) diagnosis did not add appreciably to a brief global functioning screen in predicting service use; c) low inter-rater reliability among informants and clinicians for six of the most common diagnoses; and d) clinician diagnoses differed between sites in ways that reflect different reimbursement strategies. The study concludes that clinicians and researchers should not assume diagnosis is a useful measure of child and adolescent problems and outcomes until there is more evidence supporting the validity of diagnosis.DOI:10.2458/azu_jmmss_v3i1_bickman

Research paper thumbnail of Is There a Future for Therapists?

Administration and policy in mental health, 2017

Research paper thumbnail of Four: The Evaluation of the Ft. Bragg and Stark County Systems of Care for Children and Adolescents: An Interview With Len Bickman

Evaluation in Action, 2000

Research paper thumbnail of Methodological Issues in Evaluating Mental Health Services: Special Issue

Evaluation and Program Planning, Dec 31, 1995

Research paper thumbnail of Beyond the laboratory : field research in social psychology

Research paper thumbnail of The SAGE Handbook of Social Research Methods

Editorial Aims. To cover the range of qual and quant methods; To chart evolving terrain of method... more Editorial Aims. To cover the range of qual and quant methods; To chart evolving terrain of methods; To go beyond methodological 'fashions'; To cover each aspect of the research process with attention to analysis; To be transnational ...

Research paper thumbnail of Dose response in child and adolescent mental health services

This study examines the dose-response relationship, the correlation between the amount of mental ... more This study examines the dose-response relationship, the correlation between the amount of mental health treatment a child receives (dose) and the outcome (response) in a community setting. Participants were 125 children treated in the Stark County Child and Adolescent Mental Health System. Study methods include multiple outcomes, multiple-dose definitions, longitudinal hierarchical analysis of repeated measures, and instrumental variable estimation to control for possible confounding between outcome and treatment dose. Results show no statistically significant dose response. The results do not support the existence of a dose response for children and adolescents consistent enough to guide clinicians, administrators, or policymakers.

Research paper thumbnail of Quasi-Experimental Design

Research paper thumbnail of Comprar Evaluating Managed Mental Health Services | Bickman, Leonard | 9780306484377 | Springer

Http Www Libreriasaulamedica Com, 2004

Research paper thumbnail of Some failures of basic social psychology

Research paper thumbnail of Evaluating Managed Mental Health Services: The Fort Bragg Experiment

... Mark Lipsey, Wendi Lozada-Smith, Erin Maloney, Kathleen Maloy, Ann Marable, Jules Marquart, J... more ... Mark Lipsey, Wendi Lozada-Smith, Erin Maloney, Kathleen Maloy, Ann Marable, Jules Marquart, Jan Marra, Su-zanne McMurphy, Mary Miles, Donna Miller, Heung Sung Nito, Carol Nixon, Robert Noell, Denine Northrup, Barry Nurcombe, Pamela Pappas, Heather Perry, Keith ...

Research paper thumbnail of Improving Principal Leadership through Feedback and Coaching

Society For Research on Educational Effectiveness, 2012

A metaanalysis of 70 studies found effect sizes ranging from 0.16 to 0.33 between teacher percept... more A metaanalysis of 70 studies found effect sizes ranging from 0.16 to 0.33 between teacher perception of school leadership and student achievement (Waters et al., 2003). Robinson et al. (2008) analyzed 22 studies and concluded the average effect of instructional leadership is three to four times greater (effect size of 0.44) than the effect of transformational leadership on student outcomes. Recent empirical work has supported the connections between school leadership, teacher practices, and improved student outcomes (e.g.

Research paper thumbnail of Soft Social Science

Research paper thumbnail of Social support following a disaster

Research paper thumbnail of Using Baby Books to Prevent Injuries

ABSTRACT Purpose: Preventable injuries are the leading cause of death in children. While the medi... more ABSTRACT Purpose: Preventable injuries are the leading cause of death in children. While the medical community has advocated for parent education about injury prevention during doctor visits, research has found that pediatricians often do not provide anticipatory guidance (AG) information and when they do, it is often narrow in scope, omitting many topics or provided using complex language. The present study attempts to provide AG in a simple and easily accessible manner by embedding educational information into baby books provided on the same schedule as regular well-child visits. Capitalizing on the low reading level of baby books and their likelihood of being read often, the study tests whether baby books are a feasible way to increase knowledge of injury prevention and if so, whether more knowledge result in better safety practices and fewer injuries. Methods: New mothers (n=180) were randomly assigned to 1 of 3 groups (to receive: educational books, non-educational books, no-books) during the 3rd trimester of pregnancy. Home-based data collection occurred during pregnancy and when the infant was 2, 4, 6, 9, 12, and 18-months. At each visit, knowledge of injury prevention and practices in the home were assessed. Mothers were asked about their baby’s injuries monthly and medical charts were reviewed for treatment of an injury. Results: Baseline knowledge was equivalent between groups, with ample room for improvement (M = 40% correct on criterion-references measure). Adjusting for relevant confounders, women in the educational book group scored 6.3-8.2% higher than the women in the other two conditions (p <0.0001). This increase in knowledge appears to have influenced some safety practices (e.g., covering outlets, not using a baby walker) but not all (e.g., using cabinet latches, removing small or sharp objects). As for injuries, ¼ of the mothers reported that their child had at least one injury although few injuries required medical attention (11%). While women receiving the intervention utilized more safe practices, there were no significant differences in the number of injuries between groups. Conclusion: Presenting AG in the form of baby books appears to be an effective way to increase new mothers’ knowledge about safety and injury prevention. While this increase knowledge may promote some safety practices, it does not seem to result in fewer injuries. Education is one piece of preventing injuries but clearly not the only important component.

Research paper thumbnail of Comprar Evaluating Managed Mental Health Services | Bickman, Leonard | 9780306450440 | Springer

Http Www Libreriasaulamedica Com, 1995

Research paper thumbnail of Talking to the Media

Research paper thumbnail of Environmental Attitudes and Actions

Http Dx Doi Org 10 1080 00224545 1972 9922533, Jun 30, 2010

Research paper thumbnail of Improving Mental Health Services: A 50-Year Journey from Randomized Experiments to Artificial Intelligence and Precision Mental Health

Administration and Policy in Mental Health and Mental Health Services Research

This conceptual paper describes the current state of mental health services, identifies critical ... more This conceptual paper describes the current state of mental health services, identifies critical problems, and suggests how to solve them. I focus on the potential contributions of artificial intelligence and precision mental health to improving mental health services. Toward that end, I draw upon my own research, which has changed over the last half century, to highlight the need to transform the way we conduct mental health services research. I identify exemplars from the emerging literature on artificial intelligence and precision approaches to treatment in which there is an attempt to personalize or fit the treatment to the client in order to produce more effective interventions. Keywords Mental health services • Artificial intelligence • Machine learning • Precision mental health • Randomized clinical trials (RCTs) • Precision medicine "AI will bring many wonders. It may also destabilize everything from nuclear détente to human friendships. We need to think much harder about how to adapt... it is changing human knowledge, perception and reality-and, in so doing, changing the course of human history. We seek to understand it and its consequences and encourage others across the disciplines to do the same."-Kissinger et al. 2019, pp. 24-26 "AI is one of the most profound things we're working on as humanity. It's more profound than fire or electricity."-Alphabet CEO Sundar Pichai, in Thompson and Bodoni 2020. This article is part of a special issue, Festschrift for Leonard Bickman: The Future of Children's Mental Health Services.

Research paper thumbnail of Improving Deployment-Related Primary Care Provider Assessments of PTSD and Mental Health Conditions

This project addresses the need for research on service delivery approaches for Service Members w... more This project addresses the need for research on service delivery approaches for Service Members with combat-related physical or psychiatric symptoms, including Posttraumatic Stress Disorder (PTSD) and/or post-concussive symptoms. As a primary care encounter, the post-deployment health reassessment (PDHRA) process is critical to force health protection efforts. The project will develop and test the efficacy of a focused training and feedback intervention for health care providers designed to increase Service member reports of behavioral health concerns and Service member acceptance of a referral for further assessment. The project has two goals. (1) Develop an evidence-based training program for providers who deliver deployment related assessments. (2) Evaluate the feasibility and efficacy of a targeted training and feedback program on primary care provider interviews and clinical communication patterns related to Service member behavioral health condition identification and referrals. To accomplish these aims, a training workshop that incorporates experiential learning strategies and evidence-supported characteristics of high quality communication training programs was piloted at 4 sites, reaching 23 providers. Multi-method and multi-reporter data include survey data (Service members and providers), program manager interviews, and electronic health data. Preliminary analyses indicate positive impact of the workshop: (a) rated as acceptable and feasible by participating providers; (b) increased providers' patient-centered communication skills and expected behaviors during PDHRA interview as rated by Service members; (c) increased providers' identification of BH concerns in context of PDHRA encounters where Service members anonymously reported BH concerns; and (d) affected PDHRA provider documentation, with more concerns and One Source referrals yet fewer medical referrals. Further analyses, including covariates, are planned for year five.

Research paper thumbnail of Problems in Using Diagnosis in Child and Adolescent Mental Health Services Research

Journal of Methods and Measurement in the Social Sciences

This paper presents results from a three-part study on diagnosis of children with affective and b... more This paper presents results from a three-part study on diagnosis of children with affective and behavior disorders. We examined the reliability, discriminant, and predictive validity of common diagnoses used in mental health services research using a research diagnostic interview. Results suggest four problems: a) some diagnoses demonstrate internal consistency only slightly better than symptoms chosen at random; b) diagnosis did not add appreciably to a brief global functioning screen in predicting service use; c) low inter-rater reliability among informants and clinicians for six of the most common diagnoses; and d) clinician diagnoses differed between sites in ways that reflect different reimbursement strategies. The study concludes that clinicians and researchers should not assume diagnosis is a useful measure of child and adolescent problems and outcomes until there is more evidence supporting the validity of diagnosis.DOI:10.2458/azu_jmmss_v3i1_bickman

Research paper thumbnail of Is There a Future for Therapists?

Administration and policy in mental health, 2017

Research paper thumbnail of Four: The Evaluation of the Ft. Bragg and Stark County Systems of Care for Children and Adolescents: An Interview With Len Bickman

Evaluation in Action, 2000

Research paper thumbnail of Methodological Issues in Evaluating Mental Health Services: Special Issue

Evaluation and Program Planning, Dec 31, 1995

Research paper thumbnail of Beyond the laboratory : field research in social psychology

Research paper thumbnail of The SAGE Handbook of Social Research Methods

Editorial Aims. To cover the range of qual and quant methods; To chart evolving terrain of method... more Editorial Aims. To cover the range of qual and quant methods; To chart evolving terrain of methods; To go beyond methodological 'fashions'; To cover each aspect of the research process with attention to analysis; To be transnational ...

Research paper thumbnail of Dose response in child and adolescent mental health services

This study examines the dose-response relationship, the correlation between the amount of mental ... more This study examines the dose-response relationship, the correlation between the amount of mental health treatment a child receives (dose) and the outcome (response) in a community setting. Participants were 125 children treated in the Stark County Child and Adolescent Mental Health System. Study methods include multiple outcomes, multiple-dose definitions, longitudinal hierarchical analysis of repeated measures, and instrumental variable estimation to control for possible confounding between outcome and treatment dose. Results show no statistically significant dose response. The results do not support the existence of a dose response for children and adolescents consistent enough to guide clinicians, administrators, or policymakers.

Research paper thumbnail of Quasi-Experimental Design

Research paper thumbnail of Comprar Evaluating Managed Mental Health Services | Bickman, Leonard | 9780306484377 | Springer

Http Www Libreriasaulamedica Com, 2004

Research paper thumbnail of Some failures of basic social psychology

Research paper thumbnail of Evaluating Managed Mental Health Services: The Fort Bragg Experiment

... Mark Lipsey, Wendi Lozada-Smith, Erin Maloney, Kathleen Maloy, Ann Marable, Jules Marquart, J... more ... Mark Lipsey, Wendi Lozada-Smith, Erin Maloney, Kathleen Maloy, Ann Marable, Jules Marquart, Jan Marra, Su-zanne McMurphy, Mary Miles, Donna Miller, Heung Sung Nito, Carol Nixon, Robert Noell, Denine Northrup, Barry Nurcombe, Pamela Pappas, Heather Perry, Keith ...

Research paper thumbnail of Improving Principal Leadership through Feedback and Coaching

Society For Research on Educational Effectiveness, 2012

A metaanalysis of 70 studies found effect sizes ranging from 0.16 to 0.33 between teacher percept... more A metaanalysis of 70 studies found effect sizes ranging from 0.16 to 0.33 between teacher perception of school leadership and student achievement (Waters et al., 2003). Robinson et al. (2008) analyzed 22 studies and concluded the average effect of instructional leadership is three to four times greater (effect size of 0.44) than the effect of transformational leadership on student outcomes. Recent empirical work has supported the connections between school leadership, teacher practices, and improved student outcomes (e.g.

Research paper thumbnail of Soft Social Science

Research paper thumbnail of Social support following a disaster

Research paper thumbnail of Using Baby Books to Prevent Injuries

ABSTRACT Purpose: Preventable injuries are the leading cause of death in children. While the medi... more ABSTRACT Purpose: Preventable injuries are the leading cause of death in children. While the medical community has advocated for parent education about injury prevention during doctor visits, research has found that pediatricians often do not provide anticipatory guidance (AG) information and when they do, it is often narrow in scope, omitting many topics or provided using complex language. The present study attempts to provide AG in a simple and easily accessible manner by embedding educational information into baby books provided on the same schedule as regular well-child visits. Capitalizing on the low reading level of baby books and their likelihood of being read often, the study tests whether baby books are a feasible way to increase knowledge of injury prevention and if so, whether more knowledge result in better safety practices and fewer injuries. Methods: New mothers (n=180) were randomly assigned to 1 of 3 groups (to receive: educational books, non-educational books, no-books) during the 3rd trimester of pregnancy. Home-based data collection occurred during pregnancy and when the infant was 2, 4, 6, 9, 12, and 18-months. At each visit, knowledge of injury prevention and practices in the home were assessed. Mothers were asked about their baby’s injuries monthly and medical charts were reviewed for treatment of an injury. Results: Baseline knowledge was equivalent between groups, with ample room for improvement (M = 40% correct on criterion-references measure). Adjusting for relevant confounders, women in the educational book group scored 6.3-8.2% higher than the women in the other two conditions (p <0.0001). This increase in knowledge appears to have influenced some safety practices (e.g., covering outlets, not using a baby walker) but not all (e.g., using cabinet latches, removing small or sharp objects). As for injuries, ¼ of the mothers reported that their child had at least one injury although few injuries required medical attention (11%). While women receiving the intervention utilized more safe practices, there were no significant differences in the number of injuries between groups. Conclusion: Presenting AG in the form of baby books appears to be an effective way to increase new mothers’ knowledge about safety and injury prevention. While this increase knowledge may promote some safety practices, it does not seem to result in fewer injuries. Education is one piece of preventing injuries but clearly not the only important component.

Research paper thumbnail of Comprar Evaluating Managed Mental Health Services | Bickman, Leonard | 9780306450440 | Springer

Http Www Libreriasaulamedica Com, 1995

Research paper thumbnail of Talking to the Media

Research paper thumbnail of Environmental Attitudes and Actions

Http Dx Doi Org 10 1080 00224545 1972 9922533, Jun 30, 2010