Allison Dymnicki | American Institutes for Research (original) (raw)

Papers by Allison Dymnicki

Research paper thumbnail of Theories of Prevention Science

Research paper thumbnail of Applying Lessons Learned from the STRYVE Initiative to Expand the Role of Public Health Departments in Preventing Youth Violence

142nd APHA Annual Meeting and Exposition (November 15 - November 19, 2014), Nov 17, 2014

ABSTRACT Background/Purpose: The American Institutes of Research (AIR), in partnership with the C... more ABSTRACT Background/Purpose: The American Institutes of Research (AIR), in partnership with the Centers for the Disease Control, National Center of Injury Prevention and Control [CDC, NCIPC) is engaged in a second initiative focused around increasing the role and visibility of public health departments in preventing youth violence with 12 communities across the country. Methods This five-year initiative attempts to take lessons learned from the STRYVE initiative to support twelve communities in engaging in and expanding their efforts to prevent youth violence. Four communities who have been engaged in this type of work before and eight communities that are engaging in this work for the first time will be recruited for this initiative. Results/Outcomes Activities that have been achieved during the planning year of this initiative will be described. These include: developing an environmental scan of public health department and collecting data to inform what supports will be offered to participating sites, creating a recruitment approach to recruit two types of communities, and identifying the key supports that will be offered during this initiative that aim to decrease community rates of violent incidents (e.g., homicides). Conclusions Key findings from the environmental scan of the needs of public health departments, a rationale for the recruitment process, and a description of the supports that might help public health departments to engage in this type of work will be shared in an effort to increase the knowledge related to injury prevention and the role that public health departments can play in these efforts.

Research paper thumbnail of Improving College and Career Readiness by Incorporating Social and Emotional Learning

This issue brief was written to assist state policymakers in better understanding how social and ... more This issue brief was written to assist state policymakers in better understanding how social and emotional learning (SEL) can help students to be college and career ready. The brief provides a short description of what SEL is, why it is needed, and what it looks like in practice. In addition, examples of standards that support SEL at the federal and state levels, current SEL initiatives and programs, and outcomes and measures that can be used to assess SEL programming are described.

Research paper thumbnail of Medical Specialty Camp Alumni Perceptions of Outcomes and Experiences

Social Science Research Network, 2022

Research paper thumbnail of Assessing Implementation and Effects Associated with a Comprehensive Framework Designed to Reduce School Violence: A Randomized Controlled Trial

Journal of School Violence, 2021

ABSTRACT School safety continues to be a concern in today’s schools, and comprehensive approaches... more ABSTRACT School safety continues to be a concern in today’s schools, and comprehensive approaches to school safety are one way to address this concern. However, few comprehensive approaches have been rigorously evaluated. To address this gap, we evaluated the implementation and effects associated with Safe Communities Safe Schools (SCSS) comprehensive school safety framework. Forty-six middle schools received SCSS within a staggered randomized implementation design. Implementation data, classroom observations, staff and student perceptions of school climate, student attendance/truancy, suspension rates, and academic test scores indicated that schools implemented some SCSS components as intended. Mixed impacts were found on school climate, student behavior, and academic outcomes. Findings suggest that implementation data highlights barriers to bringing interventions to scale and comprehensive interventions produce changes sequentially. Comprehensive frameworks hold promise for building staff capacity and the necessary infrastructure to reduce school violence – but require engagement and commitment of key staff, and sufficient time for change to occur.

Research paper thumbnail of Effects of positive youth development programs on school, family, and community systems

American Journal of Community Psychology, Mar 31, 2007

Research paper thumbnail of Middle school students overestimate normative support for aggression and underestimate normative support for nonviolent problem-solving strategies

Journal of Applied Social Psychology, Feb 1, 2013

Research paper thumbnail of Moderating Effects of School Climate on Outcomes for the Multisite Violence Prevention Project Universal Program

Journal of Research on Adolescence, Aug 5, 2013

This study examines to what extent baseline school climate moderates the effects of a randomized ... more This study examines to what extent baseline school climate moderates the effects of a randomized controlled trial of a universal violence prevention intervention. School climate was assessed by teacher ratings of the quality of relationships among school members and the seriousness of school problems. Cluster analysis revealed three climate types: distressed, average, and conducive. Mixed-effects regression models of data from 5,256 students suggested limited overall positive program outcomes for students in schools assigned to the universal intervention versus students in schools assigned to control conditions. There was, however, evidence of differential effects of the universal intervention by climate type. These findings have important implications for identifying school characteristics that researchers and practitioners should consider in planning universal school-based interventions. Whereas a handful of studies have addressed the way that ecological characteristics (e.g., classroom, school, community factors) affect implementation of school-based prevention efforts (Gregory, Henry, Schoeny, & The Metropolitan Area Child Study Research Group, 2007; Kallestad & Olweus, 2003), few studies have analyzed how ecological variables influence student intervention outcomes (Farrell, Henry, & Bettencourt, 2011). Findings of one study suggested that, although the universal intervention produced robust effects for most schools, it was not associated with positive intervention effects in high-poverty schools (Conduct Problems Prevention Research Group, 2010). Another study found that a multicomponent intervention that had no effect in a poor and high-crime community had significant effects in a less distressed community (Metropolitan Area Child Study Research Group, 2002). The current study attempts to analyze the relationship of school climate to intervention outcomes in a randomized controlled trial of a schoolbased violence prevention program. Few studies have investigated the relations between specific ecological characteristics and student intervention outcomes. However, some longitudinal research has identified ecological characteristics that predict student outcomes, and other studies have linked ecological characteristics to program implementation. Considerable research evidence indicates that different aspects of school climate can affect student outcomes. Such characteristics include individual and school norms, supportive student-teacher relationships, and school policies and practices (

Research paper thumbnail of Clustering and its applications in community research

Research paper thumbnail of Clustering Methods with Qualitative Data: a Mixed-Methods Approach for Prevention Research with Small Samples

Prevention Science, May 7, 2015

Qualitative methods potentially add depth to prevention research, but can produce large amounts o... more Qualitative methods potentially add depth to prevention research, but can produce large amounts of complex data even with small samples. Studies conducted with culturally distinct samples often produce voluminous qualitative data, but may lack sufficient sample sizes for sophisticated quantitative analysis. Currently lacking in mixed methods research are methods allowing for more fully integrating qualitative and quantitative analysis techniques. Cluster analysis can be applied to coded qualitative data to clarify the findings of prevention studies by aiding efforts to reveal such things as the motives of participants for their actions and the reasons behind counterintuitive findings. By clustering groups of participants with similar profiles of codes in a quantitative analysis, cluster analysis can serve as a key component in mixed methods research. This article reports two studies. In the first study, we conduct simulations to test the accuracy of cluster assignment using three different clustering methods with binary data as produced when coding qualitative interviews. Results indicated that hierarchical clustering, K-Means clustering, and latent class analysis produced similar levels of accuracy with binary data, and that the accuracy of these methods did not decrease with samples as small as 50. Whereas the first study explores the feasibility of using common clustering methods with binary data, the second study provides a "real-world" example using data from a qualitative study of community leadership connected with a drug abuse prevention project. We discuss the implications of this approach for conducting prevention research, especially with small samples and culturally distinct communities. Qualitative inquiry can be a valuable tool in prevention research, providing rich material on motivations, behaviors, thoughts, and feelings. Qualitative inquiry is a key tool in discoverybased research, hypothesis generation, in characterizing the mechanisms underlying quantitative findings (e.g., Farrell et al., 2007), and can provide guidance in the development and refinement of measures. The patterns discovered in qualitative data can advance our understanding of how people interact with prevention programs and the divergent contexts in which they are embedded. In the current paper, we describe two studies that evaluate the performance of three different quantitative approaches for clustering binary data, such as the type produced in coding of qualitative interviews. We then provide an example of the application of a cluster analytic approach as a mixed methods component of a study of community leadership in drug abuse prevention.

Research paper thumbnail of Grappling With Grouping: Social-Network Analysis

Research paper thumbnail of Levels and growth of specific and general norms for nonviolence among middle school students

Journal of Adolescence, Jan 8, 2011

This study examined the levels and growth of specific and general normative beliefs about nonviol... more This study examined the levels and growth of specific and general normative beliefs about nonviolence (called norms for nonviolence). The sample consisted of 1254 middle school students from four metropolitan areas who participated in the control condition of the Multisite Violence Prevention Project. We predicted that the association and endorsement of specific and general norms for nonviolence would strengthen over time, levels and growth of norms for nonviolence would be moderated by gender and ethnicity, and norms for nonviolence would be related to youths' behaviors. Linear mixed models found that levels and direction of growth in specific and general norms varied as a function of gender, age, and ethnicity, providing partial support for our hypotheses. Specific and general norms for nonviolence were also consistently positively related to students' social skills and negatively related to students' aggressive behavior. Implications for understanding adolescent development are discussed.

Research paper thumbnail of Understanding How Programs Work to Prevent Overt Aggressive Behaviors: A Meta-analysis of Mediators of Elementary School–Based Programs

Journal of School Violence, Oct 1, 2011

Research paper thumbnail of Quality of Relationships Scale

Research paper thumbnail of Influence of school-level variables on aggression and associated attitudes of middle school students

Journal of School Psychology, Oct 1, 2011

Research paper thumbnail of Use of Clustering Methods to Understand More about the Case

Methodological Innovations online, Aug 1, 2011

During the past seventy years, the field of cluster analysis has emerged, accompanied by a pletho... more During the past seventy years, the field of cluster analysis has emerged, accompanied by a plethora of methods, algorithms, concepts, and terminology that are used in cluster-related research. We refer to cluster analysis (CA) as a general approach composed of several multivariate methods for delineating natural groups or clusters in data sets. In this paper, we describe the ability of CA to provide rich information about the individual case and highlight potential underlying social processes. First, we discuss the theory behind CA as well as differentiate between more and less familiar clustering approaches. Second, we illustrate the value of less familiar clustering techniques by comparing the results of a four wave growth mixture model of family variables versus clustering the same data with a more familiar two-step approach. The growth mixture modelling approach suggested a one-class cluster solution where all families shared similar growth trajectories in parenting practices and family relationship characteristics. However the two-step clustering approach suggested a four-class solution. Finally, we describe ways that CA allows researchers to model processes whose outcomes are the results of a combination of multiple factors and additional benefits of less familiar clustering methods.

Research paper thumbnail of YMCA Capacity Assessment for Youth Development Programming

Research paper thumbnail of Conducting Prevention Research and Evaluation in Schools

Springer eBooks, 2015

In a time when schools are experiencing the burden of multiple high-priority initiatives and, in ... more In a time when schools are experiencing the burden of multiple high-priority initiatives and, in many cases, tight budgets, federal priorities to increase evidence for programs and to promote educationally relevant research are increasing the research demands on schools. Given the increasing pressures experienced by schools, researchers need to carefully and artfully plan their work to maximize chances for success. This chapter presents some real-world challenges and solutions from research partnerships carried out with schools and districts including describing some considerations in maintaining the integrity of experimental designs in schools. We organize the chapter around a four-phase process of research with schools that includes (1) planning (building authentic partnerships with schools), (2) recruitment, (3) data collection, and (4) communication. At each phase, it is important for researchers to be open to educators’ ideas and ensure that the research serves the educators’ as well as the researchers’ mission. Our recommendations for researchers emphasize (1) respectful of school culture and customs; (2) patient if your study is not the school’s first priority; (3) authentic in your intentions to improve student outcomes, and to build positive relationships with school personnel; (4) persistent in engaging across seasons and across turnover of school/district leaders; and (5) demonstrably grateful to school staff for their participation and partnership in your study.

Research paper thumbnail of Bringing interventions to scale: Implications and challenges for the field of community psychology

American Psychological Association eBooks, 2017

Research paper thumbnail of Important implementation constructs for federal agencies in health and human service settings that are selecting, monitoring, and supporting grantees

Evidence & Policy: A Journal of Research, Debate and Practice, Aug 1, 2020

Background: Federal agencies and other funders seeking to maximise their impact aim to understand... more Background: Federal agencies and other funders seeking to maximise their impact aim to understand factors associated with implementing evidence-based interventions (EBIs) to address health problems. Challenges exist, however, in synthesising information from different disciplines and reaching agreement about these factors due to different terminology, frameworks, and measures being used in different fields. Methods: A mixed-methods approach was used to identifying a set of implementation constructs helpful for selecting, monitoring, and supporting federal grantees in health and human service settings. Three phases of research were conducted: a literature review, structured expert interviews, and consensus building. Interviews with implementation experts were used to validate a set of implementation constructs identified in the literature review as strongly and consistently related to successful implementation of EBIs in international contexts. A modified Delphi approach was used with a technical working group (TWG) of federal staff to agree on the constructs most relevant for federally funded EBIs. Findings: This process yielded 11 constructs related to either the intervention, the intersection between the invention and context, or the implementation process. These constructs are areas of interest when integrating research evidence into routine practice. Expert interviewees recommended establishing clear, consistent construct definitions before developing valid, feasible measures of the constructs. In contrast to the numerous and specific constructs advanced by researchers, federal TWG members favoured fewer constructs with more generalisability. Discussion and conclusions: This article demonstrates the translation work required for policy contexts and highlights a successful approach to translate evidence from implementation science research for federal staff.

Research paper thumbnail of Theories of Prevention Science

Research paper thumbnail of Applying Lessons Learned from the STRYVE Initiative to Expand the Role of Public Health Departments in Preventing Youth Violence

142nd APHA Annual Meeting and Exposition (November 15 - November 19, 2014), Nov 17, 2014

ABSTRACT Background/Purpose: The American Institutes of Research (AIR), in partnership with the C... more ABSTRACT Background/Purpose: The American Institutes of Research (AIR), in partnership with the Centers for the Disease Control, National Center of Injury Prevention and Control [CDC, NCIPC) is engaged in a second initiative focused around increasing the role and visibility of public health departments in preventing youth violence with 12 communities across the country. Methods This five-year initiative attempts to take lessons learned from the STRYVE initiative to support twelve communities in engaging in and expanding their efforts to prevent youth violence. Four communities who have been engaged in this type of work before and eight communities that are engaging in this work for the first time will be recruited for this initiative. Results/Outcomes Activities that have been achieved during the planning year of this initiative will be described. These include: developing an environmental scan of public health department and collecting data to inform what supports will be offered to participating sites, creating a recruitment approach to recruit two types of communities, and identifying the key supports that will be offered during this initiative that aim to decrease community rates of violent incidents (e.g., homicides). Conclusions Key findings from the environmental scan of the needs of public health departments, a rationale for the recruitment process, and a description of the supports that might help public health departments to engage in this type of work will be shared in an effort to increase the knowledge related to injury prevention and the role that public health departments can play in these efforts.

Research paper thumbnail of Improving College and Career Readiness by Incorporating Social and Emotional Learning

This issue brief was written to assist state policymakers in better understanding how social and ... more This issue brief was written to assist state policymakers in better understanding how social and emotional learning (SEL) can help students to be college and career ready. The brief provides a short description of what SEL is, why it is needed, and what it looks like in practice. In addition, examples of standards that support SEL at the federal and state levels, current SEL initiatives and programs, and outcomes and measures that can be used to assess SEL programming are described.

Research paper thumbnail of Medical Specialty Camp Alumni Perceptions of Outcomes and Experiences

Social Science Research Network, 2022

Research paper thumbnail of Assessing Implementation and Effects Associated with a Comprehensive Framework Designed to Reduce School Violence: A Randomized Controlled Trial

Journal of School Violence, 2021

ABSTRACT School safety continues to be a concern in today’s schools, and comprehensive approaches... more ABSTRACT School safety continues to be a concern in today’s schools, and comprehensive approaches to school safety are one way to address this concern. However, few comprehensive approaches have been rigorously evaluated. To address this gap, we evaluated the implementation and effects associated with Safe Communities Safe Schools (SCSS) comprehensive school safety framework. Forty-six middle schools received SCSS within a staggered randomized implementation design. Implementation data, classroom observations, staff and student perceptions of school climate, student attendance/truancy, suspension rates, and academic test scores indicated that schools implemented some SCSS components as intended. Mixed impacts were found on school climate, student behavior, and academic outcomes. Findings suggest that implementation data highlights barriers to bringing interventions to scale and comprehensive interventions produce changes sequentially. Comprehensive frameworks hold promise for building staff capacity and the necessary infrastructure to reduce school violence – but require engagement and commitment of key staff, and sufficient time for change to occur.

Research paper thumbnail of Effects of positive youth development programs on school, family, and community systems

American Journal of Community Psychology, Mar 31, 2007

Research paper thumbnail of Middle school students overestimate normative support for aggression and underestimate normative support for nonviolent problem-solving strategies

Journal of Applied Social Psychology, Feb 1, 2013

Research paper thumbnail of Moderating Effects of School Climate on Outcomes for the Multisite Violence Prevention Project Universal Program

Journal of Research on Adolescence, Aug 5, 2013

This study examines to what extent baseline school climate moderates the effects of a randomized ... more This study examines to what extent baseline school climate moderates the effects of a randomized controlled trial of a universal violence prevention intervention. School climate was assessed by teacher ratings of the quality of relationships among school members and the seriousness of school problems. Cluster analysis revealed three climate types: distressed, average, and conducive. Mixed-effects regression models of data from 5,256 students suggested limited overall positive program outcomes for students in schools assigned to the universal intervention versus students in schools assigned to control conditions. There was, however, evidence of differential effects of the universal intervention by climate type. These findings have important implications for identifying school characteristics that researchers and practitioners should consider in planning universal school-based interventions. Whereas a handful of studies have addressed the way that ecological characteristics (e.g., classroom, school, community factors) affect implementation of school-based prevention efforts (Gregory, Henry, Schoeny, & The Metropolitan Area Child Study Research Group, 2007; Kallestad & Olweus, 2003), few studies have analyzed how ecological variables influence student intervention outcomes (Farrell, Henry, & Bettencourt, 2011). Findings of one study suggested that, although the universal intervention produced robust effects for most schools, it was not associated with positive intervention effects in high-poverty schools (Conduct Problems Prevention Research Group, 2010). Another study found that a multicomponent intervention that had no effect in a poor and high-crime community had significant effects in a less distressed community (Metropolitan Area Child Study Research Group, 2002). The current study attempts to analyze the relationship of school climate to intervention outcomes in a randomized controlled trial of a schoolbased violence prevention program. Few studies have investigated the relations between specific ecological characteristics and student intervention outcomes. However, some longitudinal research has identified ecological characteristics that predict student outcomes, and other studies have linked ecological characteristics to program implementation. Considerable research evidence indicates that different aspects of school climate can affect student outcomes. Such characteristics include individual and school norms, supportive student-teacher relationships, and school policies and practices (

Research paper thumbnail of Clustering and its applications in community research

Research paper thumbnail of Clustering Methods with Qualitative Data: a Mixed-Methods Approach for Prevention Research with Small Samples

Prevention Science, May 7, 2015

Qualitative methods potentially add depth to prevention research, but can produce large amounts o... more Qualitative methods potentially add depth to prevention research, but can produce large amounts of complex data even with small samples. Studies conducted with culturally distinct samples often produce voluminous qualitative data, but may lack sufficient sample sizes for sophisticated quantitative analysis. Currently lacking in mixed methods research are methods allowing for more fully integrating qualitative and quantitative analysis techniques. Cluster analysis can be applied to coded qualitative data to clarify the findings of prevention studies by aiding efforts to reveal such things as the motives of participants for their actions and the reasons behind counterintuitive findings. By clustering groups of participants with similar profiles of codes in a quantitative analysis, cluster analysis can serve as a key component in mixed methods research. This article reports two studies. In the first study, we conduct simulations to test the accuracy of cluster assignment using three different clustering methods with binary data as produced when coding qualitative interviews. Results indicated that hierarchical clustering, K-Means clustering, and latent class analysis produced similar levels of accuracy with binary data, and that the accuracy of these methods did not decrease with samples as small as 50. Whereas the first study explores the feasibility of using common clustering methods with binary data, the second study provides a "real-world" example using data from a qualitative study of community leadership connected with a drug abuse prevention project. We discuss the implications of this approach for conducting prevention research, especially with small samples and culturally distinct communities. Qualitative inquiry can be a valuable tool in prevention research, providing rich material on motivations, behaviors, thoughts, and feelings. Qualitative inquiry is a key tool in discoverybased research, hypothesis generation, in characterizing the mechanisms underlying quantitative findings (e.g., Farrell et al., 2007), and can provide guidance in the development and refinement of measures. The patterns discovered in qualitative data can advance our understanding of how people interact with prevention programs and the divergent contexts in which they are embedded. In the current paper, we describe two studies that evaluate the performance of three different quantitative approaches for clustering binary data, such as the type produced in coding of qualitative interviews. We then provide an example of the application of a cluster analytic approach as a mixed methods component of a study of community leadership in drug abuse prevention.

Research paper thumbnail of Grappling With Grouping: Social-Network Analysis

Research paper thumbnail of Levels and growth of specific and general norms for nonviolence among middle school students

Journal of Adolescence, Jan 8, 2011

This study examined the levels and growth of specific and general normative beliefs about nonviol... more This study examined the levels and growth of specific and general normative beliefs about nonviolence (called norms for nonviolence). The sample consisted of 1254 middle school students from four metropolitan areas who participated in the control condition of the Multisite Violence Prevention Project. We predicted that the association and endorsement of specific and general norms for nonviolence would strengthen over time, levels and growth of norms for nonviolence would be moderated by gender and ethnicity, and norms for nonviolence would be related to youths' behaviors. Linear mixed models found that levels and direction of growth in specific and general norms varied as a function of gender, age, and ethnicity, providing partial support for our hypotheses. Specific and general norms for nonviolence were also consistently positively related to students' social skills and negatively related to students' aggressive behavior. Implications for understanding adolescent development are discussed.

Research paper thumbnail of Understanding How Programs Work to Prevent Overt Aggressive Behaviors: A Meta-analysis of Mediators of Elementary School–Based Programs

Journal of School Violence, Oct 1, 2011

Research paper thumbnail of Quality of Relationships Scale

Research paper thumbnail of Influence of school-level variables on aggression and associated attitudes of middle school students

Journal of School Psychology, Oct 1, 2011

Research paper thumbnail of Use of Clustering Methods to Understand More about the Case

Methodological Innovations online, Aug 1, 2011

During the past seventy years, the field of cluster analysis has emerged, accompanied by a pletho... more During the past seventy years, the field of cluster analysis has emerged, accompanied by a plethora of methods, algorithms, concepts, and terminology that are used in cluster-related research. We refer to cluster analysis (CA) as a general approach composed of several multivariate methods for delineating natural groups or clusters in data sets. In this paper, we describe the ability of CA to provide rich information about the individual case and highlight potential underlying social processes. First, we discuss the theory behind CA as well as differentiate between more and less familiar clustering approaches. Second, we illustrate the value of less familiar clustering techniques by comparing the results of a four wave growth mixture model of family variables versus clustering the same data with a more familiar two-step approach. The growth mixture modelling approach suggested a one-class cluster solution where all families shared similar growth trajectories in parenting practices and family relationship characteristics. However the two-step clustering approach suggested a four-class solution. Finally, we describe ways that CA allows researchers to model processes whose outcomes are the results of a combination of multiple factors and additional benefits of less familiar clustering methods.

Research paper thumbnail of YMCA Capacity Assessment for Youth Development Programming

Research paper thumbnail of Conducting Prevention Research and Evaluation in Schools

Springer eBooks, 2015

In a time when schools are experiencing the burden of multiple high-priority initiatives and, in ... more In a time when schools are experiencing the burden of multiple high-priority initiatives and, in many cases, tight budgets, federal priorities to increase evidence for programs and to promote educationally relevant research are increasing the research demands on schools. Given the increasing pressures experienced by schools, researchers need to carefully and artfully plan their work to maximize chances for success. This chapter presents some real-world challenges and solutions from research partnerships carried out with schools and districts including describing some considerations in maintaining the integrity of experimental designs in schools. We organize the chapter around a four-phase process of research with schools that includes (1) planning (building authentic partnerships with schools), (2) recruitment, (3) data collection, and (4) communication. At each phase, it is important for researchers to be open to educators’ ideas and ensure that the research serves the educators’ as well as the researchers’ mission. Our recommendations for researchers emphasize (1) respectful of school culture and customs; (2) patient if your study is not the school’s first priority; (3) authentic in your intentions to improve student outcomes, and to build positive relationships with school personnel; (4) persistent in engaging across seasons and across turnover of school/district leaders; and (5) demonstrably grateful to school staff for their participation and partnership in your study.

Research paper thumbnail of Bringing interventions to scale: Implications and challenges for the field of community psychology

American Psychological Association eBooks, 2017

Research paper thumbnail of Important implementation constructs for federal agencies in health and human service settings that are selecting, monitoring, and supporting grantees

Evidence & Policy: A Journal of Research, Debate and Practice, Aug 1, 2020

Background: Federal agencies and other funders seeking to maximise their impact aim to understand... more Background: Federal agencies and other funders seeking to maximise their impact aim to understand factors associated with implementing evidence-based interventions (EBIs) to address health problems. Challenges exist, however, in synthesising information from different disciplines and reaching agreement about these factors due to different terminology, frameworks, and measures being used in different fields. Methods: A mixed-methods approach was used to identifying a set of implementation constructs helpful for selecting, monitoring, and supporting federal grantees in health and human service settings. Three phases of research were conducted: a literature review, structured expert interviews, and consensus building. Interviews with implementation experts were used to validate a set of implementation constructs identified in the literature review as strongly and consistently related to successful implementation of EBIs in international contexts. A modified Delphi approach was used with a technical working group (TWG) of federal staff to agree on the constructs most relevant for federally funded EBIs. Findings: This process yielded 11 constructs related to either the intervention, the intersection between the invention and context, or the implementation process. These constructs are areas of interest when integrating research evidence into routine practice. Expert interviewees recommended establishing clear, consistent construct definitions before developing valid, feasible measures of the constructs. In contrast to the numerous and specific constructs advanced by researchers, federal TWG members favoured fewer constructs with more generalisability. Discussion and conclusions: This article demonstrates the translation work required for policy contexts and highlights a successful approach to translate evidence from implementation science research for federal staff.