Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute (original) (raw)
Related papers
Investigating complexity in systematic reviews of interventions by using a spectrum of methods
Journal of Clinical Epidemiology, 2013
Systematic reviews framed by PICOS (Populations, Interventions, Comparisons, Outcomes, and Study designs) have been valuable for synthesizing evidence about the effects of interventions. However, this framework is limited in its utility for exploring the influence of variations within populations or interventions, or about the mechanisms of action or causal pathways thought to mediate outcomes, other contextual factors that might similarly moderate outcomes, or how and when these mechanisms and elements interact. Valuable insights into these issues come from configurative as well as aggregative methods of synthesis. This article considers the range of evidence that can be used in systematic reviews of interventions to investigate complexity in terms of potential sources of variation in interventions and their effects, and presents a continuum of purposes for, and approaches to, evidence synthesis. Choosing an appropriate synthesis method takes into account whether the purpose of the synthesis is to generate, explore, or test theories. Taking complexity into account in a synthesis of economic evidence similarly shifts emphasis from evidence synthesis strategies focused on aggregation toward configurative strategies that aim to develop, explore, and refine (in advance of testing) theories or explanations of how and why interventions are more or less resource intensive, costly or cost-effective in different settings, or when implemented in different ways.
AHRQ Series on Complex Intervention Systematic Reviews - Paper 5: Advanced Analytic Methods
Journal of clinical epidemiology, 2017
Advanced analytic methods for synthesizing evidence about complex interventions continue to be developed. In this paper, we emphasize that the specific research question posed in the review should be used as a guide for choosing the appropriate analytic method. We present advanced analytic approaches that address four common questions that guide reviews of complex interventions: 1) How effective is the intervention?; 2) For whom does the intervention work and in what contexts?; 3) What happens when the intervention is implemented?; and 4) What decisions are possible given the results of the synthesis? The analytic approaches presented in this paper are particularly useful when each primary study differs in components, mechanisms of action, context, implementation, timing, and many other domains.
Background: Once a proposed topic has been identified for a systematic review and has undergone a question formulation stage, a protocol must be developed that specifies the scope and research questions in detail and outlines the methodology for conducting the systematic review. Rationale: Framework modifications are often needed to accommodate increased complexity. We describe and give examples of adaptations and alternatives to traditional analytic frameworks. Discussion: This article identifies and describes elements of frameworks and how they can be adapted to inform the protocol and conduct of systematic reviews of complex interventions. Modifications may be needed to adapt the population, intervention, comparators, and outcomes normally used in protocol development to successfully describe complex interventions; in some instances, alternative frameworks may be better suited. Possible approaches to analytic frameworks for complex interventions that illustrate causal and associative linkages are outlined, including time elements, which systematic reviews of complex interventions may need to address. The need for and specifics of the accommodations vary with details of a specific systematic review. This in turn helps determine whether traditional frameworks are sufficient, can be refined, or if alternate frameworks must be adopted.
Synthesising quantitative evidence in systematic reviews of complex health interventions
BMJ Global Health
Public health and health service interventions are typically complex: they are multifaceted, with impacts at multiple levels and on multiple stakeholders. Systematic reviews evaluating the effects of complex health interventions can be challenging to conduct. This paper is part of a special series of papers considering these challenges particularly in the context of WHO guideline development. We outline established and innovative methods for synthesising quantitative evidence within a systematic review of a complex intervention, including considerations of the complexity of the system into which the intervention is introduced. We describe methods in three broad areas: non-quantitative approaches, including tabulation, narrative and graphical approaches; standard meta-analysis methods, including meta-regression to investigate study-level moderators of effect; and advanced synthesis methods, in which models allow exploration of intervention components, investigation of both moderators...
Health Technology Assessment, 2021
BackgroundThe Medical Research Council published the second edition of its framework in 2006 on developing and evaluating complex interventions. Since then, there have been considerable developments in the field of complex intervention research. The objective of this project was to update the framework in the light of these developments. The framework aims to help research teams prioritise research questions and design, and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods.MethodsThere were four stages to the update: (1) gap analysis to identify developments in the methods and practice since the previous framework was published; (2) an expert workshop of 36 participants to discuss the topics identified in the gap analysis; (3) an open consultation process to seek comments on a first draft of the new framework; and (4) findings from the previous stages were used to redraft the framework, and final expert re...
BMC medical research methodology, 2017
Health interventions fall along a spectrum from simple to more complex. There is wide interest in methods for reviewing 'complex interventions', but few transparent approaches for assessing intervention complexity in systematic reviews. Such assessments may assist review authors in, for example, systematically describing interventions and developing logic models. This paper describes the development and application of the intervention Complexity Assessment Tool for Systematic Reviews (iCAT_SR), a new tool to assess and categorise levels of intervention complexity in systematic reviews. We developed the iCAT_SR by adapting and extending an existing complexity assessment tool for randomized trials. We undertook this adaptation using a consensus approach in which possible complexity dimensions were circulated for feedback to a panel of methodologists with expertise in complex interventions and systematic reviews. Based on these inputs, we developed a draft version of the tool. ...