Interventions in primary care to reduce medication related adverse events and hospital admissions: systematic review and meta‐analysis (original) (raw)

Abstract

Objective

To identify and evaluate studies of interventions in primary care aimed at reducing medication related adverse events that result in morbidity, hospital admission, and/or mortality.

Methods

Fourteen electronic databases were systematically searched for published and unpublished data. Bibliographies of retrieved papers were searched and experts and first authors contacted in an attempt to locate additional studies. There were no restrictions on language of publication. All interventions applied in primary care settings which aimed to improve patient safety by reducing adverse events resulting from medication overuse or misuse were considered. Randomised controlled trials, controlled trials, controlled before and after studies, and interrupted time series studies were eligible for inclusion. Study quality assessment and data extraction were undertaken using the Cochrane Effective Practice and Organisation of Care data collection checklist and template. Meta‐analysis was performed using a random effects model.

Results

159 studies were initially identified, of which 38 satisfied our inclusion criteria. These were categorised as follows: 17 pharmacist‐led interventions (of which 15 reported hospital admissions as an outcome); eight interventions led by other primary healthcare professionals that reported preventable drug related morbidity as an outcome; and 13 complex interventions that included a component of medication review aimed at reducing falls in the elderly (the outcome being falls). Meta‐analysis found that pharmacist‐led interventions are effective at reducing hospital admissions (OR 0.64 (95% CI 0.43 to 0.96)), but restricting analysis to the randomised controlled trials failed to demonstrate significant benefit (OR 0.92 (95% CI 0.81 to 1.05)). Pooling the results of studies in the other categories did not demonstrate any significant effect.

Conclusions

There is relatively weak evidence to indicate that pharmacist‐led medication reviews are effective in reducing hospital admissions. There is currently no evidence for the effectiveness of other interventions which aim at reducing admissions or preventable drug related morbidity. More randomised controlled trials of primary care based pharmacist‐led interventions are needed to decide whether or not this intervention is effective in reducing hospital admissions.

Keywords: medication error, patient safety, primary care


Medication related adverse events in primary care represent an important common cause of morbidity.1 A recent prospective cohort study has shown that, within 4 weeks of receiving a primary care prescription, 25% of patients experience an adverse drug event, 11% of which are judged preventable.2 A systematic review and meta‐analysis reported that a median 7.1% (interquartile range 5.7–16.2) of hospital admissions result from drug related problems, of which 59% were considered preventable (that is, attributable to error).3

Clinical errors, escalating costs of negligence claims, and continuing public debate about the prevalence of drug related morbidities have raised the profile of safety considerations in delivery of health care. Improving patient safety is therefore now a government priority in many economically developed countries including the UK and USA.4,5 Reduction of prescribing errors is of particular interest, both as a result of the disease burden posed and the likelihood of finding effective interventions.

To date, however, there has been no systematic review to help inform the development of interventions aimed at reducing the incidence of preventable drug related morbidity. Furthermore, there has been little research seeking to evaluate interventions that might lead to safer prescribing. We therefore sought systematically to identify and evaluate studies of interventions delivered in primary care settings which aimed to reduce preventable drug related morbidity.

Methods

Searching

A systematic search for published material was performed, initially for the period 1981–2001 and then extended for the main biomedical databases to 2005. Medical subject headings and text words were used in 10 electronic databases: Cochrane Database of Systematic Reviews (Issue 1, 2005), Cochrane Effective Practice and Organisation of Care (EPOC) specialised register, Cochrane Controlled Trials Register (CCTR) (Issue 1, 2005), MEDLINE (1966–Feb 2005), EMBASE (1980–Feb 2005), CINAHL (1982–Feb 2005), Psychinfo (1966–2001), Pharmline (1978–2001), Science Citation Index (1981–2001), and International Pharmaceutical Abstracts (1970–2001).

A further four databases were searched to identify dissertations and unpublished work including: the UK National Research Register (Issue 4, 2001), Dissertation Abstracts (1994–2001), Index to Thesis (1970–2001), and the System for Information on the Grey Literature (SIGLE). Bibliographies of key background papers and studies included in the review were also searched to identify additional published studies. In an attempt to identify other relevant unpublished studies, we wrote to subject experts and the first authors of included studies.

Search strategies, customised for each database, did not employ any language restriction and comprised four key concepts: study design, primary care setting, medication, and error. Search strategies were designed for each concept and then combined. Full details of the search strategy used are available from the first author.

Selection

In keeping with the Cochrane EPOC guidelines, we accepted data from randomised controlled trials and high quality controlled clinical trials, controlled before and after studies, and interrupted time series studies. Table 1 describes the quality criteria used to assess each study design.

Table 1 EPOC inclusion criteria for study design.

Randomised controlled trial:
Participants (or other units) definitely assigned prospectively to one or more alternative forms of health care using a process of random allocation (e.g. random number generation, coin flips).
Controlled clinical trial:
Participants (or other units) were:
(a) Definitely assigned prospectively to one or more alternative forms of health care using a quasi‐random allocation method (e.g. alternation, date of birth, patient identifier) or
(b) Possibly assigned prospectively to one or more alternative forms of health care using a process of random or quasi‐random allocation.
Controlled before and after study:
Involvement of intervention and control groups other than by random process and inclusion of baseline period of assessment of main outcomes. There are two minimum criteria for inclusion of controlled before and after studies in EPOC reviews:
(a) Contemporaneous data collection
(b) Appropriate choice of control site
Interrupted time series:
A change in trend attributable to the intervention. There are two minimum criteria for inclusion of interrupted time series designs in EPOC reviews:
(a) A clearly defined point in time when the intervention occurred
(b) At least three data points before and three after the intervention.

Studies were eligible for inclusion if they involved health care professionals providing community based family medical services. Community settings included family and general practice, community pharmacies, and nursing and residential homes. Studies of interventions in clinics attached to a hospital were excluded unless they were described as a primary care clinic.

We included interventions applied in primary care which aimed to reduce drug‐related morbidity, hospitalisation or death resulting from medication overuse or misuse. We did not include studies that contained data solely relating to errors of underuse.6

Two reviewers independently screened the titles and abstracts retrieved to assess studies against the inclusion criteria. Full text copies of all papers considered to be of potential relevance were obtained and first authors of studies were contacted for clarification where necessary. Any disagreement about relevance was resolved by discussion between the reviewers.

Validity assessment

The quality of all included studies was assessed independently by two reviewers, using the criteria developed by the EPOC group.7 Parameters including baseline measurements, concealment of allocation, blinding of outcome assessors, and losses to follow up were assessed.

Data abstraction and synthesis

Data extraction was completed by one reviewer and checked by a co‐reviewer using a data collection template. Discrepancies were resolved by discussion between reviewers. Studies were grouped together according to similarity of interventions and common outcomes. STATA 8 software was used to pool data; random effects models were used to allow for the anticipated statistical heterogeneity between studies. Unadjusted data from studies in which participants were recruited in clusters were adjusted for the clustering effect assuming an intraclass correlation coefficient (ICC) of 0.02.8

Results

Description of studies

159 studies were identified, of which 38 satisfied our inclusion criteria. The main reasons for excluding studies are summarised in the QUOROM flow diagram (fig 1).9 Our searches also identified 10 systematic reviews in related areas10,11,12,13,14,15,16,17,18,19 that provided additional references.

graphic file with name qc12153.f1.jpg

Figure 1 QUOROM flow diagram.

The characteristics of included studies are described in table 2. Eighteen studies were set in the USA, 16 in Europe, three in Australia, and one in New Zealand. Most studies examined a number of patient outcomes (for example, mortality rates, morbidity assessments and quality of life scores), while others examined data on processes of care (for example, completed medication reviews and drug utilisation data). Few studies, however, used patient outcomes as an a priori defined primary end point and none were designed to link patient outcomes causally to drug related adverse events.

Table 2 Characteristics of included studies.

Study Country Participants Study design Interventions Relevant outcomes Baseline measurements Concealment of allocation Attrition bias Blind outcome assessment Main results
Hawkins24 US 1148 patients with diabetes and/or hypertension attending primary care clinic RCT Pharmacist‐led Hospital admissions and emergency department visits Done Not clear Not done Not clear Hospital admissions: 0.16 patients/year v 0.17 patients/year (NS)
Emergency department visits:
1.18 patients/year v 1.01 patients/year (NS)
Cummings23 US 160 ambulatory adults CBA Pharmacist‐led Hospital admissions Done N/A Not clear Not clear Hospital admissions: 28/61 v 46/68
Thompson31 US 152 elderly patients in a skilled nursing facility CBA Pharmacist‐led Hospital admissions and number of deaths Done N/A Not clear Not clear Hospital admissions: 2.9% v 11.1% (p = 0.06)
Deaths: 3/67 v 10/72 (p = 0.05)
Kane38 US 9738 nursing home residents CBA Health care professional/educational Hospital admissions and emergency department visits Done N/A Not clear Not clear Hospital admissions: a relative decrease from pre to post of 0.69 per 1000 patient days (p<0.05).
Emergency department visits: a relative decrease from pre to post of 0.9 (NS)
Avorn43 US 823 patients from six stratified pairs of nursing homes RCT Health care professional/educational Formal assessments of mental status, memory, anxiety, depression, behaviour and sleep Done Not clear Not done Done Reduction in function in those taking antipsychotics: Mental status 38% v 56% (NS), memory 31% v 54% (p<0.05), anxiety 46% v 35% (NS), depression 56% v 27% (p<0.05), behaviour 45% v 38% (NS), sleep 35% v 25% (NS) Reduction in function in those taking benzodiazepines: Mental status 46% v 27% (NS), memory 62% v 29% (p<0.05), anxiety 23% v 52% (p<0.05), depression 40% v 38% (NS), behaviour 36% v 41% (NS), sleep 56% v 32% (NS)
Vetter52 UK 674 elderly patients of a single general practice RCT Intervention to reduce falls Fall with fracture Done Done Not done Not clear Falls with fractures: 5% v 4% (NS)
Zullich57 US 155 elderly patients taking benzodiazepines from 10 long term care facilities ITS Health care professional/educational Fall, hospital admission N/A N/A Not done Not clear Population risk ratio for falls 0.63 (NS) Population risk ratio for hospital admission 1.38 (NS)
Kimberlin35 US 762 patients using community pharmacies RCT Pharmacist‐led Hospital admissions Not clear Not clear Not done Not clear Odds of admission not significantly different between groups (numbers not reported)
Wilkinson42 UK 61 patients with depression attending three general practices RCT Health care professional/educational Adverse events Done Done Not done Not done Adverse events/number of patients: 46/14 v 37/19 (NS)
Knowlton36 US 18 pharmacies RCT Pharmacist‐led Hospital admissions Not done Not clear Not clear Not done Hospital admission rates per month: 3.95% v 3.93% (NS)
Tinetti50 US 301 elderly primary care patients RCT Intervention to reduce falls Falls, hospital admissions, deaths Done Not clear Done Done Falls: 35% v 47% (p = 0.04) Hospital admissions: 21% v 24% (NS) Deaths: 5% v 3% (NS)
Wagner53 US 1559 elderly primary care patients RCT Intervention to reduce falls Falls resulting in injury, falls resulting in hospital admission Done Not clear Done Not done Falls resulting in injury: 13.4% v 10.1% (NS) Falls resulting in hospital admission: 0.6% v 0.9% (NS)
Kendrick44 UK 440 patients with long term mental health problems from 16 general practices RCT Health care professional/educational Admissions Done Not clear Done Not clear Admissions with physical problems: 14.2% v 16.1% (NS)
Hanlon34 US 208 primary care patients on five or more regular medications RCT Pharmacist‐led Adverse drug events Done Not clear Done Done Adverse drug events: 30.2% v 40.0% (NS)
Carter45 Australia 658 elderly primary care patients RCT Intervention to reduce falls Fall resulting in injury Done Not clear Not done Not clear Fall resulting in injury: 10.4% v 14.3% (NS)
DeSonnaville41 Netherlands 505 primary care patients with type II diabetes CBA Health care professional/educational Episodes of hypoglycaemia Not done N/A Not done Not clear Episodes of hypoglycaemia/patient/year: 0.014 v 0 (NS)
Ray49 US 499 residents of seven matched pairs of nursing homes RCT Intervention to reduce falls Falls, mortality Done Done Done Done Incidence rate of injurious falls (per 100 person years): 13.7 v 19.9 (NS) Mortality rate (per 100 person years): 23.0 v 17.3 (NS)
Aubert37 US 138 primary care patients with diabetes RCT Health care professional/educational Hospital admissions, emergency department visits, severe low blood glucose events Done Not clear Not done Not clear Hospital admission rate: 6% v 6% (NS) Emergency department visits: 2% v 6% (NS) Severe low blood glucose events (increase from baseline): 3.1% v 2.9% (NS)
Lai27 US 874 primary care patients CBA Pharmacist‐led Hospital admissions, emergency department visits Done N/A Done Done Mean number of hospital admissions: 0.1 v 0.2 (NS) Mean number of emergency room visits: 0.06 v 0.06 (NS)
McCombs29 US 6000 patients using nine Kaiser Permanente pharmacies RCT Pharmacist‐led Hospital admissions Done Not clear Done Done Kaiser Permanente model associated with 3.3% lower likelihood of hospital admission
Campbell54 NZ 93 elderly primary care patients using hypnotics RCT Intervention to reduce falls Falls Done Done Not done Done Falls per person years: 0.52 v 1.16 (p<0.05)
Coleman46 US 169 elderly primary care patients RCT Health care professional/educational Falls, hospital admissions, emergency department visits Done Not clear Not done Not clear Fall in last 12 months: 43.5% v 35.6% (NS) Mean hospital admissions/year: 0.58 v 0.59 (NS) Mean emergency department visits/year: 0.23 v 0.27 (NS)
Bond21 UK 3074 primary care patients RCT Pharmacist‐led Adverse drug reactions, hospital admissions, mortality Not done Done Not clear Not clear Adverse drug reactions: 8.3% v 6.7% (NS) Hospital admissions: 6.0% v 5.7% (NS) Mortality rate: 3.6% v 3.8% (NS)
Furniss33 UK 330 residents of seven matched pairs of nursing homes RCT Pharmacist‐led Formal assessments of cognitive function, depression and behaviour and deaths Done Not clear Done Not clear Mean difference in cognitive function score: 1.6 in favour of control (NS) Mean difference in depression score: −0.75 in favour of intervention (NS) Mean difference in behaviour score: −2.2 in favour of control (p = 0.02) Deaths: 4 v 14 (p = 0.03)
Kempton55 Australia 3600 elderly primary care patients CBA Intervention to reduce falls Falls leading to hospital admission Done N/A Not done Not done Fall related hospital admission rate ratio: 0.8 (p<0.01)
Malone28 US 1054 primary care patients RCT Pharmacist‐led Hospital admissions Done Done Done Done Mean increase in hospital admission rates over study period: 0.13 v 0.19 (NS)
McMurdo48 UK 133 elderly patients from nine residential homes RCT Intervention to reduce falls Falls Not clear Not clear Not done Done Falls per person per week: 0.06 v 0.07 (NS)
Piette39 US 280 primary care patients with diabetes RCT Health care professional/educational Hospital admissions, emergency department visits. Done Done Done Not done Hospital admissions: 24% v 23% (NS) Emergency department visits: 48% v 40% (NS)
Poulstrup56 Denmark 26221 elderly primary care patients CBA Intervention to reduce falls Fractures Done N/A Not clear Not clear Reduction in fractures in intervention group compared to control: 14% (NS)
Van Haastregt51 Netherlands 316 elderly primary care patients RCT Intervention to reduce falls Falls Done Not clear Done Not clear Injurious falls: 28% v 22% (NS) Falls resulting in medical care: 18% v 12% (NS)
Bernsten20 Multi‐centre (Europe) 2454 elderly primary care patients RCT Pharmacist‐led Hospital admissions Not done Not clear Not done Not clear Hospital admissions: 35.6% v 40.4% (NS)
Herborg25 Denmark 500 patients obtaining asthma medication from community pharmacists CBA Pharmacist‐led Hospital admissions, emergency department visits Done N/A Done Not clear Hospital admissions per patient: 0.019 v 0.058 (not tested) Emergency department visits: 0.019 v 0.021 (not tested)
Krska26 UK 332 elderly primary care patients from six general practices RCT Pharmacist‐led Hospital admissions, pharmaceutical care issues Done Not clear Done Not clear Hospital admissions: 12 v 13 (not tested) Potential or suspected adverse drug reactions resolved: 84.3% v 57.8% (p<0.0001)
Olivarius40 Denmark 1316 primary care patients with diabetes RCT Health care professional/educational Hospital admissions, severe hypoglycaemic episodes Done Not clear Not done Not done Median number of hospital admissions since diagnosis: 1 v 1 (NS) Proportion of participants with an episode of severe hypoglycaemia since diagnosis: 4% v 4% (NS)
Roberts30 Australia 3230 residents of 55 nursing homes RCT Pharmacist‐led Hospital admissions, mortality Not clear Done Not done Not clear Difference in mean percentage hospital admission rate pre/post study: 1.3 v −16.9 (NS) Adjusted mortality rates per 100 person years: 27.2 v 31.7 (NS)
Zermansky32 UK 1188 elderly primary care patients RCT Pharmacist ‐led Hospital admissions Done Not clear Done Not clear Proportion admitted to hospital: 19% v 17% (NS)
Jensen47 Sweden 439 elderly patients from nine residential care facilities RCT Intervention to reduce falls Falls Done Not clear Done Not done Falls: 44% v 56% (p<0.05)
Bouvy22 Netherlands 152 patients with heart failure RCT Pharmacist‐led Hospital admissions Done Done Done Not done Hospital admissions: 32/74 v 42/78 (p = 0.4)

Methodological quality of included studies

Comments on the important methodological features of each study are presented in table 2. None of the studies made any adjustment for a clustering effect in the data presented, and none that used randomisation described this in sufficient detail for us to comment on the adequacy of concealment. We were, through discussion, able to classify studies according to the main features of the intervention.

Pharmacist‐led interventions

Seventeen studies included a medication review component in the intervention arm that was performed by a pharmacist.20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36 Thirteen of these studies20,21,22,23,24,25,26,27,28,29,30,31,32 included hospital admission data in a form that allowed the calculation of an odds ratio to summarise the findings; the remaining four did not, however, present data in this form and were excluded from the meta‐analysis.33,34,35,36 We found significant heterogeneity between studies (χ2 = 126.71, df = 12, p<0.001). Random effects meta‐analysis showed a significant positive effect of these interventions on hospital admissions (OR 0.64 (95% CI 0.43 to 0.96), fig 2).

graphic file with name qc12153.f2.jpg

Figure 2 Forest plot of pharmacist‐led intervention studies.

A sensitivity analysis restricting the included studies to randomised controlled trials removed the heterogeneity (χ2 = 5.62, df = 7, p = 0.58) but no longer found a positive effect (OR 0.92 (95% CI 0.81 to 1.05), fig 3). A sensitivity analysis using an ICC of 0.01 when adjusting the results of clustered studies did not affect the above results.

graphic file with name qc12153.f3.jpg

Figure 3 Forest plot of pharmacist‐led intervention randomised controlled trials.

A funnel plot was prepared and this suggested the presence of publication bias (fig 4). This was supported by Begg's rank correlation p value for bias of 0.04, but not by Egger's weighted regression method (p value for bias 0.88).

graphic file with name qc12153.f4.jpg

Figure 4 Funnel plot of all pharmacist‐led interventions.

Interventions led by other primary healthcare professionals

Eight studies reported interventions led by other primary healthcare professionals. Nurses used protocols to manage diabetes, heart failure, depression, and asthma in six of these37,38,39,40,41,42 and the remaining two involved education programmes for primary care physicians.43,44 Four of the nurse led interventions reported the incidence of adverse drug events which satisfied our inclusion criteria and allowed the calculation of an odds ratio.37,39,40,41 These were combined in a meta‐analysis but no significant effect was found (OR 1.05 (95% CI 0.57 to 1.94)); there was no significant heterogeneity (χ2 = 1.95, df = 3, p = 0.58).

Complex interventions to reduce falls in the elderly

Thirteen studies described interventions with a number of components that aimed to reduce the incidence of falls in the elderly.45,46,47,48,49,50,51,52,53,54,55,56,57 To be included in this review, one of the components had to be a medication review undertaken by a primary healthcare professional, the presumption being made that any reduction in the incidence of falls was at least in part a reduction in drug related morbidity. Nine of the studies presented data in a way which allowed the calculation of an odds ratio and these were pooled in a meta‐analysis.45,46,47,48,49,50,51,52,53 No significant effect was demonstrated (OR 0.91 (95% CI 0.68 to 1.21)) and there was no significant heterogeneity (χ2 = 14.59, df = 8, p = 0.07).

Studies not included in the meta‐analysis

Table 2 presents the key features of the design and the principal findings of all studies that satisfied our inclusion criteria, including those that could not be included in the meta‐analysis.

Discussion

We have shown that there is some evidence that pharmacist‐led interventions incorporating a medication review component are effective in reducing hospital admissions. However, when restricted to randomised controlled trials (which are less susceptible to bias than controlled before–after studies and interrupted time series analysis), the pooled odds ratio became non‐significant. We found no evidence of any significant effect of primary care medication reviews aimed at reducing falls in the elderly on the primary outcome, or of nurse‐led chronic disease management programmes in reducing drug related morbidity.

Strengths of review

We searched a very broad range of published and unpublished sources of information and coupled this with rigorous quality assessment and appraisal of studies. We deliberately narrowed the focus of the review to those studies which attempted to address errors resulting in actual patient harm as opposed to process outcomes only.

Limitations of review

Publication bias is an important potential source of bias in systematic reviews.58 Considerable effort was therefore made to locate unpublished studies. However, a small number may have been omitted from the review, as is suggested by the borderline assessment of evidence of publication bias.

The setting for this review was primary care and our findings are unlikely to be applicable to all healthcare systems. For example, studies undertaken in ambulatory patients based in general medical clinics in the USA met our inclusion criteria but their relevance to the primary care systems of Western Europe can be questioned. We deliberately chose “bottom line” patient outcome measures as the focus of this review in order to maximise its usefulness to healthcare policy makers and service commissioners. Some studies that were included showed significant improvements in upstream outcomes and their value in this respect is not acknowledged by our criteria.

Implications for health policy, clinical care, and future research

This systematic review has shown a paucity of high quality evaluations of interventions aimed specifically at preventing medication related adverse events in primary care. The clinical implications of these studies are therefore at present limited.

Given the high disease burden associated with prescribing errors in primary care, there is a pressing need for further studies in this field. In developing future interventions, researchers should focus on patient safety and should endeavour to select outcome measures that allow for ready comparisons with other studies. For example, criteria exist to classify hospital admissions as “medication related”, yet none of the studies identified in the review used these criteria.4 Future studies need to be powered adequately to be able to detect clinically important reductions in prescribing errors, and they should consider building in a cost‐effectiveness analysis.

In the USA and several other countries, the use of information technology to support medication safety is well developed. We were therefore surprised not to find more evaluations of the role of computers in improving patient safety in primary care, given the benefits that have been shown to accrue from its use in hospital facilities.59 There is therefore a need to assess the effectiveness of these system interventions in preventing medication related adverse events, and to evaluate future developments in these systems.

Conclusions

There is some evidence that pharmacist‐led interventions aimed at optimising medication regimens are effective in reducing hospital admissions from primary care. Larger, rigorously designed intervention studies are now needed to evaluate whether the significantly increased body of understanding of the causes of medication errors can be translated into meaningful improvements in patient outcomes.

Key messages

Footnotes

Funding: BUPA Foundation.

Competing interests: None declared.

References