How well do search filters perform in identifying economic evaluations in MEDLINE and EMBASE | International Journal of Technology Assessment in Health Care | Cambridge Core (original) (raw)

Article contents

Abstract

Objectives: Health technology assessment (HTA) agencies assessing the cost-effectiveness of healthcare technologies seek evidence from economic evaluations. As well as searching economic evaluation databases, researchers often search MEDLINE and EMBASE, using search filters whose current performance is unclear. We assessed the performance of search filters in identifying economic evaluations from MEDLINE and EMBASE.

Methods: A gold standard of economic evaluations was compiled from National Health Service Economic Evaluation Database (NHS EED) records for 2000, 2003, and 2006. Corresponding records were retrieved in MEDLINE and EMBASE. Search filters were identified from the InterTASC Information Specialists’ SubGroup Web site and from Canadian Agency for Drugs and Technologies in Health (CADTH) Information Services. The sensitivity and precision of search filters in retrieving gold standard records from MEDLINE and EMBASE were tested.

Results: A total of 2,070 full economic evaluations were identified from NHS EED. Of these, 1,955 records were available in Ovid MEDLINE and 1,873 were available in Ovid EMBASE. Thirteen MEDLINE and eight EMBASE filters were identified. NHS Quality Improvement Scotland (full and brief filters), the NHS EED and Royle and Waugh filters achieved over 0.99 sensitivity in MEDLINE. NHS Quality Improvement Scotland, CADTH, Royle and Waugh, and NHS EED filters achieved greater than 0.99 sensitivity in EMBASE. Filters demonstrated low precision.

Conclusions: This research provided new performance data on search filters to identify economic evaluations in MEDLINE and EMBASE. It demonstrated that highly sensitive economic evaluation filters are available, but that precision is low, yielding perhaps 5 relevant records per 100 records scanned.

Keywords

Information

Type

General Essays

Copyright

Copyright © Cambridge University Press 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

  1. Bak, G, Mierzwinski-Urban, M, Fitzsimmons, H, Morrison, A, Maden-Jenkins, M. A pragmatic critical appraisal instrument for search filters: Introducing the CADTH CAI. Health Info Libr J. 2008. Epub ahead of print.CrossRefGoogle Scholar

  2. EndNote X1.1.01. Carlsbad, CA: Thomson Reuters; 2009.Google Scholar

  3. Glanville, JM, Lefebvre, C, Miles, JN, et al. How to identify randomized controlled trials in MEDLINE: Ten years on. J Med Libr Assoc. 2006;94:130–136.Google Scholar

  4. Ho, C, Li, H, Noorani, H, et al. Appendix 2: Literature search strategy for cost-effectiveness studies. In: Implantable cardiac defibrillators for primary prevention of sudden cardiac death in high risk patients: A meta-analysis of clinical efficacy, and a review of cost-effectiveness and psychosocial issues [Technology report no 81]. Ottawa: Canadian Agency for Drugs and Technologies in Health (CADTH); 2007. http://www.cadth.ca/media/pdf/332_ICD_tr_appendices_e.pdf (accessed September 11, 2009).Google Scholar

  5. Lefebvre, C, Manheimer, E, Glanville, JM. Chapter 6: Searching for studies. In: Higgins, JPT, Green, S, eds. Cochrane handbook for systematic reviews of interventions version 5.0.1 (updated September 2008). Cochrane Collaboration; 2008. http://www.cochrane-handbook.org/ (accessed September 11, 2009).Google Scholar

  6. Ritchie, G, Glanville, J, Lefebvre, C. Do published search filters to identify diagnostic test accuracy studies perform adequately? Health Info Libr J. 2007;24:188–192.CrossRefGoogle ScholarPubMed

  7. Royle, P, Waugh, N. Literature searching for clinical and cost-effectiveness studies used in health technology assessment reports carried out for the National Institute for Clinical Excellence appraisal system. Health Technol Assess. 2003;7:iii, ix-51. http://www.hta.ac.uk/fullmono/mon734.pdf (accessed September 11, 2009).CrossRefGoogle ScholarPubMed

  8. Sassi, F, Archard, L, McDaid, D. Searching literature databases for health care economic evaluations: How systematic can we afford to be? Med Care. 2002;40:387–394.CrossRefGoogle ScholarPubMed

  9. Wilczynski, NL, Haynes, RB, Lavis, JN, et al. Optimal search strategies for detecting health services research studies in MEDLINE. CMAJ. 2004;171:1179–1185.CrossRefGoogle ScholarPubMed