Reference bias in reports of drug trials - PubMed (original) (raw)

. 1987 Sep 12;295(6599):654-6.

Affiliations

PMID: 3117277
PMCID: PMC1257776

Reference bias in reports of drug trials

P C Gøtzsche. Br Med J (Clin Res Ed). 1987.

Abstract

Articles published before 1985 describing double blind trials of two or more non-steroidal anti-inflammatory drugs in rheumatoid arthritis were examined to see whether there was any bias in the references they cited. Althogether 244 articles meeting the criteria were found through a Medline search and through examining the reference lists of the articles retrieved. The drugs compared in the studies were classified as new or as control drugs and the outcome of the trial as positive or not positive. The reference lists of all papers with references to other trials on the new drug were then examined for reference bias. Positive bias was judged to have occurred if the reference list contained a higher proportion of references with a positive outcome for that drug than among all the articles assumed to have been available to the authors (those published more than two years earlier than the index article). Altogether 133 of the 244 articles were excluded for various reasons--for example, 44 because of multiple publication and 19 because they had no references. Among the 111 articles analysed bias was not possible in the references of 35 (because all the references gave the same outcome); 10 had a neutral selection of references, 22 a negative selection, and 44 a positive selection--a significant positive bias. This bias was not caused by better scientific standing of the cited articles over the uncited ones. Thus retrieving literature by scanning reference lists may produce a biased sample of articles, and reference bias may also render the conclusions of an article less reliable.

PubMed Disclaimer

Cited by

Examining the Predictive Validity of NIH Peer Review Scores.
Lindner MD, Nakamura RK. Lindner MD, et al. PLoS One. 2015 Jun 3;10(6):e0126938. doi: 10.1371/journal.pone.0126938. eCollection 2015. PLoS One. 2015. PMID: 26039440 Free PMC article.
Systematic reviews in health care: Investigating and dealing with publication and other biases in meta-analysis.
Sterne JA, Egger M, Smith GD. Sterne JA, et al. BMJ. 2001 Jul 14;323(7304):101-5. doi: 10.1136/bmj.323.7304.101. BMJ. 2001. PMID: 11451790 Free PMC article. Review. No abstract available.
Accumulation Bias in meta-analysis: the need to consider time in error control.
Ter Schure J, Grünwald P. Ter Schure J, et al. F1000Res. 2019 Jun 25;8:962. doi: 10.12688/f1000research.19375.1. eCollection 2019. F1000Res. 2019. PMID: 31737258 Free PMC article.
Multidisciplinary rehabilitation for adults with multiple sclerosis.
Khan F, Turner-Stokes L, Ng L, Kilpatrick T. Khan F, et al. Cochrane Database Syst Rev. 2007 Apr 18;2007(2):CD006036. doi: 10.1002/14651858.CD006036.pub2. Cochrane Database Syst Rev. 2007. PMID: 17443610 Free PMC article.
Biologic agents in rheumatology: unmet issues after 200 trials and $200 billion sales.
Ioannidis JP, Karassa FB, Druyts E, Thorlund K, Mills EJ. Ioannidis JP, et al. Nat Rev Rheumatol. 2013 Nov;9(11):665-73. doi: 10.1038/nrrheum.2013.134. Epub 2013 Sep 3. Nat Rev Rheumatol. 2013. PMID: 23999553 Review.

Reference bias in reports of drug trials - PubMed (original) (raw)