Assessing risk of bias in prevalence studies: modification of an existing tool and evidence of interrater agreement - PubMed (original) (raw)
Assessing risk of bias in prevalence studies: modification of an existing tool and evidence of interrater agreement
Damian Hoy et al. J Clin Epidemiol. 2012 Sep.
Abstract
Objective: In the course of performing systematic reviews on the prevalence of low back and neck pain, we required a tool to assess the risk of study bias. Our objectives were to (1) modify an existing checklist and (2) test the final tool for interrater agreement.
Study design and setting: The final tool consists of 10 items addressing four domains of bias plus a summary risk of bias assessment. Two researchers tested the interrater agreement of the tool by independently assessing 54 randomly selected studies. Interrater agreement overall and for each individual item was assessed using the proportion of agreement and Kappa statistic.
Results: Raters found the tool easy to use, and there was high interrater agreement: overall agreement was 91% and the Kappa statistic was 0.82 (95% confidence interval: 0.76, 0.86). Agreement was almost perfect for the individual items on the tool and moderate for the summary assessment.
Conclusion: We have addressed a research gap by modifying and testing a tool to assess risk of study bias. Further research may be useful for assessing the applicability of the tool across different conditions.
Copyright © 2012 Elsevier Inc. All rights reserved.
Comment in
- Be specific and dare to generalize: do we need a rating form for every disease?
Kane RL, Shamliyan T. Kane RL, et al. J Clin Epidemiol. 2012 Sep;65(9):921-3. doi: 10.1016/j.jclinepi.2012.03.003. Epub 2012 Jun 26. J Clin Epidemiol. 2012. PMID: 22739246 No abstract available.
Similar articles
- Reliability of 3 assessment tools used to evaluate randomized controlled trials for treatment of neck pain.
Graham N, Haines T, Goldsmith CH, Gross A, Burnie S, Shahzad U, Talovikova E. Graham N, et al. Spine (Phila Pa 1976). 2012 Mar 15;37(6):515-22. doi: 10.1097/BRS.0b013e31822671eb. Spine (Phila Pa 1976). 2012. PMID: 21673624 - Assessment of study quality for systematic reviews: a comparison of the Cochrane Collaboration Risk of Bias Tool and the Effective Public Health Practice Project Quality Assessment Tool: methodological research.
Armijo-Olivo S, Stiles CR, Hagen NA, Biondo PD, Cummings GG. Armijo-Olivo S, et al. J Eval Clin Pract. 2012 Feb;18(1):12-8. doi: 10.1111/j.1365-2753.2010.01516.x. Epub 2010 Aug 4. J Eval Clin Pract. 2012. PMID: 20698919 - Interrater reliability in assessing quality of diagnostic accuracy studies using the QUADAS tool. A preliminary assessment.
Hollingworth W, Medina LS, Lenkinski RE, Shibata DK, Bernal B, Zurakowski D, Comstock B, Jarvik JG. Hollingworth W, et al. Acad Radiol. 2006 Jul;13(7):803-10. doi: 10.1016/j.acra.2006.03.008. Acad Radiol. 2006. PMID: 16777553 - Forty-two systematic reviews generated 23 items for assessing the risk of bias in values and preferences' studies.
Yepes-Nuñez JJ, Zhang Y, Xie F, Alonso-Coello P, Selva A, Schünemann H, Guyatt G. Yepes-Nuñez JJ, et al. J Clin Epidemiol. 2017 May;85:21-31. doi: 10.1016/j.jclinepi.2017.04.019. Epub 2017 May 4. J Clin Epidemiol. 2017. PMID: 28478082 Review. - Developing and Testing a Tool for the Classification of Study Designs in Systematic Reviews of Interventions and Exposures [Internet].
Hartling L, Bond K, Harvey K, Santaguida PL, Viswanathan M, Dryden DM. Hartling L, et al. Rockville (MD): Agency for Healthcare Research and Quality (US); 2010 Dec. Report No.: 11-EHC007-EF. Rockville (MD): Agency for Healthcare Research and Quality (US); 2010 Dec. Report No.: 11-EHC007-EF. PMID: 21433333 Free Books & Documents. Review.
Cited by
- Stakeholder attitudes to the regulation of traditional and complementary medicine professions: a systematic review.
Carè J, Steel A, Wardle J. Carè J, et al. Hum Resour Health. 2021 Mar 29;19(1):42. doi: 10.1186/s12960-021-00579-y. Hum Resour Health. 2021. PMID: 33781297 Free PMC article. Review. - Person-centred care in osteoarthritis and inflammatory arthritis: a scoping review of people's needs outside of healthcare.
Fairley JL, Seneviwickrama M, Yeh S, Anthony S, Chou L, Cicuttini FM, Sullivan K, Briggs AM, Wluka AE. Fairley JL, et al. BMC Musculoskelet Disord. 2021 Apr 9;22(1):341. doi: 10.1186/s12891-021-04190-z. BMC Musculoskelet Disord. 2021. PMID: 33836697 Free PMC article. Review. - Systematic review of the global epidemiology of viral-induced acute liver failure.
Patterson J, Hussey HS, Silal S, Goddard L, Setshedi M, Spearman W, Hussey GD, Kagina BM, Muloiwa R. Patterson J, et al. BMJ Open. 2020 Jul 20;10(7):e037473. doi: 10.1136/bmjopen-2020-037473. BMJ Open. 2020. PMID: 32690747 Free PMC article. - Overuse of diagnostic testing in healthcare: a systematic review.
Müskens JLJM, Kool RB, van Dulmen SA, Westert GP. Müskens JLJM, et al. BMJ Qual Saf. 2022 Jan;31(1):54-63. doi: 10.1136/bmjqs-2020-012576. Epub 2021 May 10. BMJ Qual Saf. 2022. PMID: 33972387 Free PMC article. - Hepatitis E Virus in Water Environments: A Systematic Review and Meta-analysis.
Takuissu GR, Kenmoe S, Ndip L, Ebogo-Belobo JT, Kengne-Ndé C, Mbaga DS, Bowo-Ngandji A, Oyono MG, Kenfack-Momo R, Tchatchouang S, Kenfack-Zanguim J, Lontuo Fogang R, Zeuko'o Menkem E, Kame-Ngasse GI, Magoudjou-Pekam JN, Nkie Esemu S, Veneri C, Mancini P, Bonanno Ferraro G, Iaconelli M, Suffredini E, La Rosa G. Takuissu GR, et al. Food Environ Virol. 2022 Sep;14(3):223-235. doi: 10.1007/s12560-022-09530-3. Epub 2022 Aug 29. Food Environ Virol. 2022. PMID: 36036329 Free PMC article. Review.
MeSH terms
LinkOut - more resources
Full Text Sources
Miscellaneous