Assessing risk of bias in prevalence studies: modification of an existing tool and evidence of interrater agreement - PubMed (original) (raw)
Assessing risk of bias in prevalence studies: modification of an existing tool and evidence of interrater agreement
Damian Hoy et al. J Clin Epidemiol. 2012 Sep.
Abstract
Objective: In the course of performing systematic reviews on the prevalence of low back and neck pain, we required a tool to assess the risk of study bias. Our objectives were to (1) modify an existing checklist and (2) test the final tool for interrater agreement.
Study design and setting: The final tool consists of 10 items addressing four domains of bias plus a summary risk of bias assessment. Two researchers tested the interrater agreement of the tool by independently assessing 54 randomly selected studies. Interrater agreement overall and for each individual item was assessed using the proportion of agreement and Kappa statistic.
Results: Raters found the tool easy to use, and there was high interrater agreement: overall agreement was 91% and the Kappa statistic was 0.82 (95% confidence interval: 0.76, 0.86). Agreement was almost perfect for the individual items on the tool and moderate for the summary assessment.
Conclusion: We have addressed a research gap by modifying and testing a tool to assess risk of study bias. Further research may be useful for assessing the applicability of the tool across different conditions.
Copyright © 2012 Elsevier Inc. All rights reserved.
Comment in
- Be specific and dare to generalize: do we need a rating form for every disease?
Kane RL, Shamliyan T. Kane RL, et al. J Clin Epidemiol. 2012 Sep;65(9):921-3. doi: 10.1016/j.jclinepi.2012.03.003. Epub 2012 Jun 26. J Clin Epidemiol. 2012. PMID: 22739246 No abstract available.
Similar articles
- Reliability of 3 assessment tools used to evaluate randomized controlled trials for treatment of neck pain.
Graham N, Haines T, Goldsmith CH, Gross A, Burnie S, Shahzad U, Talovikova E. Graham N, et al. Spine (Phila Pa 1976). 2012 Mar 15;37(6):515-22. doi: 10.1097/BRS.0b013e31822671eb. Spine (Phila Pa 1976). 2012. PMID: 21673624 - Assessment of study quality for systematic reviews: a comparison of the Cochrane Collaboration Risk of Bias Tool and the Effective Public Health Practice Project Quality Assessment Tool: methodological research.
Armijo-Olivo S, Stiles CR, Hagen NA, Biondo PD, Cummings GG. Armijo-Olivo S, et al. J Eval Clin Pract. 2012 Feb;18(1):12-8. doi: 10.1111/j.1365-2753.2010.01516.x. Epub 2010 Aug 4. J Eval Clin Pract. 2012. PMID: 20698919 - Interrater reliability in assessing quality of diagnostic accuracy studies using the QUADAS tool. A preliminary assessment.
Hollingworth W, Medina LS, Lenkinski RE, Shibata DK, Bernal B, Zurakowski D, Comstock B, Jarvik JG. Hollingworth W, et al. Acad Radiol. 2006 Jul;13(7):803-10. doi: 10.1016/j.acra.2006.03.008. Acad Radiol. 2006. PMID: 16777553 - Forty-two systematic reviews generated 23 items for assessing the risk of bias in values and preferences' studies.
Yepes-Nuñez JJ, Zhang Y, Xie F, Alonso-Coello P, Selva A, Schünemann H, Guyatt G. Yepes-Nuñez JJ, et al. J Clin Epidemiol. 2017 May;85:21-31. doi: 10.1016/j.jclinepi.2017.04.019. Epub 2017 May 4. J Clin Epidemiol. 2017. PMID: 28478082 Review. - Developing and Testing a Tool for the Classification of Study Designs in Systematic Reviews of Interventions and Exposures [Internet].
Hartling L, Bond K, Harvey K, Santaguida PL, Viswanathan M, Dryden DM. Hartling L, et al. Rockville (MD): Agency for Healthcare Research and Quality (US); 2010 Dec. Report No.: 11-EHC007-EF. Rockville (MD): Agency for Healthcare Research and Quality (US); 2010 Dec. Report No.: 11-EHC007-EF. PMID: 21433333 Free Books & Documents. Review.
Cited by
- Live birth rate after oocyte donation in females diagnosed with turner syndrome: a systematic review and meta-analysis.
Rashidian P, Parsaei M, Karami S, Sharifi TSS, Sadin Z, Salehi SA. Rashidian P, et al. BMC Pregnancy Childbirth. 2024 Sep 18;24(1):605. doi: 10.1186/s12884-024-06801-8. BMC Pregnancy Childbirth. 2024. PMID: 39294592 - Vitamin D content and prevalence of vitamin D deficiency in patients with epilepsy: a systematic review and meta-analysis.
Liu Y, Gong C, Li J, Ning X, Zeng P, Wang L, Lian B, Liu J, Fang L, Guo J. Liu Y, et al. Front Nutr. 2024 Aug 30;11:1439279. doi: 10.3389/fnut.2024.1439279. eCollection 2024. Front Nutr. 2024. PMID: 39279896 Free PMC article. - Etiology, clinical profile, and outcomes of crescentic glomerulonephritis in children: a systematic review.
Meena J, Nangla P, Ojha S, Sinha A, Hari P, Bagga A. Meena J, et al. Pediatr Nephrol. 2024 Sep 16. doi: 10.1007/s00467-024-06521-3. Online ahead of print. Pediatr Nephrol. 2024. PMID: 39278987 Review. - Prevalence of turnover intention among emergency nurses worldwide: a meta-analysis.
Ren H, Xue Y, Li P, Yin X, Xin W, Li H. Ren H, et al. BMC Nurs. 2024 Sep 11;23(1):645. doi: 10.1186/s12912-024-02284-2. BMC Nurs. 2024. PMID: 39261866 Free PMC article. - Gestational diabetes mellitus prevalence in Brazil: a systematic review and meta-analysis.
Mocellin LP, Gomes HA, Sona L, Giacomini GM, Pizzuti EP, Nunes GB, Zanchet TM, Macedo JL. Mocellin LP, et al. Cad Saude Publica. 2024 Sep 9;40(8):e00064919. doi: 10.1590/0102-311XEN064919. eCollection 2024. Cad Saude Publica. 2024. PMID: 39258680 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Miscellaneous