A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews - PubMed (original) (raw)
Review
A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews
Pierre Pluye et al. Int J Nurs Stud. 2009 Apr.
Abstract
A new form of literature review has emerged, Mixed Studies Review (MSR). These reviews include qualitative, quantitative and mixed methods studies. In the present paper, we examine MSRs in health sciences, and provide guidance on processes that should be included and reported. However, there are no valid and usable criteria for concomitantly appraising the methodological quality of the qualitative, quantitative and mixed methods studies.
Objective: To propose criteria for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies or study components.
Design: A three-step critical review was conducted.
Data sources: 2322 references were identified in MEDLINE, and their titles and abstracts were screened; 149 potentially relevant references were selected and the full-text papers were examined; 59 MSRs were retained and scrutinized using a deductive-inductive qualitative thematic data analysis. This revealed three types of MSR: convenience, reproducible, and systematic.
Review methods: Guided by a proposal, we conducted a qualitative thematic data analysis of the quality appraisal procedures used in the 17 systematic MSRs (SMSRs).
Results: Of 17 SMSRs, 12 showed clear quality appraisal procedures with explicit criteria but no SMSR used valid checklists to concomitantly appraise qualitative, quantitative and mixed methods studies. In two SMSRs, criteria were developed following a specific procedure. Checklists usually contained more criteria than needed. In four SMSRs, a reliability assessment was described or mentioned. While criteria for quality appraisal were usually based on descriptors that require specific methodological expertise (e.g., appropriateness), no SMSR described the fit between reviewers' expertise and appraised studies. Quality appraisal usually resulted in studies being ranked by methodological quality.
Conclusion: A scoring system is proposed for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods studies for SMSRs. This scoring system may also be used to appraise the methodological quality of qualitative, quantitative and mixed methods components of mixed methods research.
Similar articles
- A hierarchy of evidence for assessing qualitative health research.
Daly J, Willis K, Small R, Green J, Welch N, Kealy M, Hughes E. Daly J, et al. J Clin Epidemiol. 2007 Jan;60(1):43-9. doi: 10.1016/j.jclinepi.2006.03.014. Epub 2006 Sep 28. J Clin Epidemiol. 2007. PMID: 17161753 Review. - An increasing number of qualitative research papers in oncology and palliative care: does it mean a thorough development of the methodology of research?
Borreani C, Miccinesi G, Brunelli C, Lina M. Borreani C, et al. Health Qual Life Outcomes. 2004 Jan 23;2:7. doi: 10.1186/1477-7525-2-7. Health Qual Life Outcomes. 2004. PMID: 14741052 Free PMC article. Review. - The effectiveness of self-assessment on the identification of learner needs, learner activity, and impact on clinical practice: BEME Guide no. 10.
Colthart I, Bagnall G, Evans A, Allbutt H, Haig A, Illing J, McKinstry B. Colthart I, et al. Med Teach. 2008;30(2):124-45. doi: 10.1080/01421590701881699. Med Teach. 2008. PMID: 18464136 Review. - How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research.
Devers KJ. Devers KJ. Health Serv Res. 1999 Dec;34(5 Pt 2):1153-88. Health Serv Res. 1999. PMID: 10591278 Free PMC article. Review.
Cited by
- Barriers and incentives influencing the use of partograph in Nigeria: A comprehensive review.
Elendu C, Davidson G, Wali JN, Sampson GU, Eneyo US, Ebosie PE, Opara PC, Davidson PN, Davidson DU, Davidson J. Elendu C, et al. Medicine (Baltimore). 2024 May 31;103(22):e38389. doi: 10.1097/MD.0000000000038389. Medicine (Baltimore). 2024. PMID: 39259070 Free PMC article. Review. - Perspectives of People Living with HIV on Access to Health Care: Protocol for a Scoping Review.
Asghari S, Maybank A, Hurley O, Modir H, Farrell A, Marshall Z, Kendall C, Johnston S, Hogel M, Rourke SB, Liddy C. Asghari S, et al. JMIR Res Protoc. 2016 May 18;5(2):e71. doi: 10.2196/resprot.5263. JMIR Res Protoc. 2016. PMID: 27193076 Free PMC article. - Barriers and facilitators to primary health care for people with intellectual disabilities and/or autism: an integrative review.
Doherty AJ, Atherton H, Boland P, Hastings R, Hives L, Hood K, James-Jenkinson L, Leavey R, Randell E, Reed J, Taggart L, Wilson N, Chauhan U. Doherty AJ, et al. BJGP Open. 2020 Aug 25;4(3):bjgpopen20X101030. doi: 10.3399/bjgpopen20X101030. Print 2020 Aug. BJGP Open. 2020. PMID: 32605913 Free PMC article. - Measuring the shadows: A systematic review of chronic emptiness in borderline personality disorder.
Miller CE, Townsend ML, Day NJS, Grenyer BFS. Miller CE, et al. PLoS One. 2020 Jul 1;15(7):e0233970. doi: 10.1371/journal.pone.0233970. eCollection 2020. PLoS One. 2020. PMID: 32609777 Free PMC article. - Barriers to access and utilization of emergency obstetric care at health facilities in sub-Saharan Africa: a systematic review of literature.
Geleto A, Chojenta C, Musa A, Loxton D. Geleto A, et al. Syst Rev. 2018 Nov 13;7(1):183. doi: 10.1186/s13643-018-0842-2. Syst Rev. 2018. PMID: 30424808 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources