Constructing arguments for the interpretation and use of patient-reported outcome measures in research: an application of modern validity theory - PubMed (original) (raw)
. 2021 Jun;30(6):1715-1722.
doi: 10.1007/s11136-021-02776-7. Epub 2021 Feb 25.
Affiliations
- PMID: 33630235
- DOI: 10.1007/s11136-021-02776-7
Constructing arguments for the interpretation and use of patient-reported outcome measures in research: an application of modern validity theory
Kevin P Weinfurt. Qual Life Res. 2021 Jun.
Abstract
The past 100 years have witnessed an evolution of the meaning of validity and validation within the fields of education and psychology. Validity was once viewed as a property of tests and scales, but is now viewed as the extent to which theory and evidence support proposed interpretations and uses of test scores. Uncertainty about what types of validity evidence were needed motivated the current "argument-based" approach, as reflected in the 2014 Standards for Educational and Psychological Testing. According to this approach, investigators should delineate the assumptions required in order for a proposed interpretation or use to be plausible and then seek evidence that supports or refutes those assumptions. Though validation practices within the field of patient-reported outcome measurement have implicitly included many elements of the argument-based approach, the approach has yet to be explicitly adopted. To facilitate adoption, this article proposes an initial set of assumptions that might be included in most arguments for research-related interpretations and uses of scores from patient-reported outcome measures. The article also includes brief descriptions of the types of evidence that would be best suited for evaluating each assumption. It is hoped that these generic assumptions will stimulate further discussion and debate among quality of life researchers regarding how best to adopt modern validity theory to patient-reported outcome measures.
Keywords: Argument-based approach to validity; Measurement; Patient-centered outcomes; Patient-reported outcomes; Psychometrics; Quality of life; Reliability; Validity; Validity theory.
Similar articles
- Application of validity theory and methodology to patient-reported outcome measures (PROMs): building an argument for validity.
Hawkins M, Elsworth GR, Osborne RH. Hawkins M, et al. Qual Life Res. 2018 Jul;27(7):1695-1710. doi: 10.1007/s11136-018-1815-6. Epub 2018 Feb 20. Qual Life Res. 2018. PMID: 29464456 Free PMC article. - A contemporary approach to validity arguments: a practical guide to Kane's framework.
Cook DA, Brydges R, Ginsburg S, Hatala R. Cook DA, et al. Med Educ. 2015 Jun;49(6):560-75. doi: 10.1111/medu.12678. Med Educ. 2015. PMID: 25989405 - Changing conceptions of measurement validity: an update on the new standards.
Goodwin LD. Goodwin LD. J Nurs Educ. 2002 Mar;41(3):100-6. doi: 10.3928/0148-4834-20020301-05. J Nurs Educ. 2002. PMID: 11939227 Review. - The Female Sexual Function Index (FSFI)-A Systematic Review of Measurement Properties.
Neijenhuijs KI, Hooghiemstra N, Holtmaat K, Aaronson NK, Groenvold M, Holzner B, Terwee CB, Cuijpers P, Verdonck-de Leeuw IM. Neijenhuijs KI, et al. J Sex Med. 2019 May;16(5):640-660. doi: 10.1016/j.jsxm.2019.03.001. Epub 2019 Apr 5. J Sex Med. 2019. PMID: 30956110
Cited by
- Telehealth Made EASY: Understanding Provider Perceptions of Telehealth Appropriateness in Outpatient Rheumatology Encounters.
Smith ID, Coles TM, Howe C, Overton R, Economou-Zavlanos N, Solomon MJ, Zhao R, Adagarla B, Doss J, Henao R, Clowse MEB, Leverenz DL. Smith ID, et al. ACR Open Rheumatol. 2022 Oct;4(10):845-852. doi: 10.1002/acr2.11470. Epub 2022 Jul 19. ACR Open Rheumatol. 2022. PMID: 35855564 Free PMC article. - Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024.
Elsman EBM, Mokkink LB, Terwee CB, Beaton D, Gagnier JJ, Tricco AC, Baba A, Butcher NJ, Smith M, Hofstetter C, Aiyegbusi OL, Berardi A, Farmer J, Haywood KL, Krause KR, Markham S, Mayo-Wilson E, Mehdipour A, Ricketts J, Szatmari P, Touma Z, Moher D, Offringa M. Elsman EBM, et al. Qual Life Res. 2024 Aug;33(8):2029-2046. doi: 10.1007/s11136-024-03634-y. Epub 2024 Jul 9. Qual Life Res. 2024. PMID: 38980635 Free PMC article. - Development and content validity testing of a colonoscopy-specific patient-reported experience measure: the Patient Experience Colonoscopy Scale (PECS).
Rosvall A, Axelsson M, Toth E, Kumlien C, Gershater MA. Rosvall A, et al. J Patient Rep Outcomes. 2024 Mar 18;8(1):32. doi: 10.1186/s41687-024-00710-2. J Patient Rep Outcomes. 2024. PMID: 38498225 Free PMC article. - Validation of Patient-Reported Outcomes in Patients With Nonmetastatic Breast Cancer Receiving Comprehensive Nodal Irradiation in the RadComp Trial.
Hahn EA, Pugh SL, Lu HL, Vela AM, Gillespie EF, Nichols EM, Wright JL, MacDonald SM, Cahlon O, Baas C, Braunstein LZ, Fang LC, Freedman GM, Jimenez RB, Kesslering CM, Mishra MV, Mutter RW, Ohri N, Rosen LR, Urbanic JJ, Jagsi R, Mitchell SA, Bekelman JE, Cella D; Study Group Investigators:. Hahn EA, et al. Int J Radiat Oncol Biol Phys. 2024 Sep 1;120(1):149-161. doi: 10.1016/j.ijrobp.2024.03.020. Epub 2024 May 13. Int J Radiat Oncol Biol Phys. 2024. PMID: 38739047 Free PMC article. Clinical Trial. - Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024.
Elsman EBM, Mokkink LB, Terwee CB, Beaton D, Gagnier JJ, Tricco AC, Baba A, Butcher NJ, Smith M, Hofstetter C, Aiyegbusi OL, Berardi A, Farmer J, Haywood KL, Krause KR, Markham S, Mayo-Wilson E, Mehdipour A, Ricketts J, Szatmari P, Touma Z, Moher D, Offringa M. Elsman EBM, et al. Health Qual Life Outcomes. 2024 Jul 9;22(1):48. doi: 10.1186/s12955-024-02256-9. Health Qual Life Outcomes. 2024. PMID: 38978063 Free PMC article.
References
- Zumbo, B. C. E. (2014). Validity and validation in social, behavioral, and health sciences social indicators research series. Cham: Springer.
- Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000 . - DOI
- Edwards, M. C., Slagle, A., Rubright, J. D., & Wirth, R. J. (2017). Fit for purpose and modern validity theory in clinical outcomes assessment. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 14(2), 1–10. https://doi.org/10.1007/s11136-017-1644-z . - DOI
- Association, A. E. R., Association, A. P., & Education, N. C. o. M. i. Standards for educational and psychological testing (American Educational Research Association): American Educational Research Association.
- Kane, M. T. (2013). Validation as a pragmatic, scientific activity. Journal of Educational Measurement, 50(1), 115–122. https://doi.org/10.1111/jedm.12007 . - DOI
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous