Constructing arguments for the interpretation and use of patient-reported outcome measures in research: an application of modern validity theory - PubMed (original) (raw)
. 2021 Jun;30(6):1715-1722.
doi: 10.1007/s11136-021-02776-7. Epub 2021 Feb 25.
Affiliations
- PMID: 33630235
- DOI: 10.1007/s11136-021-02776-7
Constructing arguments for the interpretation and use of patient-reported outcome measures in research: an application of modern validity theory
Kevin P Weinfurt. Qual Life Res. 2021 Jun.
Abstract
The past 100 years have witnessed an evolution of the meaning of validity and validation within the fields of education and psychology. Validity was once viewed as a property of tests and scales, but is now viewed as the extent to which theory and evidence support proposed interpretations and uses of test scores. Uncertainty about what types of validity evidence were needed motivated the current "argument-based" approach, as reflected in the 2014 Standards for Educational and Psychological Testing. According to this approach, investigators should delineate the assumptions required in order for a proposed interpretation or use to be plausible and then seek evidence that supports or refutes those assumptions. Though validation practices within the field of patient-reported outcome measurement have implicitly included many elements of the argument-based approach, the approach has yet to be explicitly adopted. To facilitate adoption, this article proposes an initial set of assumptions that might be included in most arguments for research-related interpretations and uses of scores from patient-reported outcome measures. The article also includes brief descriptions of the types of evidence that would be best suited for evaluating each assumption. It is hoped that these generic assumptions will stimulate further discussion and debate among quality of life researchers regarding how best to adopt modern validity theory to patient-reported outcome measures.
Keywords: Argument-based approach to validity; Measurement; Patient-centered outcomes; Patient-reported outcomes; Psychometrics; Quality of life; Reliability; Validity; Validity theory.
Similar articles
- Application of validity theory and methodology to patient-reported outcome measures (PROMs): building an argument for validity.
Hawkins M, Elsworth GR, Osborne RH. Hawkins M, et al. Qual Life Res. 2018 Jul;27(7):1695-1710. doi: 10.1007/s11136-018-1815-6. Epub 2018 Feb 20. Qual Life Res. 2018. PMID: 29464456 Free PMC article. - A contemporary approach to validity arguments: a practical guide to Kane's framework.
Cook DA, Brydges R, Ginsburg S, Hatala R. Cook DA, et al. Med Educ. 2015 Jun;49(6):560-75. doi: 10.1111/medu.12678. Med Educ. 2015. PMID: 25989405 - Changing conceptions of measurement validity: an update on the new standards.
Goodwin LD. Goodwin LD. J Nurs Educ. 2002 Mar;41(3):100-6. doi: 10.3928/0148-4834-20020301-05. J Nurs Educ. 2002. PMID: 11939227 Review. - Fit for purpose and modern validity theory in clinical outcomes assessment.
Edwards MC, Slagle A, Rubright JD, Wirth RJ. Edwards MC, et al. Qual Life Res. 2018 Jul;27(7):1711-1720. doi: 10.1007/s11136-017-1644-z. Epub 2017 Jul 7. Qual Life Res. 2018. PMID: 28688085 Review.
Cited by
- Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024.
Elsman EBM, Mokkink LB, Terwee CB, Beaton D, Gagnier JJ, Tricco AC, Baba A, Butcher NJ, Smith M, Hofstetter C, Aiyegbusi OL, Berardi A, Farmer J, Haywood KL, Krause KR, Markham S, Mayo-Wilson E, Mehdipour A, Ricketts J, Szatmari P, Touma Z, Moher D, Offringa M. Elsman EBM, et al. Qual Life Res. 2024 Aug;33(8):2029-2046. doi: 10.1007/s11136-024-03634-y. Epub 2024 Jul 9. Qual Life Res. 2024. PMID: 38980635 Free PMC article. - Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024.
Elsman EBM, Mokkink LB, Terwee CB, Beaton D, Gagnier JJ, Tricco AC, Baba A, Butcher NJ, Smith M, Hofstetter C, Aiyegbusi OL, Berardi A, Farmer J, Haywood KL, Krause KR, Markham S, Mayo-Wilson E, Mehdipour A, Ricketts J, Szatmari P, Touma Z, Moher D, Offringa M. Elsman EBM, et al. Health Qual Life Outcomes. 2024 Jul 9;22(1):48. doi: 10.1186/s12955-024-02256-9. Health Qual Life Outcomes. 2024. PMID: 38978063 Free PMC article. - Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024.
Elsman EBM, Mokkink LB, Terwee CB, Beaton D, Gagnier JJ, Tricco AC, Baba A, Butcher NJ, Smith M, Hofstetter C, Aiyegbusi OL, Berardi A, Farmer J, Haywood KL, Krause KR, Markham S, Mayo-Wilson E, Mehdipour A, Ricketts J, Szatmari P, Touma Z, Moher D, Offringa M. Elsman EBM, et al. J Patient Rep Outcomes. 2024 Jul 9;8(1):64. doi: 10.1186/s41687-024-00727-7. J Patient Rep Outcomes. 2024. PMID: 38977535 Free PMC article. - Validation practice in health: where do we go from here?
Hawkins M. Hawkins M. Qual Life Res. 2024 Aug;33(8):2051-2052. doi: 10.1007/s11136-024-03732-x. Epub 2024 Jul 5. Qual Life Res. 2024. PMID: 38967867 Free PMC article. No abstract available. - Validation of Patient-Reported Outcomes in Patients With Nonmetastatic Breast Cancer Receiving Comprehensive Nodal Irradiation in the RadComp Trial.
Hahn EA, Pugh SL, Lu HL, Vela AM, Gillespie EF, Nichols EM, Wright JL, MacDonald SM, Cahlon O, Baas C, Braunstein LZ, Fang LC, Freedman GM, Jimenez RB, Kesslering CM, Mishra MV, Mutter RW, Ohri N, Rosen LR, Urbanic JJ, Jagsi R, Mitchell SA, Bekelman JE, Cella D; Study Group Investigators:. Hahn EA, et al. Int J Radiat Oncol Biol Phys. 2024 Sep 1;120(1):149-161. doi: 10.1016/j.ijrobp.2024.03.020. Epub 2024 May 13. Int J Radiat Oncol Biol Phys. 2024. PMID: 38739047 Free PMC article. Clinical Trial.
References
- Zumbo, B. C. E. (2014). Validity and validation in social, behavioral, and health sciences social indicators research series. Cham: Springer.
- Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000 . - DOI
- Edwards, M. C., Slagle, A., Rubright, J. D., & Wirth, R. J. (2017). Fit for purpose and modern validity theory in clinical outcomes assessment. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 14(2), 1–10. https://doi.org/10.1007/s11136-017-1644-z . - DOI
- Association, A. E. R., Association, A. P., & Education, N. C. o. M. i. Standards for educational and psychological testing (American Educational Research Association): American Educational Research Association.
- Kane, M. T. (2013). Validation as a pragmatic, scientific activity. Journal of Educational Measurement, 50(1), 115–122. https://doi.org/10.1111/jedm.12007 . - DOI
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous