The psychometric and pragmatic evidence rating scale (PAPERS) for measure development and evaluation - PubMed (original) (raw)

The psychometric and pragmatic evidence rating scale (PAPERS) for measure development and evaluation

Cara C Lewis et al. Implement Res Pract. 2021.

Abstract

To rigorously measure the implementation of evidence-based interventions, implementation science requires measures that have evidence of reliability and validity across different contexts and populations. Measures that can detect change over time and impact on outcomes of interest are most useful to implementers. Moreover, measures that fit the practical needs of implementers could be used to guide implementation outside of the research context. To address this need, our team developed a rating scale for implementation science measures that considers their psychometric and pragmatic properties and the evidence available. The Psychometric and Pragmatic Evidence Rating Scale (PAPERS) can be used in systematic reviews of measures, in measure development, and to select measures. PAPERS may move the field toward measures that inform robust research evaluations and practical implementation efforts.

Keywords: Measures; implementation; pragmatic; psychometric; rating scale.

© The Author(s) 2021.

PubMed Disclaimer

Conflict of interest statement

The author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: The psychometric and pragmatic evidence rating scale (PAPERS) for measure development and evaluations. Funding for this study came from the National Institute of Mental Health, awarded to Dr. Cara C. Lewis as principal investigator (R01MH106510). Dr. Lewis is both an author of this manuscript and editor of the journal, Implementation Research and Practice. Due to this conflict, Dr. Lewis was not involved in the editorial or review process for this manuscript.

Similar articles

Cited by

References

    1. Aarons G. A., Ehrhart M. G., Farahnak L. R. (2014). The implementation leadership scale (ILS): Development of a brief measure of unit level implementation leadership. Implementation Science, 9(1), 45. 10.1186/1748-5908-9-45 - DOI - PMC - PubMed
    1. Aarons G. A., Green A. E., Trott E., Willging C. E., Torres E. M., Ehrhart M. G., Roesch S. C. (2016). The roles of system and organizational leadership in system-wide evidence-based intervention sustainment: A mixed-method study. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 991–1008. 10.1007/s10488-016-0751-4 - DOI - PMC - PubMed
    1. Allen P., Pilar M., Walsh-Bailey C., Hooley C., Mazzucca S., Lewis C. C., Mettert K. D., Dorsey C. N., Purtle J., Kepper M. M., Baumann A. A., Brownson R. C. (2020). Quantitative measures of health policy implementation determinants and outcomes: A systematic review. Implementation Science, 15(1), 47. 10.1186/s13012-020-01007-w - DOI - PMC - PubMed
    1. Farahnak L. R., Ehrhart M. G., Torres E. M., Aarons G. A. (2020). The influence of transformational leadership and leader attitudes on subordinate attitudes and implementation success. Journal of Leadership & Organizational Studies, 27(1), 98–111. 10.1177/1548051818824529 - DOI
    1. McLoughlin G. M., Allen P., Walsh-Bailey C., Brownson R. C. (2021). A systematic review of school health policy measurement tools: Implementation determinants and outcomes. Implementation Science Communications, 2(1), 67. 10.1186/s43058-021-00169-y. PMID: 34174969; PMCID: PMC8235584. - DOI - PMC - PubMed

LinkOut - more resources