The measurement of observer agreement for categorical data - PubMed (original) (raw)
- PMID: 843571
The measurement of observer agreement for categorical data
J R Landis et al. Biometrics. 1977 Mar.
Abstract
This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially involves the construction of functions of the observed proportions which are directed at the extent to which the observers agree among themselves and the construction of test statistics for hypotheses involving these functions. Tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interobserver agreement are developed as generalized kappa-type statistics. These procedures are illustrated with a clinical diagnosis example from the epidemiological literature.
Similar articles
- Graphical aids for visualizing and interpreting patterns in departures from agreement in ordinal categorical observer agreement data.
Bangdiwala SI. Bangdiwala SI. J Biopharm Stat. 2017;27(5):773-783. doi: 10.1080/10543406.2016.1273941. Epub 2017 Feb 13. J Biopharm Stat. 2017. PMID: 28010186 - A computer program for the generalized chi-square analysis of categorical data using weighted least squares (GENCAT).
Landis JR, Stanish WM, Freeman JL, Koch GG. Landis JR, et al. Comput Programs Biomed. 1976 Dec;6(4):196-231. doi: 10.1016/0010-468x(76)90037-4. Comput Programs Biomed. 1976. PMID: 1009762 - Interobserver and intraobserver reliability in the load sharing classification of the assessment of thoracolumbar burst fractures.
Dai LY, Jin WJ. Dai LY, et al. Spine (Phila Pa 1976). 2005 Feb 1;30(3):354-8. doi: 10.1097/01.brs.0000152095.85927.24. Spine (Phila Pa 1976). 2005. PMID: 15682019 - Statistical methods in epidemiology. v. Towards an understanding of the kappa coefficient.
Rigby AS. Rigby AS. Disabil Rehabil. 2000 May 20;22(8):339-44. doi: 10.1080/096382800296575. Disabil Rehabil. 2000. PMID: 10896093 Review. - Measures of interrater agreement.
Mandrekar JN. Mandrekar JN. J Thorac Oncol. 2011 Jan;6(1):6-7. doi: 10.1097/JTO.0b013e318200f983. J Thorac Oncol. 2011. PMID: 21178713 Review.
Cited by
- Unveiling a hidden burden: exploring sarcopenia in hospitalized older patients through concordance and cluster analysis.
Venegas-Sanabria LC, Borda MG, Murcia-Soriano LF, Ramos-Caballero DM, Tordecilla-Sanders A, Garcia-Laguna G, Vargas-Pinilla O. Venegas-Sanabria LC, et al. BMC Geriatr. 2024 Oct 30;24(1):892. doi: 10.1186/s12877-024-05322-5. BMC Geriatr. 2024. PMID: 39478482 Free PMC article. - Methods to optimize optical sensing of biotic plant stress - combined effects of hyperspectral imaging at night and spatial binning.
Nansen C, Savi PJ, Mantri A. Nansen C, et al. Plant Methods. 2024 Oct 28;20(1):163. doi: 10.1186/s13007-024-01292-2. Plant Methods. 2024. PMID: 39468668 Free PMC article. - The Challenge of Accounting for the Moderator Effect of Risk Exposure on the Effectiveness of Mindfulness-Based Treatments for Youth.
Arjona RN, Ungar M. Arjona RN, et al. Int J Appl Posit Psychol. 2024;9(3):1181-1203. doi: 10.1007/s41042-023-00145-y. Epub 2024 Jan 12. Int J Appl Posit Psychol. 2024. PMID: 39479303 Free PMC article. Review. - Proof of concept: Screening for REM sleep behaviour disorder with a minimal set of sensors.
Cooray N, Andreotti F, Lo C, Symmonds M, Hu MTM, De Vos M. Cooray N, et al. Clin Neurophysiol. 2021 Apr;132(4):904-913. doi: 10.1016/j.clinph.2021.01.009. Epub 2021 Feb 3. Clin Neurophysiol. 2021. PMID: 33636605 Free PMC article. - Smoking is bad for babies: obstetric care providers' use of best practice smoking cessation counseling techniques.
Chang JC, Alexander SC, Holland CL, Arnold RM, Landsittel D, Tulsky JA, Pollak KI. Chang JC, et al. Am J Health Promot. 2013 Jan-Feb;27(3):170-6. doi: 10.4278/ajhp.110624-QUAL-265. Am J Health Promot. 2013. PMID: 23286593 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Other Literature Sources