The measurement of observer agreement for categorical data - PubMed (original) (raw)

• PMID: 843571

The measurement of observer agreement for categorical data

J R Landis et al. Biometrics. 1977 Mar.

Abstract

This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially involves the construction of functions of the observed proportions which are directed at the extent to which the observers agree among themselves and the construction of test statistics for hypotheses involving these functions. Tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interobserver agreement are developed as generalized kappa-type statistics. These procedures are illustrated with a clinical diagnosis example from the epidemiological literature.

PubMed Disclaimer

Similar articles

• Graphical aids for visualizing and interpreting patterns in departures from agreement in ordinal categorical observer agreement data.
  Bangdiwala SI. Bangdiwala SI. J Biopharm Stat. 2017;27(5):773-783. doi: 10.1080/10543406.2016.1273941. Epub 2017 Feb 13. J Biopharm Stat. 2017. PMID: 28010186
• A computer program for the generalized chi-square analysis of categorical data using weighted least squares (GENCAT).
  Landis JR, Stanish WM, Freeman JL, Koch GG. Landis JR, et al. Comput Programs Biomed. 1976 Dec;6(4):196-231. doi: 10.1016/0010-468x(76)90037-4. Comput Programs Biomed. 1976. PMID: 1009762
• Interobserver and intraobserver reliability in the load sharing classification of the assessment of thoracolumbar burst fractures.
  Dai LY, Jin WJ. Dai LY, et al. Spine (Phila Pa 1976). 2005 Feb 1;30(3):354-8. doi: 10.1097/01.brs.0000152095.85927.24. Spine (Phila Pa 1976). 2005. PMID: 15682019
• Statistical methods in epidemiology. v. Towards an understanding of the kappa coefficient.
  Rigby AS. Rigby AS. Disabil Rehabil. 2000 May 20;22(8):339-44. doi: 10.1080/096382800296575. Disabil Rehabil. 2000. PMID: 10896093 Review.
• Measures of interrater agreement.
  Mandrekar JN. Mandrekar JN. J Thorac Oncol. 2011 Jan;6(1):6-7. doi: 10.1097/JTO.0b013e318200f983. J Thorac Oncol. 2011. PMID: 21178713 Review.

Cited by

• Diagnostic performance of adult-based thyroid imaging reporting and data systems in pediatric thyroid carcinoma: a retrospective study.
  Li W, Du Y, Wei Y, Feng R, Wang Y, Yang X, Wang H, Li J. Li W, et al. BMC Med Imaging. 2024 Nov 15;24(1):311. doi: 10.1186/s12880-024-01496-x. BMC Med Imaging. 2024. PMID: 39548449 Free PMC article.
• Content Validity of Teacher's Evaluation of Neurodevelopmental Delays (TEDD) Tool for Indian Preschoolers.
  Kolhe S, Prakash A, Pereira M. Kolhe S, et al. Ann Neurosci. 2024 Nov 12:09727531241289177. doi: 10.1177/09727531241289177. Online ahead of print. Ann Neurosci. 2024. PMID: 39544666 Free PMC article.
• An in-depth analysis of antimicrobial prescription quality in 10 non-university hospitals, in southwest Germany, 2021.
  Först G, Giesen R, Fink G, Sehlbrede M, Wimmesberger N, Allen R, Meyer K, Müller S, Niese H, Polk S, Reistle B, Schuhmacher C, von Ameln-Meyerhofer A, Winter K, Wirth D, Kern WV, Farin-Glattacker E, Rieg S; ID ROLL OUT Study group; Other members of the ID ROLLOUT study group. Först G, et al. Euro Surveill. 2024 Nov;29(46):2400156. doi: 10.2807/1560-7917.ES.2024.29.46.2400156. Euro Surveill. 2024. PMID: 39544144 Free PMC article.
• Concordance between preoperative ultrasound arterial mapping in the femoropopliteal and distal sector and intraoperative angiography.
  Barrado PCM, Méndez MM, Palenzona AER, Oviedo FMF, Barrera JR, Requena MG. Barrado PCM, et al. J Ultrasound. 2024 Nov 15. doi: 10.1007/s40477-024-00967-9. Online ahead of print. J Ultrasound. 2024. PMID: 39543077
• Exam quality of ultrasound and dynamic contrast-enhanced abbreviated MRI and impact on early-stage HCC detection.
  Seif El Dahan K, Yokoo T, Mendiratta-Lala M, Fetzer D, Davenport M, Daher D, Rich NE, Yang E, Parikh ND, Singal AG. Seif El Dahan K, et al. Abdom Radiol (NY). 2024 Nov 15. doi: 10.1007/s00261-024-04674-1. Online ahead of print. Abdom Radiol (NY). 2024. PMID: 39542949

Publication types

MeSH terms

LinkOut - more resources

• Other Literature Sources

  • The Lens - Patent Citations Database