Conditional inequalities between Cohen's kappa and weighted kappas

Matthijs J. Warrens

doi:10.1016/j.stamet.2012.05.004

Conditional inequalities between Cohen's kappa and weighted kappas

Matthijs J. Warrens^*

^*Corresponding author for this work

Research output: Contribution to journal › Article › Academic › peer-review

36 Citations (Scopus)

Abstract

Cohen's kappa and weighted kappa are two standard tools for describing the degree of agreement between two observers on a categorical scale. For agreement tables with three or more categories, popular weights for weighted kappa are the so-called linear and quadratic weights. It has been frequently observed in the literature that, when Cohen's kappa and the two weighted kappas are applied to the same agreement table, the value of the quadratically weighted kappa is higher than the value of the linearly weighted kappa, which in turn is higher than the value of Cohen's kappa. This paper considers a sufficient condition for this double inequality. (C) 2012 Elsevier B.V. All rights reserved.

Original language	English
Pages (from-to)	14-22
Number of pages	9
Journal	Statistical Methodology
Volume	10
Issue number	1
DOIs	https://doi.org/10.1016/j.stamet.2012.05.004
Publication status	Published - Jan-2013
Externally published	Yes

Keywords

Cohen's kappa
Cohen's weighted kappa
Linear weights
Quadratic weights
Nominal agreement
Ordinal agreement
TRIDIAGONAL AGREEMENT TABLES
NOMINAL SCALE AGREEMENT
INTERRATER RELIABILITY
OBSERVER AGREEMENT
COEFFICIENT
EQUIVALENCE
STATISTICS
DIAGNOSIS
AVERAGE

Access to Document

10.1016/j.stamet.2012.05.004

Handle.net

Persistent link

Cite this

@article{a2a3aca8ab9b4b7882b6816dc291e38d,

title = "Conditional inequalities between Cohen's kappa and weighted kappas",

abstract = "Cohen's kappa and weighted kappa are two standard tools for describing the degree of agreement between two observers on a categorical scale. For agreement tables with three or more categories, popular weights for weighted kappa are the so-called linear and quadratic weights. It has been frequently observed in the literature that, when Cohen's kappa and the two weighted kappas are applied to the same agreement table, the value of the quadratically weighted kappa is higher than the value of the linearly weighted kappa, which in turn is higher than the value of Cohen's kappa. This paper considers a sufficient condition for this double inequality. (C) 2012 Elsevier B.V. All rights reserved.",

keywords = "Cohen's kappa, Cohen's weighted kappa, Linear weights, Quadratic weights, Nominal agreement, Ordinal agreement, TRIDIAGONAL AGREEMENT TABLES, NOMINAL SCALE AGREEMENT, INTERRATER RELIABILITY, OBSERVER AGREEMENT, COEFFICIENT, EQUIVALENCE, STATISTICS, DIAGNOSIS, AVERAGE",

author = "Warrens, {Matthijs J.}",

year = "2013",

month = jan,

doi = "10.1016/j.stamet.2012.05.004",

language = "English",

volume = "10",

pages = "14--22",

journal = "Statistical Methodology",

issn = "1572-3127",

publisher = "ELSEVIER SCIENCE BV",

number = "1",

}

TY - JOUR

T1 - Conditional inequalities between Cohen's kappa and weighted kappas

AU - Warrens, Matthijs J.

PY - 2013/1

Y1 - 2013/1

N2 - Cohen's kappa and weighted kappa are two standard tools for describing the degree of agreement between two observers on a categorical scale. For agreement tables with three or more categories, popular weights for weighted kappa are the so-called linear and quadratic weights. It has been frequently observed in the literature that, when Cohen's kappa and the two weighted kappas are applied to the same agreement table, the value of the quadratically weighted kappa is higher than the value of the linearly weighted kappa, which in turn is higher than the value of Cohen's kappa. This paper considers a sufficient condition for this double inequality. (C) 2012 Elsevier B.V. All rights reserved.

AB - Cohen's kappa and weighted kappa are two standard tools for describing the degree of agreement between two observers on a categorical scale. For agreement tables with three or more categories, popular weights for weighted kappa are the so-called linear and quadratic weights. It has been frequently observed in the literature that, when Cohen's kappa and the two weighted kappas are applied to the same agreement table, the value of the quadratically weighted kappa is higher than the value of the linearly weighted kappa, which in turn is higher than the value of Cohen's kappa. This paper considers a sufficient condition for this double inequality. (C) 2012 Elsevier B.V. All rights reserved.

KW - Cohen's kappa

KW - Cohen's weighted kappa

KW - Linear weights

KW - Quadratic weights

KW - Nominal agreement

KW - Ordinal agreement

KW - TRIDIAGONAL AGREEMENT TABLES

KW - NOMINAL SCALE AGREEMENT

KW - INTERRATER RELIABILITY

KW - OBSERVER AGREEMENT

KW - COEFFICIENT

KW - EQUIVALENCE

KW - STATISTICS

KW - DIAGNOSIS

KW - AVERAGE

U2 - 10.1016/j.stamet.2012.05.004

DO - 10.1016/j.stamet.2012.05.004

M3 - Article

SN - 1572-3127

VL - 10

SP - 14

EP - 22

JO - Statistical Methodology

JF - Statistical Methodology

IS - 1

ER -

Conditional inequalities between Cohen's kappa and weighted kappas

Abstract

Keywords

Access to Document

Handle.net

Fingerprint

Cite this