Abstract
Suppose two judges each classify a group of objects into one of several nominal categories. It has been observed in the literature that, for fixed observed agreement between the judges, Cohen's kappa penalizes judges with similar marginals compared to judges who produce different marginals. This paper presents a formal proof of this phenomenon.
| Original language | English |
|---|---|
| Pages (from-to) | 322-332 |
| Number of pages | 11 |
| Journal | Journal of Classification |
| Volume | 27 |
| Issue number | 3 |
| DOIs | |
| Publication status | Published - Nov-2010 |
| Externally published | Yes |
Keywords
- Inter-rater reliability
- Marginal asymmetry
- Marginal homogeneity
- Nominal agreement
- Rearrangement inequality