On the Practical Consequences of Misfit in Mokken Scaling

Daniela Ramona Crişan*, Jorge N. Tendeiro, Rob R. Meijer

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

1 Citation (Scopus)
41 Downloads (Pure)

Abstract

Mokken scale analysis is a popular method to evaluate the psychometric quality of clinical and personality questionnaires and their individual items. Although many empirical papers report on the extent to which sets of items form Mokken scales, there is less attention for the effect of violations of commonly used rules of thumb. In this study, the authors investigated the practical consequences of retaining or removing items with psychometric properties that do not comply with these rules of thumb. Using simulated data, they concluded that items with low scalability had some influence on the reliability of test scores, person ordering and selection, and criterion-related validity estimates. Removing the misfitting items from the scale had, in general, a small effect on the outcomes. Although important outcome variables were fairly robust against scale violations in some conditions, authors conclude that researchers should not rely exclusively on algorithms allowing automatic selection of items. In particular, content validity must be taken into account to build sensible psychometric instruments.

Original languageEnglish
Pages (from-to)482-496
Number of pages15
JournalApplied Psychological Measurement
Volume44
Issue number6
DOIs
Publication statusPublished - Sep-2020

Keywords

  • Mokken scale analysis
  • scale analysis
  • item response theory
  • test construction
  • content validity
  • ITEM RESPONSE THEORY
  • OF-LIFE INSTRUMENT
  • LATENT TRAIT
  • SUM SCORE
  • QUESTIONNAIRE
  • RELIABILITY
  • SCALABILITY
  • DEMENTIA
  • QUALIDEM

Cite this