Item Response Theory Based Continuous Test Norming

Research output: Contribution to journalArticleAcademicpeer-review

23 Downloads (Pure)

Abstract

In norm-referenced psychological testing, an individual's performance is expressed in relation to a reference population using a standardized score, like an IQ score. The reference population can depend on a continuous variable, like age. Current continuous norming methods transform the raw score into an age-dependent standardized score. Such methods have the shortcoming to solely rely on the raw test scores, ignoring valuable information from individual item responses. Instead of modeling the raw test scores, we propose modeling the item scores with a Bayesian two-parameter logistic Item Response Theory model with age-dependent mean and variance of the latent trait distribution, 2PL-norm for short. Norms are then derived using the estimated latent trait score and the age-dependent distribution parameters. Simulations show that 2PL-norms are overall more accurate than those from the most popular raw score-based norming methods cNORM and GAMLSS. Further, the credible intervals of 2PL-norm exhibit clearly superior coverage over the confidence intervals of the raw score-based methods. The only issue of 2PL-norm is its slightly lower performance at the tails of the norms. Among the raw score-based norming methods, GAMLSS outperforms cNORM. For empirical practice this suggests the use
of 2PL-norm, if the model assumptions hold. If not, or the interest is solely in the point estimates of the extreme trait positions, GAMLSS based norming is a better alternative. The use of the 2PL-norm is illustrated and compared with GAMLSS and cNORM using empirical data, and code is provided, so that users can readily apply 2PL-norm to their normative data.
Original languageEnglish
JournalPsychological Methods
Early online date2024
DOIs
Publication statusE-pub ahead of print - 2024

Keywords

  • psychological tests
  • norm-referenced tests
  • two-parameter IRT model

Fingerprint

Dive into the research topics of 'Item Response Theory Based Continuous Test Norming'. Together they form a unique fingerprint.

Cite this