Abstract
This article extends the work by Armstrong and Shi on CUmulative SUM (CUSUM) person-fit methodology. The authors present new theoretical considerations concerning the use of CUSUM person-fit statistics based on likelihood ratios for the purpose of detecting cheating and random guessing by individual test takers. According to the Neyman–Pearson Lemma, the optimality of such statistics relies on how accurately normal and aberrant behaviors are modeled. General and specific models for cheating and random guessing are investigated. The detection rates of several statistics are compared using simulated data. Results showed that the likelihood-based CUSUM statistics that use the proposed models for aberrant behavior performed better than some of the more commonly used statistics, especially for cheating behavior.
Original language | English |
---|---|
Pages (from-to) | 420-442 |
Number of pages | 23 |
Journal | Applied Psychological Measurement |
Volume | 36 |
Issue number | 5 |
DOIs | |
Publication status | Published - Jul-2012 |
Keywords
- item response theory model
- cheating
- random guessing
- aberrant behavior detection
- likelihood ratio
- cumulative sum
- APPROPRIATENESS MEASUREMENT
- ADAPTIVE TESTS
- FIT STATISTICS
- IDENTIFICATION