Journal of Educational Measurement
Publisher: Wiley · ISSN 00220655 · 12 articles
- Philosophy, History, Theory, and Applications of Measurement: Introduction to the JEM Special Issue
-
Diagnosing Block‐Position Effects on the Item Difficulty Scale: A Stage‐Specific Localized Difficulty‐Shift Model
Abstract Block‐position effects in large‐scale assessments are often modeled as common difficulty shifts, although variation may differ across administration stages and across examinee‐item ability‐difficulty relationships. This study...
- Issue Information
-
Predicting and Evaluating Item Responses Using Machine Learning, Text‐Embeddings, and LLMs
Abstract This study evaluates the extent to which synthetic response generation methods reproduce the psychometric properties of Likert‐type social‐emotional assessment data. We compare four approaches: machine learning (ML),...
-
Structure‐Regularized Composite Scoring for Calibrated MIRT Item Banks
Abstract Structure‐Regularized Composite Scoring (SRCS) was developed as a person‐scoring extension for calibrated multidimensional item response theory (MIRT) item banks. Given a Q‐matrix, reference distribution, and operational...
-
Increasing the Efficiency of Comparative Judgment for Writing Assessment: Warm‐Starting Estimation and Selection Using NLP
Abstract Comparative judgment (CJ) is an assessment method in which assessors compare pairs of essays and judge which is of higher quality. While CJ produces valid and reliable results, it often requires many judgments before quality...
-
Variable‐Length Calibration Stopping Rules for Multidimensional Computerized Adaptive Testing
Abstract Multidimensional computerized adaptive testing (MCAT) has gained increasing attention, as has online calibration for MCAT. As an essential component of online calibration, the calibration stopping rule determines the conditions...
-
Conditional Standard Errors, Posterior Standard Deviations, and Conditional Standard Errors of Prediction in IRT Scoring
Abstract Operational testing programs often rely on different uncertainty summaries to answer different inferential questions. This article distinguishes three such quantities in item response theory (IRT) scoring: the conditional...
-
Population Difficulty and Discrimination in Item Response Theory: A Complement to Traditional Item Parameters
Abstract Traditional Item Response Theory (IRT) parameters for item difficulty and discrimination often depend heavily on the specific assumptions and constraints of the chosen model. This study introduces and evaluates population...
-
Automated Scoring of Long‐Context Essays Using Linear‐Complexity Language Models
Abstract Automated essay scoring (AES) increasingly uses pretrained language models, but many operational systems still impose fixed input limits that truncate essays and may weaken score validity. We study how truncation and model...
-
Residual‐Based DIF Detection as a Model‐Agnostic Framework: A Comparison of Parametric, Semi‐Parametric, and Nonparametric Methods
Abstract Residual‐based methods provide a computationally efficient way to screen items for differential item functioning (DIF) using residuals from a fitted measurement model. Within this broader family, the residual‐based differential...
-
Pruned Exact Linear Time Method for Multiple Change‐Point Detection in Aberrant Responses
Abstract In educational measurement, examinees' response patterns often undergo abrupt transitions due to factors such as cheating, random guessing, or test fatigue. These transition points are defined as change points. Accurate...