학술논문

Detecting Preknowledge Cheating via Innovative Measures: A Mixture Hierarchical Model for Jointly Modeling Item Responses, Response Times, and Visual Fixation Counts.
Document Type
Article
Source
Educational & Psychological Measurement. Oct2023, Vol. 83 Issue 5, p1059-1080. 22p.
Subject
*STATISTICS
*STUDENT cheating
*TIME
*TEST-taking skills
*MEDICAL technology
*EYE movement measurements
*PATIENT monitoring
*DIFFERENTIAL item functioning (Research bias)
*STATISTICAL models
*DATA analysis
*DIFFUSION of innovations
*VIDEO recording
RESEARCH evaluation
Language
ISSN
0013-1644
Abstract
Preknowledge cheating jeopardizes the validity of inferences based on test results. Many methods have been developed to detect preknowledge cheating by jointly analyzing item responses and response times. Gaze fixations, an essential eye-tracker measure, can be utilized to help detect aberrant testing behavior with improved accuracy beyond using product and process data types in isolation. As such, this study proposes a mixture hierarchical model that integrates item responses, response times, and visual fixation counts collected from an eye-tracker (a) to detect aberrant test takers who have different levels of preknowledge and (b) to account for nuances in behavioral patterns between normally-behaved and aberrant examinees. A Bayesian approach to estimating model parameters is carried out via an MCMC algorithm. Finally, the proposed model is applied to experimental data to illustrate how the model can be used to identify test takers having preknowledge on the test items. [ABSTRACT FROM AUTHOR]