학술논문

Evaluating Targeted Double Scoring for the Performance Assessment for School Leaders Using Imputation and Decision Theory. Research Report. ETS RR-23-01
Document Type
Journal Articles
Reports - Research
Source
ETS Research Report Series. Dec 2023.
Subject
Scoring
Performance Based Assessment
Licensing Examinations (Professions)
Certification
Scores
Decision Making
Regression (Statistics)
Language
English
ISSN
2330-8516
Abstract
In a targeted double-scoring procedure for performance assessments that are used for licensure and certification purposes, a subset of responses receives an independent second rating if the first rating falls into a preidentified critical score range (CSR) where an additional rating would lead to considerably more reliable pass-fail decisions. This study evaluates the CSRs using two approaches--one based on imputation of missing scores and the other based on statistical decision theory--using data from the Performance Assessment for School Leaders (PASL). Results from the evaluation indicate that the currently used CSRs are effective.