학술논문

Psychometric validation of the Laval developmental benchmarks scale for family medicine
Document Type
article
Source
BMC Medical Education, Vol 21, Iss 1, Pp 1-11 (2021)
Subject
Criterion-referenced assessment
Validation
Family medicine
Special aspects of education
LC8-6691
Medicine
Language
English
ISSN
1472-6920
Abstract
Abstract Background With the implementation of competency-based education in family medicine, there is a need for summative end-of-rotation assessments that are criterion-referenced rather than normative. Laval University’s family residency program therefore developed the Laval Developmental Benchmarks Scale for Family Medicine (DBS-FM), based on competency milestones. This psychometric validation study investigates its internal structure and its relation to another variable, two sources of validity evidence. Methods We used assessment data from a cohort of residents (n = 1432 assessments) and the Rasch Rating Scale Model to investigate its reliability, dimensionality, rating scale functioning, targeting of items to residents’ competency levels, biases (differential item functioning), items hierarchy (adequacy of milestones ordering), and score responsiveness. Convergent validity was estimated by its correlation with the clinical rotation decision (pass, in difficulty/fail). Results The DBS-FM can be considered as a unidimensional scale with good reliability for non-extreme scores (.83). The correlation between expected and empirical items hierarchies was of .78, p