학술논문

Survey Response Rates in Health Sciences Education Research: A 10-Year Meta-Analysis
Document Type
Journal Articles
Reports - Evaluative
Author
Adam B. Wilson (ORCID 0000-0002-1221-5602); William S. Brooks (ORCID 0000-0002-4745-9295); Danielle N. Edwards (ORCID 0000-0001-5087-0029); Jill Deaver (ORCID 0000-0003-4766-0260); Jessica A. SurdObadiah J. PirloWilliam A. ByrdEdgar R. Meyer (ORCID 0000-0003-3748-7644); Amy Beresheim (ORCID 0000-0002-1672-1131); Stephanie L. CuskeyJack G. TsintolasEric S. NorrellHarriet C. FisherChristopher W. SkaggsDmytro MysakSamantha R. LevinCarlos E. Escutia RosasAndrew S. Cale (ORCID 0000-0001-7158-3977); Md Nazmul Karim (ORCID 0000-0003-2604-9649); Jenna PollockNicholas J. KakosMonica S. O'BrienRebecca S. Lufler (ORCID 0000-0002-6495-5071)
Source
Anatomical Sciences Education. 2024 17(1):11-23.
Subject
Online Surveys
Response Rates (Questionnaires)
Health Sciences
Educational Research
Educational Trends
Meta Analysis
Research Methodology
Likert Scales
Test Validity
Language
English
ISSN
1935-9772
1935-9780
Abstract
Growth in the online survey market may be increasing response burden and possibly jeopardizing higher response rates. This meta-analysis evaluated survey trends over one decade (2011-2020) to determine: (1) changes in survey publication rates over time, (2) changes in response rates over time, (3) typical response rates within health sciences education research, (4) the factors influencing survey completion levels, and (5) common gaps in survey methods and outcomes reporting. Study I estimated survey publication trends between 2011 and 2020 using articles published in the top three health sciences education research journals. Study II searched the anatomical sciences education literature across six databases and extracted study/survey features and survey response rates. Time plots and a proportional meta-analysis were performed. Per 2926 research articles, the annual estimated proportion of studies with survey methodologies has remained constant, with no linear trend (p > 0.050) over time (Study I). Study II reported a pooled absolute response rate of 67% (95% CI = 63.9-69.0) across 360 studies ("k"), totaling 115,526 distributed surveys. Despite response rate oscillations over time, no significant linear trend (p = 0.995) was detected. Neither survey length, incentives, sponsorship, nor population type affected absolute response rates (p [greater than or equal to] 0.070). Only 35% (120 of 339) of studies utilizing a Likert scale reported evidence of survey validity. Survey response rates and the prevalence of studies with survey methodologies have remained stable with no linear trends over time. We recommend researchers strive for a typical absolute response rate of 67% or higher and clearly document evidence of survey validity for empirical studies.