학술논문

From Novice to Expert: Analysis of Token Level Effects in a Longitudinal Eye Tracking Study
Document Type
Conference
Source
2021 IEEE/ACM 29th International Conference on Program Comprehension (ICPC) ICPC Program Comprehension (ICPC), 2021 IEEE/ACM 29th International Conference on. :172-183 May, 2021
Subject
Computing and Processing
Java
Tracking
Gaze tracking
Machine learning
Programming
Software
eye tracking
source code
natural text
expertise
empirical study
token effects
Language
ISSN
2643-7171
Abstract
Program comprehension is a vital skill in software development. This work investigates program comprehension by examining the eye movement of novice programmers as they gain programming experience over the duration of a Java course. Their eye movement behavior is compared to the eye movement of expert programmers. Eye movement studies of natural text show that word frequency and length influence eye movement duration and act as indicators of reading skill. The study uses an existing longitudinal eye tracking dataset with 20 novice and experienced readers of source code. The work investigates the acquisition of the effects of token frequency and token length in source code reading as an indication of program reading skill. The results show evidence of the frequency and length effects in reading source code and the acquisition of these effects by novices. These results are then leveraged in a machine learning model demonstrating how eye movement can be used to estimate programming proficiency and classify novices from experts with 72% accuracy.