학술논문

How Learning Analytics Can Help Orchestration of Formative Assessment? Data-Driven Recommendations for Technology- Enhanced Learning
Document Type
Periodical
Source
IEEE Transactions on Learning Technologies IEEE Trans. Learning Technol. Learning Technologies, IEEE Transactions on. 16(5):804-819 Oct, 2023
Subject
Computing and Processing
General Topics for Engineers
Education
Electronic mail
Behavioral sciences
Data mining
Task analysis
Project management
Physics
Decision making
formative assessment
learning analytics
peer assessment
peer instruction
technology-enhanced formative assessment (TEFA)
Language
ISSN
1939-1382
2372-0050
Abstract
Formative assessment provides teachers with feedback to help them adapt their behavior. To manage the increasing number of students in higher education, technology-enhanced formative assessment tools can be used to maintain and hopefully improve teaching and learning quality, thanks to the high amount of data that are generated by their usage. Based on literature and on authentic usages of the formative assessment system called Elaastic, we use learning analytics to provide evidence-based knowledge about formative assessment practices. An Elaastic sequence consists in asking learners to answer a choice question with a vote, a confidence degree, and a rationale, then to confront their viewpoints through a peer grading activity, and finally to answer the same question a second time. Benefits of such sequences are measured through the increase of correct answers between the two votes. Our results suggest that: 1) benefits of sequences increase when close to 50% of learners' first votes are correct; 2) benefits of sequences increase when peers provide better grades to rationales related to correct answers than others; 3) benefits of sequences do not significantly increase when learners who provided correct answers are more confident than learners who did not; 4) grades attributed by peers depend on such peer's confidence degree; 5) self-grading is inaccurate in a peer grading context; and 6) the number of evaluations each learner performs makes no significant difference in terms of sequence benefits. These results lead to recommendations regarding formative assessment and to a new data-informed formative assessment process, which is discussed at the end of this article.