학술논문

Can Large Language Models Provide Feedback to Students? A Case Study on ChatGPT
Document Type
Conference
Source
2023 IEEE International Conference on Advanced Learning Technologies (ICALT) ICALT Advanced Learning Technologies (ICALT), 2023 IEEE International Conference on. :323-325 Jul, 2023
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Chatbots
Task analysis
Feedback Generation
Automated Feedback
Large Language Model
Feedback Effectiveness
Language
ISSN
2161-377X
Abstract
Educational feedback has been widely acknowledged as an effective approach to improving student learning. However, scaling effective practices can be laborious and costly, which motivated researchers to work on automated feedback systems (AFS). Inspired by the recent advancements in the pre-trained language models (e.g., ChatGPT), we posit that such models might advance the existing knowledge of textual feedback generation in AFS because of their capability to offer natural-sounding and detailed responses. Therefore, we aimed to investigate the feasibility of using ChatGPT to provide students with feedback to help them learn better. Our results show that i) ChatGPT is capable of generating more detailed feedback that fluently and coherently summarizes students' performance than human instructors; ii) ChatGPT achieved high agreement with the instructor when assessing the topic of students' assignments; and iii) ChatGPT could provide feedback on the process of students completing the task, which might benefit students developing learning skills.