학술논문

Evaluating the Performance of ChatGPT on the Secondary School English Teacher Hiring Examination
Document Type
Article
Source
영어교과교육, 22(4), pp.73-95 Nov, 2023
Subject
영어와문학
Language
English
ISSN
2671-6178
1598-513X
Abstract
The purpose of the present study is to conduct a comprehensive evaluation and analysis of the performance of OpenAI’s ChatGPT, a language model based on GPT-4 architecture, on the Secondary School English Teacher Hiring Examination. For this purpose, the current study employed ChatGPT-4, the most recent model as its primary research instrument. A total of 23 questions from the 2023 hiring exam were fed into ChatGPT for response generation. The responses elicited from ChatGPT were then analyzed by a panel of five experts according to their respective fields of expertise. The results of the analyses highlighted both the potential and limitations of ChatGPT as a pedagogical tool. The results also identified the AI’s propensity to simplify complex or abstract human knowledge into narrower or more technical concepts. These observations underscore the limitations of current AI in fully emulating human comprehension and its capacity to interpret nuances in knowledge. Nonetheless, these findings also suggest a direction for future AI development and reinforce the idea of AI as a supplementary learning tool rather than a complete replacement of human teachers.