학술논문

Unveiling the Reliability of ChatGPT Answers in the Biomedical Realm: An Assessment in the
Document Type
Conference
Source
2023 16th International Conference on Developments in eSystems Engineering (DeSE) Developments in eSystems Engineering (DeSE), 2023 16th International Conference on. :228-233 Dec, 2023
Subject
Bioengineering
Computing and Processing
Engineering Profession
General Topics for Engineers
Power, Energy and Industry Applications
Robotics and Control Systems
Signal Processing and Analysis
Knowledge engineering
Generative AI
Epilepsy
Training data
Chatbots
Data models
Reliability
ChatGPT
Fine-Tuning
Natural Language Processing
AI
Language
Abstract
ChatGPT is an extensive language model under the umbrella of generative artificial intelligence that produces answers from data and images curated from online resources. Despite the capability to produce accurate responses, but requires verification; the responses are based on statistical patterns rather than true comprehension, i.e., it does not have consciousness and does not understand the questions from the perspective of human comprehension. The ability of ChatGPT to understand and react to questions in a humanistic way has garnered a lot of public and scientific interest over the past year. This study analyzes responses of ChatGPT to 100 questions on epilepsy in order to assess the validity of the tool in this field. Besides, this work sheds light on the advantages and disadvantages of the approach in this particular topic by analyzing responses of ChatGPT to queries on epilepsy. The study evaluates the model performance by looking at the completeness, correctness, and relevancy of responses. The findings in this paper indicate that ChatGPT has limits because of its training data and design structure, even though it could give insightful and appropriate answers to inquiries about epilepsy. It is concluded that ChatGPT can be an advantageous tool for medical professionals working on the subject of epilepsy. Nonetheless, it should be noted that ChatGPT should be utilized cautiously and in conjunction with various information sources, like clinical practice guidelines and peer-reviewed studies.