학술논문
LLM-based Solutions for Healthcare Chatbots: a Comparative Analysis
Document Type
Conference
Author
Source
2024 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops) Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), 2024 IEEE International Conference on. :346-351 Mar, 2024
Subject
Language
ISSN
2766-8576
Abstract
This paper discusses the challenges of using Large Language Models (LLMs) in medical chatbots for chronic disease self-management. Accordingly, we define an architecture specifically devised to deal with issues related to reliability, clinical trials, and privacy. Two solutions are compared to prevent data disclosure: a filtering mechanism for sensitive data with an external LLM, and a locally deployed LLM using open-source models. Experimental results underscore the challenges in effectively instructing the local LLM so as to provide performances comparable to GPT-3.5.