학술논문

Scientific figures interpreted by ChatGPT: strengths in plot recognition and limits in color perception
Document Type
article
Source
npj Precision Oncology, Vol 8, Iss 1, Pp 1-8 (2024)
Subject
Neoplasms. Tumors. Oncology. Including cancer and carcinogens
RC254-282
Language
English
ISSN
2397-768X
Abstract
Abstract Emerging studies underscore the promising capabilities of large language model-based chatbots in conducting basic bioinformatics data analyses. The recent feature of accepting image inputs by ChatGPT, also known as GPT-4V(ision), motivated us to explore its efficacy in deciphering bioinformatics scientific figures. Our evaluation with examples in cancer research, including sequencing data analysis, multimodal network-based drug repositioning, and tumor clonal evolution, revealed that ChatGPT can proficiently explain different plot types and apply biological knowledge to enrich interpretations. However, it struggled to provide accurate interpretations when color perception and quantitative analysis of visual elements were involved. Furthermore, while the chatbot can draft figure legends and summarize findings from the figures, stringent proofreading is imperative to ensure the accuracy and reliability of the content.