학술논문
Hallucination Benchmark in Medical Visual Question Answering
Document Type
Working Paper
Author
Source
Subject
Language
Abstract
The recent success of large language and vision models (LLVMs) on vision question answering (VQA), particularly their applications in medicine (Med-VQA), has shown a great potential of realizing effective visual assistants for healthcare. However, these models are not extensively tested on the hallucination phenomenon in clinical settings. Here, we created a hallucination benchmark of medical images paired with question-answer sets and conducted a comprehensive evaluation of the state-of-the-art models. The study provides an in-depth analysis of current models' limitations and reveals the effectiveness of various prompting strategies.
Comment: Accepted to ICLR 2024 Tiny Papers(Notable)
Comment: Accepted to ICLR 2024 Tiny Papers(Notable)