학술논문

Pitfalls in Users' Evaluation of Algorithms for Text-Based Similarity Detection in Medical Education
Document Type
Conference
Source
2018 Federated Conference on Computer Science and Information Systems (FedCSIS) Computer Science and Information Systems (FedCSIS), 2018 Federated Conference on. :109-116 Sep, 2018
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Correlation
Education
Medical diagnostic imaging
Databases
Tools
Automobiles
Language
Abstract
This paper introduces a user evaluation of several approaches for an automated similarity detection between study materials and curriculum description in the field of medical and healthcare education. Our objective is to present an effective methodology of getting relevant feedback from medical students and teachers. Two various data sets (electronic study materials represented by interactive educational algorithms on the AKUTNE.CZ platform and the curriculum of the General Medicine study programme) are processed. For the purposes of this work, text similarity between two data sets is expressed lexically, i.e. character-based (n-gram) similarity as well as term-based similarity methods are used. We present the comparison of five selected approaches to similarity calculation as well as an objective discussion covering our experience with and pitfalls of user evaluation.