학술논문

MoTIF: a Method for Trustworthy Dynamic Multimodal Learning on Omics
Document Type
Conference
Source
2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) Bioinformatics and Biomedicine (BIBM), 2023 IEEE International Conference on. :2851-2858 Dec, 2023
Subject
Bioengineering
Computing and Processing
Engineering Profession
Robotics and Control Systems
Signal Processing and Analysis
Measurement
Learning systems
Uncertainty
Codes
Precision medicine
Feature extraction
Multisensory integration
Multimodal Integration
Dynamic Learning
Trustworthy AI
Multi-omics Learning
Language
ISSN
2156-1133
Abstract
Omics data are inherently multimodal. The existing multimodal learning methods mainly focus on exploiting complementary information across multiple modalities and integrating them via unified representations. However, few studies have focused on the interpretability of features and modalities and the reliability of results, which are crucial in specific domains such as precision medicine and the life sciences. We propose a Multi-omics Trustworthy Integration Framework (MoTIF) to improve the reliability of multimodal learning models by adding dynamic feature selection and modality selection modules and introducing uncertainty score metrics in the classification process to indicate the reliability of model results, which adhere to our Trustworthy Multimodal Integration (TMI) rule. We conduct exhaustive experiments on five multi-omics datasets derived from TCGA. Results demonstrate that MoTIF can improve the performance of multi-omics classification tasks and provide a more detailed explanation of the model’s internal mechanism and the trustworthiness of the classification results. Code for MoTIF is available at https://github.com/YuxingLu613/MoTIF.