학술논문

Multi-View Abnormality Detection in Clinical Knee MRI Studies Using Transformers
Document Type
Conference
Source
2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI) Biomedical Imaging (ISBI), 2023 IEEE 20th International Symposium on. :1-4 Apr, 2023
Subject
Bioengineering
Computing and Processing
Photonics and Electrooptics
Signal Processing and Analysis
Three-dimensional displays
Sensitivity
Magnetic resonance imaging
Biological system modeling
Neural networks
Transformers
Robustness
abnormality detection
transformers
multi-view models
Language
ISSN
1945-8452
Abstract
We propose a novel neural network architecture based on transformers that is capable of combining information from multiple three-dimensional Magnetic Resonance Imaging (MRI) scans taken in different views, i.e. sagittal, coronal and axial. We demonstrate its performance on a public dataset and show that it is on par with other state-of-the-art methods in terms of area under curve (0.93 ± 0.01), sensitivity (0.86 ± 0.02), specificity (0.89 ± 0.05) and accuracy (0.86 ± 0.01) in detecting abnormalities. We further show that robustness to missing data can be increased when applying multi-view dropout and outline the potential of such an architecture in the field of medical imaging.