학술논문
A Multicenter Longitudinal MRI Study Assessing LeMan-PV Software Accuracy in the Detection of White Matter Lesions in Multiple Sclerosis Patients.
Document Type
Academic Journal
Author
Todea AR; Department of Neuroradiology, Clinic of Radiology and Nuclear Medicine, University Hospital of Basel, Basel, Switzerland.; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Melie-Garcia L; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Barakovic M; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Cagol A; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Rahmanzadeh R; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Galbusera R; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Lu PJ; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Weigel M; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Division of Radiological Physics, Department of Radiology, University Hospital Basel and University of Basel, Basel, Switzerland.; Ruberte E; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Radue EW; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Schaedelin S; Clinical Trial Unit, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.; Benkert P; Clinical Trial Unit, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland.; Oezguer Y; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Sinnecker T; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Medical Image Analysis Center (MIAC) and qbig, Department of Biomedical Engineering, University Basel, Basel, Switzerland.; Müller S; Department of Neurology, Cantonal Hospital St. Gallen, St. Gallen, Switzerland.; Achtnichts L; Department of Neurology, Cantonal Hospital Aarau, Switzerland.; Vehoff J; Department of Neurology, Cantonal Hospital St. Gallen, St. Gallen, Switzerland.; Disanto G; Department of Neurology, Neurocenter of Southern Switzerland, EOC, Lugano, Switzerland.; Findling O; Department of Neurology, Cantonal Hospital Aarau, Switzerland.; Chan A; Department of Neurology, Inselspital, Bern University Hospital and University of Bern, Bern, Switzerland.; Salmen A; Department of Neurology, Inselspital, Bern University Hospital and University of Bern, Bern, Switzerland.; Pot C; Service of Neurology, Department of Clinical Neurosciences, Lausanne University Hospital (CHUV) and University of Lausanne, Lausanne, Switzerland.; Lalive P; Department of Clinical Neurosciences, Geneva University Hospital and Faculty of Medicine, Geneva, Switzerland.; Bridel C; Department of Clinical Neurosciences, Geneva University Hospital and Faculty of Medicine, Geneva, Switzerland.; Zecca C; Department of Neurology, Neurocenter of Southern Switzerland, EOC, Lugano, Switzerland.; Faculty of Biomedical Sciences, University of Italian Switzerland, Lugano, Switzerland.; Derfuss T; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Remonda L; Department of Radiology, Cantonal Hospital Aarau, Switzerland.; Wagner F; Department of Diagnostic and Interventional Neuroradiology, Inselspital, Bern University Hospital and University of Bern, Bern, Switzerland.; Vargas M; Department of Radiology, Geneva University Hospital and Faculty of Medicine, Geneva, Switzerland.; Du Pasquier R; Service of Neurology, Department of Clinical Neurosciences, Lausanne University Hospital (CHUV) and University of Lausanne, Lausanne, Switzerland.; Pravata E; Faculty of Biomedical Sciences, University of Italian Switzerland, Lugano, Switzerland.; Department of Neuroradiology, Neurocenter of Southern Switzerland, Lugano, Switzerland.; Weber J; Department of Radiology, Cantonal Hospital St. Gallen, St. Gallen, Switzerland.; Gobbi C; Department of Neurology, Neurocenter of Southern Switzerland, EOC, Lugano, Switzerland.; Faculty of Biomedical Sciences, University of Italian Switzerland, Lugano, Switzerland.; Leppert D; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Wuerfel J; Medical Image Analysis Center (MIAC) and qbig, Department of Biomedical Engineering, University Basel, Basel, Switzerland.; Kober T; Advanced Clinical Imaging Technology, Siemens Healthineers International, Lausanne, Switzerland.; Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.; LTS5, École Polytechnique FÉdÉrale de Lausanne (EPFL), Lausanne, Switzerland.; Marechal B; Advanced Clinical Imaging Technology, Siemens Healthineers International, Lausanne, Switzerland.; Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.; LTS5, École Polytechnique FÉdÉrale de Lausanne (EPFL), Lausanne, Switzerland.; Corredor-Jerez R; Advanced Clinical Imaging Technology, Siemens Healthineers International, Lausanne, Switzerland.; Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.; LTS5, École Polytechnique FÉdÉrale de Lausanne (EPFL), Lausanne, Switzerland.; Psychogios M; Department of Neuroradiology, Clinic of Radiology and Nuclear Medicine, University Hospital of Basel, Basel, Switzerland.; Lieb J; Department of Neuroradiology, Clinic of Radiology and Nuclear Medicine, University Hospital of Basel, Basel, Switzerland.; Kappos L; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Cuadra MB; CIBM Center for Biomedical Imaging, Radiology Department, Lausanne University Hospital (CHUV) and University of Lausanne, Lausanne, Switzerland.; Kuhle J; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.; Granziera C; Translational Imaging in Neurology (ThINk) Basel, Department of Biomedical Engineering, Faculty of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland.; Department of Neurology, University Hospital Basel, Switzerland, MS Center and Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland.
Source
Publisher: Wiley-Liss Country of Publication: United States NLM ID: 9105850 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1522-2586 (Electronic) Linking ISSN: 10531807 NLM ISO Abbreviation: J Magn Reson Imaging Subsets: MEDLINE
Subject
Language
English
Abstract
Background: Detecting new and enlarged lesions in multiple sclerosis (MS) patients is needed to determine their disease activity. LeMan-PV is a software embedded in the scanner reconstruction system of one vendor, which automatically assesses new and enlarged white matter lesions (NELs) in the follow-up of MS patients; however, multicenter validation studies are lacking.
Purpose: To assess the accuracy of LeMan-PV for the longitudinal detection NEL white-matter MS lesions in a multicenter clinical setting.
Study Type: Retrospective, longitudinal.
Subjects: A total of 206 patients with a definitive MS diagnosis and at least two follow-up MRI studies from five centers participating in the Swiss Multiple Sclerosis Cohort study. Mean age at first follow-up = 45.2 years (range: 36.9-52.8 years); 70 males.
Field Strength/sequence: Fluid attenuated inversion recovery (FLAIR) and T1-weighted magnetization prepared rapid gradient echo (T1-MPRAGE) sequences at 1.5 T and 3 T.
Assessment: The study included 313 MRI pairs of datasets. Data were analyzed with LeMan-PV and compared with a manual "reference standard" provided by a neuroradiologist. A second rater (neurologist) performed the same analysis in a subset of MRI pairs to evaluate the rating-accuracy. The Sensitivity (Se), Specificity (Sp), Accuracy (Acc), F1-score, lesion-wise False-Positive-Rate (aFPR), and other measures were used to assess LeMan-PV performance for the detection of NEL at 1.5 T and 3 T. The performance was also evaluated in the subgroup of 123 MRI pairs at 3 T.
Statistical Tests: Intraclass correlation coefficient (ICC) and Cohen's kappa (CK) were used to evaluate the agreement between readers.
Results: The interreader agreement was high for detecting new lesions (ICC = 0.97, Pvalue < 10-20 , CK = 0.82, P value = 0) and good (ICC = 0.75, P value < 10 -12 , CK = 0.68, P value = 0) for detecting enlarged lesions. Across all centers, scanner field strengths (1.5 T, 3 T), and for NEL, LeMan-PV achieved: Acc = 61%, Se = 65%, Sp = 60%, F1-score = 0.44, aFPR = 1.31. When both follow-ups were acquired at 3 T, LeMan-PV accuracy was higher (Acc = 66%, Se = 66%, Sp = 66%, F1-score = 0.28, aFPR = 3.03).
Data Conclusion: In this multicenter study using clinical data settings acquired at 1.5 T and 3 T, and variations in MRI protocols, LeMan-PV showed similar sensitivity in detecting NEL with respect to other recent 3 T multicentric studies based on neural networks. While LeMan-PV performance is not optimal, its main advantage is that it provides automated clinical decision support integrated into the radiological-routine flow.
Evidence Level: 4 TECHNICAL EFFICACY: Stage 2.
(© 2023 The Authors. Journal of Magnetic Resonance Imaging published by Wiley Periodicals LLC on behalf of International Society for Magnetic Resonance in Medicine.)
Purpose: To assess the accuracy of LeMan-PV for the longitudinal detection NEL white-matter MS lesions in a multicenter clinical setting.
Study Type: Retrospective, longitudinal.
Subjects: A total of 206 patients with a definitive MS diagnosis and at least two follow-up MRI studies from five centers participating in the Swiss Multiple Sclerosis Cohort study. Mean age at first follow-up = 45.2 years (range: 36.9-52.8 years); 70 males.
Field Strength/sequence: Fluid attenuated inversion recovery (FLAIR) and T1-weighted magnetization prepared rapid gradient echo (T1-MPRAGE) sequences at 1.5 T and 3 T.
Assessment: The study included 313 MRI pairs of datasets. Data were analyzed with LeMan-PV and compared with a manual "reference standard" provided by a neuroradiologist. A second rater (neurologist) performed the same analysis in a subset of MRI pairs to evaluate the rating-accuracy. The Sensitivity (Se), Specificity (Sp), Accuracy (Acc), F1-score, lesion-wise False-Positive-Rate (aFPR), and other measures were used to assess LeMan-PV performance for the detection of NEL at 1.5 T and 3 T. The performance was also evaluated in the subgroup of 123 MRI pairs at 3 T.
Statistical Tests: Intraclass correlation coefficient (ICC) and Cohen's kappa (CK) were used to evaluate the agreement between readers.
Results: The interreader agreement was high for detecting new lesions (ICC = 0.97, Pvalue < 10
Data Conclusion: In this multicenter study using clinical data settings acquired at 1.5 T and 3 T, and variations in MRI protocols, LeMan-PV showed similar sensitivity in detecting NEL with respect to other recent 3 T multicentric studies based on neural networks. While LeMan-PV performance is not optimal, its main advantage is that it provides automated clinical decision support integrated into the radiological-routine flow.
Evidence Level: 4 TECHNICAL EFFICACY: Stage 2.
(© 2023 The Authors. Journal of Magnetic Resonance Imaging published by Wiley Periodicals LLC on behalf of International Society for Magnetic Resonance in Medicine.)