학술논문

Performance evaluation of automated white matter hyperintensity segmentation algorithms in a multicenter cohort on cognitive impairment and dementia
Document Type
article
Author
Malo GaubertAndrea Dell’OrcoCatharina LangeAntoine Garnier-CrussardIsabella ZimmermannMartin DyrbaMarco DueringGabriel ZieglerOliver PetersLukas PreisJosef PrillerEike Jakob SpruthAnja SchneiderKlaus FliessbachJens WiltfangBjörn H. SchottFranziska MaierWenzel GlanzKatharina BuergerDaniel JanowitzRobert PerneczkyBoris-Stephan RauchmannStefan TeipelIngo KilimannChristoph LaskeMatthias H. MunkAnnika SpottkeNina RoyLaura DobischMichael EwersPeter DechentJohn Dylan HaynesKlaus SchefflerEmrah DüzelFrank JessenMiranka Wirthfor the DELCODE study groupAmthauer HolgerCetindag Arda CanCosma Nicoleta CarmenDiesing DominikEhrlich MarieFenski FrederikeFreiesleben Silka DawnFuentes ManuelHauser DietmarHujer NicoleIncesoy Enise IremKainz ChristianLange CatharinaLindner KatjaMegges HerlindPeters OliverPreis LukasAltenstein SlawekLohse AndreaFranke ChristianaPriller JosefSpruth EikeVillar Munoz IreneBarkhoff MiriamBoecker HenningBrosseron FredericDaamen MarcelEngels TanjaFaber JenniferFließbach KlausFrommann IngoGrobe-Einsler MarcusHennes GuidoHerrmann GabiJost LorraineKalbhen PascalKimmich OkkaKobeleva XeniaKofler BarbaraMcCormick CorneliaMiebach LisaMiklitz CarolinMüller AnnaOender DemetPolcher AlexandraPurrer VeronikaRöske SandraSchneider ChristineSchneider AnjaSpottke AnnikaVogt InaWagner Michaelwolfsgruber SteffenYilmaz SagikBartels ClaudiaDechent PeterHansen NielsHassoun LinaHirschel SinaNuhn SabinePfahlert IlonaRausch LenaSchott BjörnTimäus CharlesWerner ChristineWiltfang JensZabel LiobaZech HeikeBader AbdelmajidBaldermann Juan CarlosDölle BrittaDrzezga AlexanderEscher ClausGhiasi Nasim RoshanHardenacke KatjaJessen FrankLützerath HannahMaier FranziskaMarquardt BenjaminMartikke AnjaMeiberth DixPetzler SnjezanaRostamzadeh AydaSannemann LenaSchild Ann-KatrinSorgalla SusanneStockter SimoneThelen ManuelaTscheuschler MaikeUhle FranziskaZeyen PhilipBittner DanielCardenas-Blanco ArturoDobisch LauraDüzel EmrahGrieger-Klose DoreenHartmann DeikeMetzger CoralineNestor PeterRuß ChristinSchulze FranziskaSpeck OliverYakupov RenatZiegler GabrielBrauneis ChristineBürger KatharinaCatak CihanColoma Andrews LisaDichgans MartinDörr AngelikaErtl-Wagner BirgitFrimmer DanielaHuber BrigitteJanowitz DanielKreuzer MaxMarkov EvaMüller ClaudiaRominger AxelSchmid (ehemals Spreider) JenniferSeegerer AnnaStephan JuliaZollver AdelgundeBurow Lenade Jonge SylviaFalkai PeterGarcia Angarita NatalieGörlitz ThomasGürsel Selim ÜstünHorvath IldikoKurz CarolinMeisenzahl-Lechner EvaPerneczky RobertUtecht JuliaDyrba MartinJanecek-Meyer HeikeKilimann IngoLappe ChrisLau EstherPfaff HenrikeRaum HeikeSabik PetrSchmidt MonikaSchulz HeikeSchwarzenboeck SarahTeipel StefanWeber Marc-AndreBuchmann MartinaHeger TanjaHinderer PetraKuder-Buletta ElkeLaske ChristophMunk MatthiasMychajliw ChristianSoekadar Surjosulzer PatriciaTrunk Theresia
Source
Frontiers in Psychiatry, Vol 13 (2023)
Subject
white matter hyperintensities segmentation
evaluation
FLAIR
deep learning
aging
Alzheimer’s disease
Psychiatry
RC435-571
Language
English
ISSN
1664-0640
Abstract
BackgroundWhite matter hyperintensities (WMH), a biomarker of small vessel disease, are often found in Alzheimer’s disease (AD) and their advanced detection and quantification can be beneficial for research and clinical applications. To investigate WMH in large-scale multicenter studies on cognitive impairment and AD, appropriate automated WMH segmentation algorithms are required. This study aimed to compare the performance of segmentation tools and provide information on their application in multicenter research.MethodsWe used a pseudo-randomly selected dataset (n = 50) from the DZNE-multicenter observational Longitudinal Cognitive Impairment and Dementia Study (DELCODE) that included 3D fluid-attenuated inversion recovery (FLAIR) images from participants across the cognitive continuum. Performances of top-rated algorithms for automated WMH segmentation [Brain Intensity Abnormality Classification Algorithm (BIANCA), lesion segmentation toolbox (LST), lesion growth algorithm (LGA), LST lesion prediction algorithm (LPA), pgs, and sysu_media] were compared to manual reference segmentation (RS).ResultsAcross tools, segmentation performance was moderate for global WMH volume and number of detected lesions. After retraining on a DELCODE subset, the deep learning algorithm sysu_media showed the highest performances with an average Dice’s coefficient of 0.702 (±0.109 SD) for volume and a mean F1-score of 0.642 (±0.109 SD) for the number of lesions. The intra-class correlation was excellent for all algorithms (>0.9) but BIANCA (0.835). Performance improved with high WMH burden and varied across brain regions.ConclusionTo conclude, the deep learning algorithm, when retrained, performed well in the multicenter context. Nevertheless, the performance was close to traditional methods. We provide methodological recommendations for future studies using automated WMH segmentation to quantify and assess WMH along the continuum of cognitive impairment and AD dementia.