Deep learning from multiple experts improves identification of amyloid neuropathologies
Posted on 2022-04-29 - 07:40
Abstract Pathologists can label pathologies differently, making it challenging to yield consistent assessments in the absence of one ground truth. To address this problem, we present a deep learning (DL) approach that draws on a cohort of experts, weighs each contribution, and is robust to noisy labels. We collected 100,495 annotations on 20,099 candidate amyloid beta neuropathologies (cerebral amyloid angiopathy (CAA), and cored and diffuse plaques) from three institutions, independently annotated by five experts. DL methods trained on a consensus-of-two strategy yielded 12.6–26% improvements by area under the precision recall curve (AUPRC) when compared to those that learned individualized annotations. This strategy surpassed individual-expert models, even when unfairly assessed on benchmarks favoring them. Moreover, ensembling over individual models was robust to hidden random annotators. In blind prospective tests of 52,555 subsequent expert-annotated images, the models labeled pathologies like their human counterparts (consensus model AUPRC = 0.74 cored; 0.69 CAA). This study demonstrates a means to combine multiple ground truths into a common-ground DL model that yields consistent diagnoses informed by multiple and potentially variable expert opinions.
CITE THIS COLLECTION
DataCite
3 Biotech
3D Printing in Medicine
3D Research
3D-Printed Materials and Systems
4OR
AAPG Bulletin
AAPS Open
AAPS PharmSciTech
Abhandlungen aus dem Mathematischen Seminar der Universität Hamburg
ABI Technik (German)
Academic Medicine
Academic Pediatrics
Academic Psychiatry
Academic Questions
Academy of Management Discoveries
Academy of Management Journal
Academy of Management Learning and Education
Academy of Management Perspectives
Academy of Management Proceedings
Academy of Management Review
Wong, Daniel R.; Tang, Ziqi; Mew, Nicholas C.; Das, Sakshi; Athey, Justin; McAleese, Kirsty E.; et al. (2022). Deep learning from multiple experts improves identification of amyloid neuropathologies. figshare. Collection. https://doi.org/10.6084/m9.figshare.c.5972048.v1
or
Select your citation style and then place your mouse over the citation text to select it.
SHARE
Usage metrics
Read the peer-reviewed publication
AUTHORS (13)
DW
Daniel R. Wong
ZT
Ziqi Tang
NM
Nicholas C. Mew
SD
Sakshi Das
JA
Justin Athey
KM
Kirsty E. McAleese
JK
Julia K. Kofler
MF
Margaret E. Flanagan
EB
Ewa Borys
CW
Charles L. White
AB
Atul J. Butte
BD
Brittany N. Dugger
MK
Michael J. Keiser