Evidence map›Paper›PMID 35484610›Full record

ArticleActa neuropathologica communications2022

Deep learning from multiple experts improves identification of amyloid neuropathologies.

Daniel R Wong, Ziqi Tang, Nicholas C Mew, Sakshi Das, Justin Athey, Kirsty E McAleese, Julia K Kofler, Margaret E Flanagan, Ewa Borys, Charles L White and 3 more

Abstract read
In one paragraph

Article in Acta neuropathologica communications, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

20 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Digital neuropathology of neurodegenerative disorders: Foundations, research advances, and future directions.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2025
    Review
  5. Article
  6. Comparison of multiple quantitative strategies for neuropathologic image analyses.Journal of neuropathology and experimental neurology · 2025
    Article
  7. Article
  8. Article
  9. Deep learning with noisy labels in medical prediction problems: a scoping review.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Daniel R WongBakar Computational Health Sciences Institute, University of California, San Francisco, CA, 94158, USA.ORCID 0000-0003-3642-7674
Ziqi TangInstitute for Neurodegenerative Diseases, University of California, San Francisco, CA, 94158, USA.ORCID 0000-0003-0425-0173
Nicholas C MewInstitute for Neurodegenerative Diseases, University of California, San Francisco, CA, 94158, USA.ORCID 0000-0001-9848-0396
Sakshi DasDepartment of Pathology and Laboratory Medicine, School of Medicine, University of California, Davis, Sacramento, CA, 95817, USA.
Justin AtheyDepartment of Pathology and Laboratory Medicine, School of Medicine, University of California, Davis, Sacramento, CA, 95817, USA.
Kirsty E McAleeseTranslation and Clinical Research Institute, Newcastle University, Newcastle, UK.ORCID 0000-0002-0212-9823
Julia K KoflerDepartment of Pathology, University of Pittsburgh Medical Center, Pittsburgh, PA, 15260, USA.
Margaret E FlanaganDepartment of Pathology, Northwestern University, Evanston, IL, 60208, USA.
Ewa BorysDepartment of Pathology, Loyola University Medical Center, Maywood, IL, 60153, USA.
Charles L WhiteDepartment of Pathology, University of Texas Southwestern Medical Center, Dallas, TX, 75390, USA.ORCID 0000-0002-3870-2804
Atul J ButteBakar Computational Health Sciences Institute, University of California, San Francisco, CA, 94158, USA.ORCID 0000-0002-7433-2740
Brittany N DuggerDepartment of Pathology and Laboratory Medicine, School of Medicine, University of California, Davis, Sacramento, CA, 95817, USA. bndugger@ucdavis.edu.ORCID 0000-0003-2141-8855
Michael J KeiserBakar Computational Health Sciences Institute, University of California, San Francisco, CA, 94158, USA. keiser@keiserlab.org.ORCID 0000-0002-1240-2192

Funding

TREATMENT OF DEPRESSION IN ALZHEIMER'S DISEASEP50AG005133 · NIA · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI KAMBOH, M. ILYAS · 1985 to 2019
$43.0M
Research Education ComponentP30AG066468 · NIA · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI C. Elizabeth Shaaban · 2020 to 2026
$29.4M
Neuropathology CoreP30AG013854 · NIA · NORTHWESTERN UNIVERSITY AT CHICAGO · PI ROGALSKI, EMILY J · 1996 to 2020
$28.9M
UC Davis Alzheimer's Disease Core CenterP30AG010129 · NIA · UNIVERSITY OF CALIFORNIA DAVIS · PI DECARLI, CHARLES · 1991 to 2020
$28.3M
ROLE OF GLUTAMATE IN ALZHEIMER'S DISEASEP30AG012300 · NIA · UT SOUTHWESTERN MEDICAL CENTER · PI ROSENBERG, ROGER NEWMAN · 1994 to 2016
$26.6M
Research Education Core FP30AG072977 · NIA · NORTHWESTERN UNIVERSITY AT CHICAGO · PI SANDRA WEINTRAUB · 2021 to 2026
$26.3M
UC Davis Alzheimer's Disease Research CenterP30AG072972 · NIA · UNIVERSITY OF CALIFORNIA AT DAVIS · PI Charles DeCarli, Rachel A Whitmer · 2021 to 2026
$25.2M
The Neuropathologic Landscape of Alzheimer's Disease in Hispanic DecedentsR01AG062517 · NIA · UNIVERSITY OF CALIFORNIA AT DAVIS · PI Brittany Nicole Dugger · 2019 to 2026
$10.5M
nvestigating the role of neuroinflammation in Limbic-predominant age related TDP43 encephalopathyK08AG065463 · NIA · UNIVERSITY OF TEXAS HLTH SCIENCE CENTER · PI FLANAGAN, MARGARET E · 2020 to 2024
$816k
NIA NIH HHS K08 AG065463NIA NIH HHS P30 AG010129NIA NIH HHS P30 AG012300NIA NIH HHS P30 AG013854NIA NIH HHS P30 AG066468NIA NIH HHS P30 AG072972NIA NIH HHS P30 AG072977NIA NIH HHS P50 AG005133NIA NIH HHS R01 AG062517
6 · The paper itself

Abstract

Pathologists can label pathologies differently, making it challenging to yield consistent assessments in the absence of one ground truth. To address this problem, we present a deep learning (DL) approach that draws on a cohort of experts, weighs each contribution, and is robust to noisy labels. We collected 100,495 annotations on 20,099 candidate amyloid beta neuropathologies (cerebral amyloid angiopathy (CAA), and cored and diffuse plaques) from three institutions, independently annotated by five experts. DL methods trained on a consensus-of-two strategy yielded 12.6-26% improvements by area under the precision recall curve (AUPRC) when compared to those that learned individualized annotations. This strategy surpassed individual-expert models, even when unfairly assessed on benchmarks favoring them. Moreover, ensembling over individual models was robust to hidden random annotators. In blind prospective tests of 52,555 subsequent expert-annotated images, the models labeled pathologies like their human counterparts (consensus model AUPRC = 0.74 cored; 0.69 CAA). This study demonstrates a means to combine multiple ground truths into a common-ground DL model that yields consistent diagnoses informed by multiple and potentially variable expert opinions.

Indexed as

Cerebral Amyloid AngiopathyDeep LearningAmyloid beta-PeptidesHumansNeuropathologyProspective StudiesAmyloid beta-PeptidesAlgorithmsAmyloid betaConsensusDeep learningExpert annotatorsHistopathology

Identifiers

PMID35484610
PMCPMC9052651

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.