Evidence map›Paper›PMID 34285218›Full record

ArticleNature communications2021

The impact of site-specific digital histology signatures on deep learning model accuracy and bias.

Frederick M Howard, James Dolezal, Sara Kochanny, Jefree Schulte, Heather Chen, Lara Heij, Dezheng Huo, Rita Nanda, Olufunmilayo I Olopade, Jakob N Kather and 3 more

Abstract read
In one paragraph

Article in Nature communications, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 162 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
162citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

162 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Review
  10. Review
  11. Review
  12. Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Article
  18. Mitigating Batch Effects in Histopathology via Language-Mediated Robust Embedding Generation.Proceedings. IEEE Computer Society Conference on Computer Vision and Pattern Recognition · 2026
    Article
  19. Review
  20. Article

102 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Frederick M HowardSection of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA.ORCID 0000-0002-6039-1141
James DolezalSection of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA.
Sara KochannySection of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA.
Jefree SchulteDepartment of Pathology, University of Chicago, Chicago, IL, USA.ORCID 0000-0003-3920-0301
Heather ChenDepartment of Pathology, University of Chicago, Chicago, IL, USA.
Lara HeijDepartment of Surgery and Transplantation, University Hospital RWTH Aachen, Aachen, Germany.ORCID 0000-0002-0602-3356
Dezheng HuoDepartment of Public Health Sciences, University of Chicago, Chicago, IL, USA.ORCID 0000-0002-4041-1678
Rita NandaSection of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA.ORCID 0000-0001-5248-0876
Olufunmilayo I OlopadeSection of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA.ORCID 0000-0002-9936-1599
Jakob N KatherDepartment of Medicine III, University Hospital RWTH Aachen, Aachen, Germany.
Nicole CiprianiDepartment of Pathology, University of Chicago, Chicago, IL, USA.ORCID 0000-0003-3092-2746
Robert L GrossmanSection of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA. rgrossman1@uchicago.edu.
Alexander T PearsonSection of Hematology/Oncology, Department of Medicine, University of Chicago, Chicago, IL, USA. apearson5@medicine.bsd.uchicago.edu.ORCID 0000-0003-2801-7456

Funding

BASIC RESEARCH TRAINING IN MEDICAL ONCOLOGYT32CA009566 · NCI · UNIVERSITY OF CHICAGO · PI OLUFUNMILAYO F. OLOPADE · 1987 to 2026
$10.5M
UChicago Interdisciplinary Cancer Health Disparities SPOREP20CA233307 · NCI · UNIVERSITY OF CHICAGO · PI KARRISON, THEODORE GEORGE · 2018 to 2020
$3.4M
Multiscale Computational Models Guided By Emerging Cellular Dynamics Quantification For Predicting Optimum Immune Checkpoint And Targeted Therapy SchedulesU01CA243075 · NCI · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI JACKSON, TRACHETTE · 2020 to 2024
$2.6M
A reasoned approach to combination therapy development in head and neck cancerK08DE026500 · NIDCR · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI PEARSON, ALEXANDER THOMAS · 2016 to 2020
$800k
NCI NIH HHS P20 CA233307NCI NIH HHS T32 CA009566NCI NIH HHS U01 CA243075NIDCR NIH HHS K08 DE026500
6 · The paper itself

Abstract

The Cancer Genome Atlas (TCGA) is one of the largest biorepositories of digital histology. Deep learning (DL) models have been trained on TCGA to predict numerous features directly from histology, including survival, gene expression patterns, and driver mutations. However, we demonstrate that these features vary substantially across tissue submitting sites in TCGA for over 3,000 patients with six cancer subtypes. Additionally, we show that histologic image differences between submitting sites can easily be identified with DL. Site detection remains possible despite commonly used color normalization and augmentation methods, and we quantify the image characteristics constituting this site-specific digital histology signature. We demonstrate that these site-specific signatures lead to biased accuracy for prediction of features including survival, genomic mutations, and tumor stage. Furthermore, ethnicity can also be inferred from site-specific signatures, which must be accounted for to ensure equitable application of DL. These site-specific signatures can lead to overoptimistic estimates of model performance, and we propose a quadratic programming method that abrogates this bias by ensuring models are not trained and validated on samples from the same site.

Indexed as

Deep LearningBiomarkers, TumorData AccuracyDNA Mutational AnalysisGene Expression ProfilingHumansImage Processing, Computer-AssistedMutationNeoplasmsNeoplasm StagingRisk AssessmentSpecimen HandlingBiomarkers, Tumor

Identifiers

PMID34285218
PMCPMC8292530

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.