Evidence map›Paper›PMID 34168282›Full record

ArticleModern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc2021

Quality control stress test for deep learning-based diagnostic model in digital pathology.

Birgid Schömig-Markiefka, Alexey Pryalukhin, Wolfgang Hulla, Andrey Bychkov, Junya Fukuoka, Anant Madabhushi, Viktor Achter, Lech Nieroda, Reinhard Büttner, Alexander Quaas and 1 more

Abstract read
In one paragraph

Article in Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 64 papers.

0numbers the graph read from it
0cells of the map it votes in
64citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

64 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Digital transformation of pathology - the European Society of Pathology expert opinion paper.Virchows Archiv : an international journal of pathology · 2025
    Article
  8. Article
  9. Review
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Toward Optimizing the Impact of Digital Pathology and Augmented Intelligence on Issues of Diagnosis, Grading, Staging, and Classification.Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc · 2025
    Review
  17. Article
  18. Article
  19. Review
  20. Review

4 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Birgid Schömig-MarkiefkaInstitute of Pathology, University Hospital Cologne, Cologne, Germany.
Alexey PryalukhinInstitute of Pathology, Landesklinikum Wiener Neustadt, Wiener Neustadt, Austria.
Wolfgang HullaInstitute of Pathology, Landesklinikum Wiener Neustadt, Wiener Neustadt, Austria.
Andrey BychkovDepartment of Pathology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan.
Junya FukuokaDepartment of Pathology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan.
Anant MadabhushiDepartment of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA.
Viktor AchterRegional computing center (RRZK), University of Cologne, Cologne, Germany.ORCID 0000-0002-3813-0746
Lech NierodaRegional computing center (RRZK), University of Cologne, Cologne, Germany.
Reinhard BüttnerInstitute of Pathology, University Hospital Cologne, Cologne, Germany.ORCID 0000-0001-8806-4786
Alexander QuaasInstitute of Pathology, University Hospital Cologne, Cologne, Germany.
Yuri TolkachInstitute of Pathology, University Hospital Cologne, Cologne, Germany. yuri.tolkach@gmail.com.

Funding

Clinical and Translational Science Collaborative of ClevelandUL1TR002548 · NCATS · CASE WESTERN RESERVE UNIVERSITY · PI MCCOMSEY, GRACE A · 2018 to 2022
$35.5M
Pathology CoreU54CA254566 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI MADABHUSHI, ANANT · 2020 to 2024
$5.0M
Computer-Assisted Histologic Evaluation of Cardiac Allograft RejectionR01HL151277 · NHLBI · UNIVERSITY OF PENNSYLVANIA · PI MADABHUSHI, ANANT, MARGULIES, KENNETH BER · 2020 to 2023
$3.2M
Oral Cavity Quantitative Histomorphometric Risk Classifier (OHbIC) in Oral Cavity Squamous Cell Carcinoma (OC-SCC)R01CA249992 · NCI · EMORY UNIVERSITY · PI LEWIS, JAMES, MADABHUSHI, ANANT · 2021 to 2025
$3.2M
Computerized histologic image predictor of cancer outcomeR01CA202752 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI FELDMAN, MICHAEL D, GANESAN, SHRIDAR · 2016 to 2020
$3.1M
Quantitative Histomorphometric Risk Classifier (QuHbIC) in HPV + Oropharyngeal CarcinomaR01CA220581 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI KOYFMAN, SHLOMO, LEWIS, JAMES · 2018 to 2023
$3.1M
Computerized Histologic Risk Predictor (CHiRP) for Early Stage Lung CancersR01CA216579 · NCI · EMORY UNIVERSITY · PI FU, PINGFU, LLOYD, MARK · 2018 to 2023
$3.1M
MR Fingerprinting and Computerized Decision Support for Prostate CancerR01CA208236 · NCI · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI GULANI, VIKAS, PONSKY, LEE EVAN · 2017 to 2022
$3.0M
Pathology Image Informatics Platform for visualization, analysis and managementU24CA199374 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI GURCAN, METIN NAFI, MADABHUSHI, ANANT · 2015 to 2019
$2.9M
RadxTools for assessing tumor treatment response on imagingU01CA248226 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI TIWARI, PALLAVI, VISWANATH, SATISH EASWAR · 2020 to 2022
$1.4M
HistoTools: A suite of digital pathology tools for quality control, annotation and dataset identificationU01CA239055 · NCI · CASE WESTERN RESERVE UNIVERSITY · PI JANOWCZYK, ANDREW ROBERT, MADABHUSHI, ANANT · 2019 to 2022
$1.0M
A Study to Validate and Improve an Automated Image Analysis Algorithm to Detect Tuberculosis in Sputum Smear SlidesR43EB028736 · NIBIB · DIASCOPIC, LLC · PI MADABHUSHI, ANANT, SERIF, CARY · 2019 to 2019
$225k
BLRD VA I01 BX004121NCATS NIH HHS UL1 TR002548NCI NIH HHS R01 CA202752NCI NIH HHS R01 CA208236NCI NIH HHS R01 CA216579NCI NIH HHS R01 CA220581NCI NIH HHS R01 CA249992NCI NIH HHS U01 CA239055NCI NIH HHS U01 CA248226NCI NIH HHS U24 CA199374NCI NIH HHS U54 CA254566NCRR NIH HHS C06 RR012463NHLBI NIH HHS R01 HL151277NIBIB NIH HHS R43 EB028736
6 · The paper itself

Abstract

Digital pathology provides a possibility for computational analysis of histological slides and automatization of routine pathological tasks. Histological slides are very heterogeneous concerning staining, sections' thickness, and artifacts arising during tissue processing, cutting, staining, and digitization. In this study, we digitally reproduce major types of artifacts. Using six datasets from four different institutions digitized by different scanner systems, we systematically explore artifacts' influence on the accuracy of the pre-trained, validated, deep learning-based model for prostate cancer detection in histological slides. We provide evidence that any histological artifact dependent on severity can lead to a substantial loss in model performance. Strategies for the prevention of diagnostic model accuracy losses in the context of artifacts are warranted. Stress-testing of diagnostic models using synthetically generated artifacts might be an essential step during clinical validation of deep learning-based algorithms.

Indexed as

ArtifactsDeep LearningImage Processing, Computer-AssistedNeural Networks, ComputerQuality ControlHumansMalePathology, ClinicalProstatic NeoplasmsReproducibility of Results

Identifiers

PMID34168282
PMCPMC8592835

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.