Evidence map›Paper›PMID 30312179›Full record

ArticleThe American journal of surgical pathology2018

Impact of Deep Learning Assistance on the Histopathologic Review of Lymph Nodes for Metastatic Breast Cancer.

David F Steiner, Robert MacDonald, Yun Liu, Peter Truszkowski, Jason D Hipp, Christopher Gammage, Florence Thng, Lily Peng, Martin C Stumpe

Registry-linked trialOpen access · hybridAbstract readEvaluation Study
In one paragraph

Article in The American journal of surgical pathology, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05689437 (MIRA Clinical Learning Environment), which is not on this map. Cited by 223 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
223citing papers in PubMed, 6 pooled it
34.0field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05689437 unknown statusnot on this mapstarted 2022, after this paper: background citation

MIRA Clinical Learning Environment (MIRACLE): Lung

TypeobservationalSponsorUniversity Health Network, TorontoRan2022 to 2023Enrolled1,000ConditionsLung CancerArmsApplication of ILD prediction machine learning model to planning imaging, Routine, automatic presentation of ILD risk level for evaluation by the clinician., Application of SGR machine learning model to diagnostic and planning imaging, Routine estimation of tumor specific growth rate (SGR) for lesions being considered for radiation therapy presented to clinician., Application of CBCT machine learning model to on-treatment imaging
3 · Its place in the literature

Who cites it

223 citing papers in PubMed, 6 syntheses or guidelines pooled it, 467 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Review
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review

163 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 1 institution in 1 country.

David F SteinerGoogle AI Healthcare.
Robert MacDonaldGoogle AI Healthcare.
Yun LiuGoogle AI Healthcare.
Peter TruszkowskiGoogle AI Healthcare.
Jason D HippGoogle AI Healthcare.
Christopher GammageGoogle AI Healthcare.
Florence ThngVerily Life Sciences, Mountain View, CA.
Lily PengGoogle AI Healthcare.
Martin C StumpeGoogle AI Healthcare.
Google (United States) · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Advances in the quality of whole-slide images have set the stage for the clinical use of digital images in anatomic pathology. Along with advances in computer image analysis, this raises the possibility for computer-assisted diagnostics in pathology to improve histopathologic interpretation and clinical care. To evaluate the potential impact of digital assistance on interpretation of digitized slides, we conducted a multireader multicase study utilizing our deep learning algorithm for the detection of breast cancer metastasis in lymph nodes. Six pathologists reviewed 70 digitized slides from lymph node sections in 2 reader modes, unassisted and assisted, with a wash-out period between sessions. In the assisted mode, the deep learning algorithm was used to identify and outline regions with high likelihood of containing tumor. Algorithm-assisted pathologists demonstrated higher accuracy than either the algorithm or the pathologist alone. In particular, algorithm assistance significantly increased the sensitivity of detection for micrometastases (91% vs. 83%, P=0.02). In addition, average review time per image was significantly shorter with assistance than without assistance for both micrometastases (61 vs. 116 s, P=0.002) and negative images (111 vs. 137 s, P=0.018). Lastly, pathologists were asked to provide a numeric score regarding the difficulty of each image classification. On the basis of this score, pathologists considered the image review of micrometastases to be significantly easier when interpreted with assistance (P=0.0005). Utilizing a proof of concept assistant tool, this study demonstrates the potential of a deep learning algorithm to improve pathologist accuracy and efficiency in a digital pathology workflow.

Indexed as

Deep LearningBiopsyBreast NeoplasmsDiagnosis, Computer-AssistedFemaleHumansImage Interpretation, Computer-AssistedLymphatic MetastasisLymph NodesNeoplasm MicrometastasisObserver VariationPathology, ClinicalPattern Recognition, AutomatedPredictive Value of TestsProof of Concept StudyReproducibility of Results

Identifiers

PMID30312179
PMCPMC6257102
OpenAlexW2897434820

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.