Evidence map›Paper›PMID 28087402›Full record

ArticleJournal of biomedical informatics2017

Accuracy is in the eyes of the pathologist: The visual interpretive process and diagnostic accuracy with digital whole slide images.

Tad T Brunyé, Ezgi Mercan, Donald L Weaver, Joann G Elmore

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 41 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
41citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

41 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Effects of Prior Diagnosis on Second Opinions and Pathologist Viewing Behaviors: Results from a Randomized Trial in Breast Pathology.Medical decision making : an international journal of the Society for Medical Decision Making · 2026
    Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Characterizing Interpretive and Diagnostic Competency Development in Pathology Training.Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc · 2025
    Article
  10. Review
  11. Article
  12. Review
  13. Review
  14. Article
  15. Article
  16. Machine learning classification of diagnostic accuracy in pathologists interpreting breast biopsies.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  17. Article
  18. Review
  19. Article
  20. From Image to Diagnosis: Characterizing Sources of Error in Histopathologic Interpretation.Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Tad T BrunyéCenter for Applied Brain & Cognitive Sciences, Tufts University, Medford, MA, United States. Electronic address: tbruny01@tufts.edu.
Ezgi MercanDepartment of Computer Science and Engineering, University of Washington, Seattle, WA, United States.
Donald L WeaverDepartment of Pathology and UVM Cancer Center, University of Vermont, Burlington, VT, United States.
Joann G ElmoreDepartment of Medicine, University of Washington School of Medicine, Seattle, WA, United States.

Funding

Accuracy of Breast Pathology and the Impact of Double ReadingR01CA140560 · NCI · UNIVERSITY OF WASHINGTON · PI ELMORE, JOANN G, WEAVER, DONALD LEE · 2009 to 2013
$3.3M
Digital Pathology_Accuracy Viewing Behavior and Image CharacterizationR01CA172343 · NCI · UNIVERSITY OF WASHINGTON · PI SHAPIRO, LINDA, WEAVER, DONALD LEE · 2013 to 2017
$3.2M
Improving Accuracy &Outcomes of Breast Cancer ScreeningK05CA104699 · NCI · UNIVERSITY OF WASHINGTON · PI ELMORE, JOANN G · 2004 to 2014
$1.2M
NCI NIH HHS K05 CA104699NCI NIH HHS R01 CA140560NCI NIH HHS R01 CA172343
6 · The paper itself

Abstract

Digital whole slide imaging is an increasingly common medium in pathology, with application to education, telemedicine, and rendering second opinions. It has also made it possible to use eye tracking devices to explore the dynamic visual inspection and interpretation of histopathological features of tissue while pathologists review cases. Using whole slide images, the present study examined how a pathologist's diagnosis is influenced by fixed case-level factors, their prior clinical experience, and their patterns of visual inspection. Participating pathologists interpreted one of two test sets, each containing 12 digital whole slide images of breast biopsy specimens. Cases represented four diagnostic categories as determined via expert consensus: benign without atypia, atypia, ductal carcinoma in situ (DCIS), and invasive cancer. Each case included one or more regions of interest (ROIs) previously determined as of critical diagnostic importance. During pathologist interpretation we tracked eye movements, viewer tool behavior (zooming, panning), and interpretation time. Models were built using logistic and linear regression with generalized estimating equations, testing whether variables at the level of the pathologists, cases, and visual interpretive behavior would independently and/or interactively predict diagnostic accuracy and efficiency. Diagnostic accuracy varied as a function of case consensus diagnosis, replicating earlier research. As would be expected, benign cases tended to elicit false positives, and atypia, DCIS, and invasive cases tended to elicit false negatives. Pathologist experience levels, case consensus diagnosis, case difficulty, eye fixation durations, and the extent to which pathologists' eyes fixated within versus outside of diagnostic ROIs, all independently or interactively predicted diagnostic accuracy. Higher zooming behavior predicted a tendency to over-interpret benign and atypia cases, but not DCIS cases. Efficiency was not predicted by pathologist- or visual search-level variables. Results provide new insights into the medical interpretive process and demonstrate the complex interactions between pathologists and cases that guide diagnostic decision-making. Implications for training, clinical practice, and computer-aided decision aids are considered.

Indexed as

Clinical CompetenceObserver VariationPathologistsTelemedicineBiopsyBreastBreast NeoplasmsHumansBreast cancerCognitive informaticsDecision makingPathologyWhole slide imaging

Identifiers

PMID28087402
PMCPMC5316368

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.