Evidence map›Paper›PMID 27334105›Full record

ArticleBMJ (Clinical research ed.)2016

Evaluation of 12 strategies for obtaining second opinions to improve interpretation of breast histopathology: simulation study.

Joann G Elmore, Anna Na Tosteson, Margaret S Pepe, Gary M Longton, Heidi D Nelson, Berta Geller, Patricia A Carney, Tracy Onega, Kimberly H Allison, Sara L Jackson and 1 more

Abstract read
In one paragraph

Article in BMJ (Clinical research ed.), 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. Review
  2. Are Pathologists Self-Aware of Their Diagnostic Accuracy? Metacognition and the Diagnostic Process in Pathology.Medical decision making : an international journal of the Society for Medical Decision Making · 2023
    Article
  3. Article
  4. Article
  5. Observational
  6. Article
  7. Article
  8. Article
  9. Frontiers in oncology · 2019
    Article
  10. Observational
  11. Article
  12. Effects of DNA Methylation on Progression to Interstitial Fibrosis and Tubular Atrophy in Renal Allograft Biopsies: A Multi-Omics Approach.American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons · 2017
    Article
  13. Observational
  14. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

11 authors.

Joann G ElmoreDepartment of Medicine, University of Washington School of Medicine, Seattle, WA, USA jelmore@uw.edu.
Anna Na TostesonThe Dartmouth Institute for Health Policy and Clinical Practice, Geisel School of Medicine at Dartmouth, Norris Cotton Cancer Center, Lebanon, NH, USA Department of Medicine, Geisel School of Medicine at Dartmouth, Lebanon, NH, USA.
Margaret S PepeFred Hutchinson Cancer Research Center, Seattle, WA, USA.
Gary M LongtonProgram in Biostatistics and Biomathematics, Fred Hutchinson Cancer Research Center, Seattle, WA, USA.
Heidi D NelsonProvidence Cancer Center, Providence Health and Services Oregon; and Departments of Medical Informatics and Clinical Epidemiology and Medicine, Oregon Health & Science University, Portland, OR, USA.
Berta GellerDepartment of Family Medicine, University of Vermont, Burlington, VT, USA.
Patricia A CarneyDepartment of Family Medicine, Oregon Health & Science University, Portland, OR, USA.
Tracy OnegaCommunity and Family Medicine, Geisel School of Medicine at Dartmouth, Lebanon, NH, USA.
Kimberly H AllisonDepartment of Pathology, Stanford University School of Medicine, Stanford, CA, USA.
Sara L JacksonDepartment of Medicine, University of Washington School of Medicine, Seattle, WA, USA.
Donald L WeaverDepartment of Pathology; and UVM Cancer Center, University of Vermont, Burlington, VT, USA.

Funding

Translational Engineering in Cancer (TEC)P30CA023108 · NCI · DARTMOUTH COLLEGE · PI Steven D Leach · 1985 to 2026
$91.3M
Digital Pathology_Accuracy Viewing Behavior and Image CharacterizationR01CA172343 · NCI · UNIVERSITY OF WASHINGTON · PI SHAPIRO, LINDA, WEAVER, DONALD LEE · 2013 to 2017
$3.2M
NCI NIH HHS P30 CA023108NCI NIH HHS R01 CA172343
6 · The paper itself

Abstract

objectiveTo evaluate the potential effect of second opinions on improving the accuracy of diagnostic interpretation of breast histopathology.

designSimulation study.

setting12 different strategies for acquiring independent second opinions.

participantsInterpretations of 240 breast biopsy specimens by 115 pathologists, one slide for each case, compared with reference diagnoses derived by expert consensus.

main outcome measuresMisclassification rates for individual pathologists and for 12 simulated strategies for second opinions. Simulations compared accuracy of diagnoses from single pathologists with that of diagnoses based on pairing interpretations from first and second independent pathologists, where resolution of disagreements was by an independent third pathologist. 12 strategies were evaluated in which acquisition of second opinions depended on initial diagnoses, assessment of case difficulty or borderline characteristics, pathologists' clinical volumes, or whether a second opinion was required by policy or desired by the pathologists. The 240 cases included benign without atypia (10% non-proliferative, 20% proliferative without atypia), atypia (30%), ductal carcinoma in situ (DCIS, 30%), and invasive cancer (10%). Overall misclassification rates and agreement statistics depended on the composition of the test set, which included a higher prevalence of difficult cases than in typical practice.

resultsMisclassification rates significantly decreased (P<0.001) with all second opinion strategies except for the strategy limiting second opinions only to cases of invasive cancer. The overall misclassification rate decreased from 24.7% to 18.1% when all cases received second opinions (P<0.001). Obtaining both first and second opinions from pathologists with a high volume (≥10 breast biopsy specimens weekly) resulted in the lowest misclassification rate in this test set (14.3%, 95% confidence interval 10.9% to 18.0%). Obtaining second opinions only for cases with initial interpretations of atypia, DCIS, or invasive cancer decreased the over-interpretation of benign cases without atypia from 12.9% to 6.0%. Atypia cases had the highest misclassification rate after single interpretation (52.2%), remaining at more than 34% in all second opinion scenarios.

conclusionSecond opinions can statistically significantly improve diagnostic agreement for pathologists' interpretations of breast biopsy specimens; however, variability in diagnosis will not be completely eliminated, especially for breast specimens with atypia.

Indexed as

Diagnosis, DifferentialReferral and ConsultationAdultBiopsyBreastBreast NeoplasmsCarcinoma, Ductal, BreastCarcinoma, Intraductal, NoninfiltratingConsensusDiagnostic ErrorsFemaleHumansMaleMiddle AgedObserver VariationRandom Allocation

Identifiers

PMID27334105
PMCPMC4916777

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.