Evidence map›Paper›PMID 27388877›Full record

ArticleJournal of biomedical informatics2016

Using automatically extracted information from mammography reports for decision-support.

Selen Bozkurt, Francisco Gimenez, Elizabeth S Burnside, Kemal H Gulkesen, Daniel L Rubin

Open access · greenAbstract read
In one paragraph

Article in Journal of biomedical informatics, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed, 1 pooled it
2.6field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed, 1 synthesis or guideline pooled it, 60 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Bayesian Networks in Radiology.Radiology. Artificial intelligence · 2023
    Review
  9. Combining text mining with clinical decision support in clinical practice: a scoping review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 4 institutions in 2 countries.

Selen BozkurtAkdeniz University Faculty of Medicine, Department of Biostatistics and Medical Informatics, Antalya, Turkey.
Francisco GimenezDepartment of Radiology and Medicine (Biomedical Informatics Research), Stanford University, Richard M. Lucas Center, 1201 Welch Road, Office P285, Stanford, CA 94305-5488, United States.
Elizabeth S BurnsideDepartment of Radiology, University of Wisconsin, Madison, WI, United States.
Kemal H GulkesenAkdeniz University Faculty of Medicine, Department of Biostatistics and Medical Informatics, Antalya, Turkey.
Daniel L RubinDepartment of Radiology and Medicine (Biomedical Informatics Research), Stanford University, Richard M. Lucas Center, 1201 Welch Road, Office P285, Stanford, CA 94305-5488, United States. Electronic address: dlrubin@stanford.edu.
Akdeniz University · TRStanford Medicine · USStanford University · USUniversity of Wisconsin–Madison · US

Funding

POSTDOCTORAL TRAINING IN MEDICAL INFORMATION SCIENCEST15LM007033 · NLM · STANFORD UNIVERSITY · PI SYLVIA KATINA PLEVRITIS · 1985 to 2026
$25.5M
TrainingU54AI117924 · NIAID · UNIVERSITY OF WISCONSIN-MADISON · PI CRAVEN, MARK W. · 2014 to 2018
$11.3M
Integrating Machine Learning and Physician Expertise for Breast Cancer DiagnosisR01LM010921 · NLM · UNIVERSITY OF WISCONSIN-MADISON · PI BURNSIDE, ELIZABETH S · 2011 to 2014
$1.2M
Mentoring And Research In Patient-Oriented Breast Cancer DiagnosisK24CA194251 · NCI · UNIVERSITY OF WISCONSIN-MADISON · PI BURNSIDE, ELIZABETH S · 2015 to 2019
$963k
NCI NIH HHS K24 CA194251NIAID NIH HHS U54 AI117924NLM NIH HHS R01 LM010921NLM NIH HHS T15 LM007033
6 · The paper itself

Abstract

objectiveTo evaluate a system we developed that connects natural language processing (NLP) for information extraction from narrative text mammography reports with a Bayesian network for decision-support about breast cancer diagnosis. The ultimate goal of this system is to provide decision support as part of the workflow of producing the radiology report. MATERIALS AND

methodsWe built a system that uses an NLP information extraction system (which extract BI-RADS descriptors and clinical information from mammography reports) to provide the necessary inputs to a Bayesian network (BN) decision support system (DSS) that estimates lesion malignancy from BI-RADS descriptors. We used this integrated system to predict diagnosis of breast cancer from radiology text reports and evaluated it with a reference standard of 300 mammography reports. We collected two different outputs from the DSS: (1) the probability of malignancy and (2) the BI-RADS final assessment category. Since NLP may produce imperfect inputs to the DSS, we compared the difference between using perfect ("reference standard") structured inputs to the DSS ("RS-DSS") vs NLP-derived inputs ("NLP-DSS") on the output of the DSS using the concordance correlation coefficient. We measured the classification accuracy of the BI-RADS final assessment category when using NLP-DSS, compared with the ground truth category established by the radiologist.

resultsThe NLP-DSS and RS-DSS had closely matched probabilities, with a mean paired difference of 0.004±0.025. The concordance correlation of these paired measures was 0.95. The accuracy of the NLP-DSS to predict the correct BI-RADS final assessment category was 97.58%.

conclusionThe accuracy of the information extracted from mammography reports using the NLP system was sufficient to provide accurate DSS results. We believe our system could ultimately reduce the variation in practice in mammography related to assessment of malignant lesions and improve management decisions.

Indexed as

Decision Support Systems, ClinicalNatural Language ProcessingBayes TheoremBreast NeoplasmsFemaleHumansInformation Storage and RetrievalMammographyBreast Imaging Reporting and Data System (BI-RADS)Decision support systemsInformation extractionNatural language processing

Identifiers

PMID27388877
PMCPMC5108519
OpenAlexW2460390741

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.