Evidence map›Paper›PMID 31002562›Full record

ArticleJCO clinical cancer informatics2019

Natural Language Processing for Automated Quantification of Brain Metastases Reported in Free-Text Radiology Reports.

Joeky T Senders, Aditya V Karhade, David J Cote, Alireza Mehrtash, Nayan Lamba, Aislyn DiRisio, Ivo S Muskens, William B Gormley, Timothy R Smith, Marike L D Broekman and 1 more

Open access · greenAbstract read
In one paragraph

Article in JCO clinical cancer informatics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed, 1 pooled it
2.2field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 1 synthesis or guideline pooled it, 50 citations in OpenAlex.

  1. Pooled it
  2. Review
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 3 institutions in 2 countries.

Joeky T SendersBrigham and Women's Hospital, Harvard Medical School, Boston, MA.
Aditya V KarhadeBrigham and Women's Hospital, Harvard Medical School, Boston, MA.
David J CoteBrigham and Women's Hospital, Harvard Medical School, Boston, MA.
Alireza MehrtashBrigham and Women's Hospital, Harvard Medical School, Boston, MA.
Nayan LambaBrigham and Women's Hospital, Harvard Medical School, Boston, MA.
Aislyn DiRisioBrigham and Women's Hospital, Harvard Medical School, Boston, MA.
Ivo S MuskensBrigham and Women's Hospital, Harvard Medical School, Boston, MA.
William B GormleyBrigham and Women's Hospital, Harvard Medical School, Boston, MA.
Timothy R SmithBrigham and Women's Hospital, Harvard Medical School, Boston, MA.
Marike L D BroekmanHaaglanden Medical Center, The Hague, the Netherlands.
Omar ArnaoutBrigham and Women's Hospital, Harvard Medical School, Boston, MA.
Harvard University · USBrigham and Women's Hospital · USMedisch Centrum Haaglanden · NL

Funding

Training Program in Cancer EpidemiologyT32CA009001 · NCI · HARVARD UNIVERSITY (SCH OF PUBLIC HLTH) · PI A. Heather Eliassen, Meir Stampfer · 1985 to 2026
$17.3M
NCI NIH HHS T32 CA009001
6 · The paper itself

Abstract

purposeAlthough the bulk of patient-generated health data are increasing exponentially, their use is impeded because most data come in unstructured format, namely as free-text clinical reports. A variety of natural language processing (NLP) methods have emerged to automate the processing of free text ranging from statistical to deep learning-based models; however, the optimal approach for medical text analysis remains to be determined. The aim of this study was to provide a head-to-head comparison of novel NLP techniques and inform future studies about their utility for automated medical text analysis. PATIENTS AND

methodsMagnetic resonance imaging reports of patients with brain metastases treated in two tertiary centers were retrieved and manually annotated using a binary classification (single metastasis

resultsA total of 1,479 radiology reports of patients diagnosed with brain metastases were retrieved. The least absolute shrinkage and selection operator (LASSO) regression model demonstrated the best overall performance on the hold-out test set with an area under the receiver operating characteristic curve of 0.92 (95% CI, 0.89 to 0.94), accuracy of 83% (95% CI, 80% to 87%), calibration intercept of -0.06 (95% CI, -0.14 to 0.01), and calibration slope of 1.06 (95% CI, 0.95 to 1.17).

conclusionAmong various NLP techniques, the bag-of-words approach combined with a LASSO regression model demonstrated the best overall performance in extracting binary outcomes from free-text clinical reports. This study provides a framework for the development of machine learning-based NLP models as well as a clinical vignette of patients diagnosed with brain metastases.

Indexed as

Natural Language ProcessingRadiologyAlgorithmsBrain NeoplasmsElectronic Health RecordsHumansMagnetic Resonance ImagingMedical InformaticsReproducibility of ResultsResearch ReportROC Curve

Identifiers

PMID31002562
PMCPMC6873936
OpenAlexW2936894186

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.