Evidence map›Paper›PMID 34342503›Full record

ArticleRadiology2021

Patterns of Metastatic Disease in Patients with Cancer Derived from Natural Language Processing of Structured CT Radiology Reports over a 10-year Period.

Richard K G Do, Kaelan Lupton, Pamela I Causa Andrieu, Anisha Luthra, Michio Taya, Karen Batch, Huy Nguyen, Prachi Rahurkar, Lior Gazit, Kevin Nicholas and 8 more

Open access · greenAbstract read
In one paragraph

Article in Radiology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed
4.9field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed, 52 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Imaging of Peritoneal Surface Malignancies.Journal of surgical oncology · 2024
    Review
  17. Article
  18. Based on Medicine, The Now and Future of Large Language Models.Cellular and molecular bioengineering · 2024
    Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors at 1 institution in 1 country.

Richard K G DoFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0002-6554-0310
Kaelan LuptonFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0002-3635-4412
Pamela I Causa AndrieuFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).
Anisha LuthraFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0001-9007-3462
Michio TayaFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0002-7246-378X
Karen BatchFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0002-2207-5447
Huy NguyenFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0001-9662-9599
Prachi RahurkarFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0002-8284-1246
Lior GazitFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0002-1758-0166
Kevin NicholasFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0001-8271-360X
Christopher J FongFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).
Natalie GangaiFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0003-0603-7165
Nikolaus SchultzFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).
Farhana ZulkernineFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0002-3326-0875
Varadan SevilimeduFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0002-0938-9396
Krishna JuluruFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0001-8203-8894
Amber SimpsonFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0002-4387-8417
Hedvig HricakFrom the Department of Radiology (R.K.G.D., P.I.C.A., M.T., N.G., K.J., H.H.), Human Pathology and Pathogenesis Program, Center for Molecular Oncology (A.L.), Department of Strategy and Innovation (H.N., P.R., L.G., K.N.), and Biostatistics Service, Department of Epidemiology and Biostatistics (C.J.F., N.S., V.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; and School of Computing, Queens University, Kingston, Canada (K.L., K.B., F.Z., A.S.).ORCID 0000-0003-2240-9694
Memorial Sloan Kettering Cancer Center · US

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Nicholas D Socci · 1985 to 2026
$347.4M
NCI NIH HHS P30 CA008748
6 · The paper itself

Abstract

Background Patterns of metastasis in cancer are increasingly relevant to prognostication and treatment planning but have historically been documented by means of autopsy series. Purpose To show the feasibility of using natural language processing (NLP) to gather accurate data from radiology reports for assessing spatial and temporal patterns of metastatic spread in a large patient cohort. Materials and Methods In this retrospective longitudinal study, consecutive patients who underwent CT from July 2009 to April 2019 and whose CT reports followed a departmental structured template were included. Three radiologists manually curated a sample of 2219 reports for the presence or absence of metastases across 13 organs; these manually curated reports were used to develop three NLP models with an 80%-20% split for training and test sets. A separate random sample of 448 manually curated reports was used for validation. Model performance was measured by accuracy, precision, and recall for each organ. The best-performing NLP model was used to generate a final database of metastatic disease across all patients. For each cancer type, statistical descriptive reports were provided by analyzing the frequencies of metastatic disease at the report and patient levels. Results In 91 665 patients (mean age ± standard deviation, 61 years ± 15; 46 939 women), 387 359 reports were labeled. The best-performing NLP model achieved accuracies from 90% to 99% across all organs. Metastases were most frequently reported in abdominopelvic (23.6% of all reports) and thoracic (17.6%) nodes, followed by lungs (14.7%), liver (13.7%), and bones (9.9%). Metastatic disease tropism is distinct among common cancers, with the most common first site being bones in prostate and breast cancers and liver among pancreatic and colorectal cancers. Conclusion Natural language processing may be applied to cancer patients' CT reports to generate a large database of metastatic phenotypes. Such a database could be combined with genomic studies and used to explore prognostic imaging phenotypes with relevance to treatment planning. © RSNA, 2021

Indexed as

Electronic Health RecordsNatural Language ProcessingDatabases, FactualData ManagementFeasibility StudiesFemaleHumansLongitudinal StudiesMaleMiddle AgedNeoplasm MetastasisNeoplasmsReproducibility of ResultsRetrospective StudiesTomography, X-Ray Computed

Identifiers

PMID34342503
PMCPMC8474969
OpenAlexW3189476076

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.