Evidence map›Paper›PMID 21393557›Full record

ArticleMedical decision making : an international journal of the Society for Medical Decision Making

Natural language processing improves identification of colorectal cancer testing in the electronic medical record.

Joshua C Denny, Neesha N Choma, Josh F Peterson, Randolph A Miller, Lisa Bastarache, Ming Li, Neeraja B Peterson

Abstract read
In one paragraph

Article in Medical decision making : an international journal of the Society for Medical Decision Making. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 35 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
35citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

35 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Natural Language Processing Algorithm Accurately Classifies Diverticulitis-Related Complications and Predicts Long-Term Outcomes.Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association · 2026
    Article
  4. Review
  5. A general framework for developing computable clinical phenotype algorithms.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Electronic Health Record (EHR) Abstraction.Perspectives in health information managemen · 2021
    Article
  12. Article
  13. Review
  14. Article
  15. Review
  16. Article
  17. Article
  18. A Frame-Based NLP System for Cancer-Related Information Extraction.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2018
    Article
  19. A Clinical Decision Support System for Monitoring Post-Colonoscopy Patient Follow-Up and Scheduling.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2017
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Joshua C DennyDivision of General Internal Medicine and Public Health, Department of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee (JCD, NNC, JFP, NBP)
Neesha N ChomaDivision of General Internal Medicine and Public Health, Department of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee (JCD, NNC, JFP, NBP)
Josh F PetersonDivision of General Internal Medicine and Public Health, Department of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee (JCD, NNC, JFP, NBP)
Randolph A MillerDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee (JCD, JFP, RAM, LB)
Lisa BastaracheDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee (JCD, JFP, RAM, LB)
Ming LiDepartment of Biostatistics, Vanderbilt University, Nashville, Tennessee (ML)
Neeraja B PetersonDivision of General Internal Medicine and Public Health, Department of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee (JCD, NNC, JFP, NBP)

Funding

VANDERBILT UNIVERSITY CTSA FOR PEDIATRIC RESEARCHUL1RR024975 · NCRR · VANDERBILT UNIVERSITY · PI BERNARD, GORDON RAPHAEL · 2007 to 2011
$45.7M
TIME:(Tools for Inpatient Monitoring using Evidence)for Safe &AppropriateTestingR01LM007995 · NLM · VANDERBILT UNIVERSITY · PI MILLER, RANDOLPH A · 2004 to 2009
$2.1M
Identifying Receipt of Colorectal Cancer ScreeningR21CA116573 · NCI · VANDERBILT UNIVERSITY · PI PETERSON, NEERAJA BOYAPATI · 2007 to 2008
$244k
NCI NIH HHS R21 CA116573NCRR NIH HHS 1 UL1 RR024975NCRR NIH HHS UL1 RR024975NLM NIH HHS R01 LM007995
6 · The paper itself

Abstract

backgroundDifficulty identifying patients in need of colorectal cancer (CRC) screening contributes to low screening rates.

objectiveTo use Electronic Health Record (EHR) data to identify patients with prior CRC testing.

designA clinical natural language processing (NLP) system was modified to identify 4 CRC tests (colonoscopy, flexible sigmoidoscopy, fecal occult blood testing, and double contrast barium enema) within electronic clinical documentation. Text phrases in clinical notes referencing CRC tests were interpreted by the system to determine whether testing was planned or completed and to estimate the date of completed tests.

settingLarge academic medical center. PATIENTS: 200 patients ≥ 50 years old who had completed ≥ 2 non-acute primary care visits within a 1-year period. MEASURES: Recall and precision of the NLP system, billing records, and human chart review were compared to a reference standard of human review of all available information sources.

resultsFor identification of all CRC tests, recall and precision were as follows: NLP system (recall 93%, precision 94%), chart review (74%, 98%), and billing records review (44%, 83%). Recall and precision for identification of patients in need of screening were: NLP system (recall 95%, precision 88%), chart review (99%, 82%), and billing records (99%, 67%). LIMITATIONS: Small sample size and requirement for a robust EHR.

conclusionsApplying NLP to EHR records detected more CRC tests than either manual chart review or billing records review alone. NLP had better precision but marginally lower recall to identify patients who were due for CRC screening than billing record review.

Indexed as

Natural Language ProcessingAcademic Medical CentersAgedAged, 80 and overColorectal NeoplasmsElectronic Health RecordsFemaleHumansMaleMass ScreeningMedical AuditMiddle AgedTennessee

Identifiers

PMID21393557
PMCPMC9616628

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.