Evidence map›Paper›PMID 23417341›Full record

ArticleWorld journal of urology2014

Extracting data from electronic medical records: validation of a natural language processing program to assess prostate biopsy results.

Anil A Thomas, Chengyi Zheng, Howard Jung, Allen Chang, Brian Kim, Joy Gelfond, Jeff Slezak, Kim Porter, Steven J Jacobsen, Gary W Chien

Abstract readComparative StudyValidation Study
PubMed Publisher
In one paragraph

Article in World journal of urology, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed, 1 pooled it
6.2field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 1 synthesis or guideline pooled it, 67 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. An overview and a roadmap for artificial intelligence in hematology and oncology.Journal of cancer research and clinical oncology · 2023
    Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Automatic mining of symptom severity from psychiatric evaluation notes.International journal of methods in psychiatric research · 2018
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 3 institutions in 1 country.

Anil A ThomasDepartment of Urology, Los Angeles Medical Center, Kaiser Permanente, 4900 Sunset Blvd, 2nd Floor, Los Angeles, CA, 90027, USA, anil.a.thomas@kp.org.
Chengyi Zheng
Howard Jung
Allen Chang
Brian Kim
Joy Gelfond
Jeff Slezak
Kim Porter
Steven J Jacobsen
Gary W Chien
Kaiser Permanente · USLos Angeles Medical Center · USKaiser Permanente West Los Angeles Medical Center · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveThe extraction of specific data from electronic medical records (EMR) remains tedious and is often performed manually. Natural language processing (NLP) programs have been developed to identify and extract information within clinical narrative text. We performed a study to assess the validity of an NLP program to accurately identify patients with prostate cancer and to retrieve pertinent pathologic information from their EMR. MATERIALS AND

methodsA retrospective review was performed of a prospectively collected database including patients from the Southern California Kaiser Permanente Medical Region that underwent prostate biopsies during a 2-week period. A NLP program was used to identify patients with prostate biopsies that were positive for prostatic adenocarcinoma from all pathology reports within this period. The application then processed 100 consecutive patients with prostate adenocarcinoma to extract 10 variables from their pathology reports. The extraction and retrieval of information by NLP was then compared to a blinded manual review.

resultsA consecutive series of 18,453 pathology reports were evaluated. NLP correctly detected 117 out of 118 patients (99.1%) with prostatic adenocarcinoma after TRUS-guided prostate biopsy. NLP had a positive predictive value of 99.1% with a 99.1% sensitivity and a 99.9% specificity to correctly identify patients with prostatic adenocarcinoma after biopsy. The overall ability of the NLP application to accurately extract variables from the pathology reports was 97.6%.

conclusionsNatural language processing is a reliable and accurate method to identify select patients and to extract relevant data from an existing EMR in order to establish a prospective clinical database.

Indexed as

Natural Language ProcessingAdenocarcinomaBiopsyCaliforniaCross-Sectional StudiesElectronic Health RecordsHumansInformation Storage and RetrievalMaleProstateProstatic NeoplasmsReproducibility of ResultsRetrospective StudiesSensitivity and Specificity

Identifiers

PMID23417341
OpenAlexW2082612446

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.