Evidence map›Paper›PMID 26911811›Full record

SynthesisJournal of the American Medical Informatics Association : JAMIA2016

Extracting information from the text of electronic medical records to improve case detection: a systematic review.

Elizabeth Ford, John A Carroll, Helen E Smith, Donia Scott, Jackie A Cassell

Abstract readSystematic Review
In one paragraph

Synthesis in Journal of the American Medical Informatics Association : JAMIA, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 191 papers, 8 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
191citing papers in PubMed, 8 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

191 citing papers in PubMed, 8 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Use of unstructured text in prognostic clinical prediction models: a systematic review.Journal of the American Medical Informatics Association : JAMIA · 2022
    Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

131 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Elizabeth FordDivision of Primary Care and Public Health, Brighton and Sussex Medical School, Brighton, UK e.m.ford@bsms.ac.uk.
John A CarrollDepartment of Informatics, University of Sussex, Brighton, UK.
Helen E SmithDivision of Primary Care and Public Health, Brighton and Sussex Medical School, Brighton, UK.
Donia ScottDepartment of Informatics, University of Sussex, Brighton, UK.
Jackie A CassellDivision of Primary Care and Public Health, Brighton and Sussex Medical School, Brighton, UK.

Funding

Medical Research Council MR/K006525/1Wellcome Trust 086105/Z/08/Z
6 · The paper itself

Abstract

backgroundElectronic medical records (EMRs) are revolutionizing health-related research. One key issue for study quality is the accurate identification of patients with the condition of interest. Information in EMRs can be entered as structured codes or unstructured free text. The majority of research studies have used only coded parts of EMRs for case-detection, which may bias findings, miss cases, and reduce study quality. This review examines whether incorporating information from text into case-detection algorithms can improve research quality.

methodsA systematic search returned 9659 papers, 67 of which reported on the extraction of information from free text of EMRs with the stated purpose of detecting cases of a named clinical condition. Methods for extracting information from text and the technical accuracy of case-detection algorithms were reviewed.

resultsStudies mainly used US hospital-based EMRs, and extracted information from text for 41 conditions using keyword searches, rule-based algorithms, and machine learning methods. There was no clear difference in case-detection algorithm accuracy between rule-based and machine learning methods of extraction. Inclusion of information from text resulted in a significant improvement in algorithm sensitivity and area under the receiver operating characteristic in comparison to codes alone (median sensitivity 78% (codes + text) vs 62% (codes), P = .03; median area under the receiver operating characteristic 95% (codes + text) vs 88% (codes), P = .025).

conclusionsText in EMRs is accessible, especially with open source information extraction algorithms, and significantly improves case detection when combined with codes. More harmonization of reporting within EMR studies is needed, particularly standardized reporting of algorithm accuracy metrics like positive predictive value (precision) and sensitivity (recall).

Indexed as

AlgorithmsElectronic Health RecordsInformation Storage and RetrievalData MiningDiagnosisHumansMachine LearningNatural Language ProcessingSensitivity and Specificitycase detectiondata qualityelectronic health recordsreviewtext mining

Identifiers

PMID26911811
PMCPMC4997034

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.