Evidence map›Paper›PMID 27130217›Full record

ArticleBMC pediatrics2016

Quality of EHR data extractions for studies of preterm birth in a tertiary care center: guidelines for obtaining reliable data.

Lindsey A Knake, Monika Ahuja, Erin L McDonald, Kelli K Ryckman, Nancy Weathers, Todd Burstain, John M Dagle, Jeffrey C Murray, Prakash Nadkarni

Open access · goldAbstract readComparative Study
In one paragraph

Article in BMC pediatrics, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed, 2 pooled it
6.9field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed, 2 syntheses or guidelines pooled it, 46 citations in OpenAlex.

  1. Electronic health record data quality assessment and tools: a systematic review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Pooled it
  2. Digital Health Data Quality Issues: Systematic Review.Journal of medical Internet research · 2023
    Pooled it
  3. Article
  4. Article
  5. A Standardized Guideline for Assessing Extracted Electronic Health Records Cohorts: A Scoping Review.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2025
    Article
  6. Article
  7. The validity of hospital diagnostic and procedure codes reflecting morbidity in preterm neonates born <32 weeks gestation.Journal of perinatology : official journal of the California Perinatal Association · 2023
    Article
  8. Article
  9. Article
  10. Comparison of electronic versus manual abstraction for 2 standardized perinatal care measures.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
  11. Article
  12. Observational
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Data electronically extracted from the electronic health record require validation.Journal of perinatology : official journal of the California Perinatal Association · 2019
    Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 2 institutions in 1 country.

Lindsey A KnakeDepartment of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA, 52240, USA.
Monika AhujaInstitue for Clinical and Translational Science, University of Iowa, Iowa City, IA, USA.
Erin L McDonaldDepartment of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA, 52240, USA.
Kelli K RyckmanDepartment of Epidemiology, University of Iowa, Iowa City, IA, USA.
Nancy WeathersDepartment of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA, 52240, USA.
Todd BurstainInstitue for Clinical and Translational Science, University of Iowa, Iowa City, IA, USA.
John M DagleDepartment of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA, 52240, USA.
Jeffrey C MurrayDepartment of Pediatrics, University of Iowa Hospitals and Clinics, 200 Hawkins Drive, 276 MRF, Iowa City, IA, 52240, USA.
Prakash NadkarniInstitue for Clinical and Translational Science, University of Iowa, Iowa City, IA, USA. prakash-nadkarni@uiowa.edu.
University of Iowa Hospitals and Clinics · USUniversity of Iowa · US

Funding

UNIVERSITY OF IOWA CTSA FOR PEDIATRIC RESEARCHUL1RR024979 · NCRR · UNIVERSITY OF IOWA · PI ROSENTHAL, GARY E · 2007 to 2011
$31.8M
SHORT-TERM TRAINING: STUDENTS IN HEALTH PROF. SCHOOLST35HL007485 · NHLBI · UNIVERSITY OF IOWA · PI ROGHAIR, ROBERT D · 1985 to 2019
$4.3M
University of Iowa Institute for Clinical and Translational ScienceU54TR001013 · NCATS · UNIVERSITY OF IOWA · PI ROSENTHAL, GARY E · 2014 to 2014
$4.2M
Iowa Medical Student Summer Research Program in trans-NIDDK ResearchT35DK135446 · NIDDK · UNIVERSITY OF IOWA · PI ROBERT D ROGHAIR · 2023 to 2026
$418k
NCATS NIH HHS U54 TR001013NCRR NIH HHS UL1 RR024979NHLBI NIH HHS T35 HL007485NIDDK NIH HHS T35 DK135446
6 · The paper itself

Abstract

backgroundThe use of Electronic Health Records (EHR) has increased significantly in the past 15 years. This study compares electronic vs. manual data abstractions from an EHR for accuracy. While the dataset is limited to preterm birth data, our work is generally applicable. We enumerate challenges to reliable extraction, and state guidelines to maximize reliability.

methodsAn Epic™ EHR data extraction of structured data values from 1,772 neonatal records born between the years 2001-2011 was performed. The data were directly compared to a manually-abstracted database. Specific data values important to studies of perinatology were chosen to compare discrepancies between the two databases.

resultsDiscrepancy rates between the EHR extraction and the manual database were calculated for gestational age in weeks (2.6 %), birthweight (9.7 %), first white blood cell count (3.2 %), initial hemoglobin (11.9 %), peak total and direct bilirubin (11.4 % and 4.9 %), and patent ductus arteriosus (PDA) diagnosis (12.8 %). Using the discrepancies, errors were quantified in both datasets using chart review. The EHR extraction errors were significantly fewer than manual abstraction errors for PDA and laboratory values excluding neonates transferred from outside hospitals, but significantly greater for birth weight. Reasons for the observed errors are discussed.

conclusionsWe show that an EHR not modified specifically for research purposes had discrepancy ranges comparable to a manually created database. We offer guidelines to minimize EHR extraction errors in future study designs. As EHRs become more research-friendly, electronic chart extractions should be more efficient and have lower error rates compared to manual abstractions.

Indexed as

Data AccuracyInfant, PrematurePremature BirthDatabases, FactualElectronic Health RecordsFemaleHumansInfant, NewbornInfant, Premature, DiseasesMalePregnancyTertiary Care CentersBioinformaticsData qualityEHR and manual chart abstraction comparisonEHR vs. Manual chart abstraction, and difference in data qualityNeonatologyPEDs data registryPrematurityQuality assurance

Identifiers

PMID27130217
PMCPMC4851819
OpenAlexW2345088727

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.