Evidence map›Paper›PMID 39504136›Full record

ArticleJMIR medical informatics2024

Electronic Health Record Data Quality and Performance Assessments: Scoping Review.

Yordan P Penev, Timothy R Buchanan, Matthew M Ruppert, Michelle Liu, Ramin Shekouhi, Ziyuan Guan, Jeremy Balch, Tezcan Ozrazgat-Baslanti, Benjamin Shickel, Tyler J Loftus and 1 more

Abstract readScoping Review
In one paragraph

Article in JMIR medical informatics, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Review
  2. Article
  3. Review
  4. Article
  5. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Yordan P PenevDepartment of Medicine, University of Florida, Gainesville, Florida, United States.ORCID 0000-0001-8520-9417
Timothy R BuchananDepartment of Medicine, University of Florida, Gainesville, Florida, United States.ORCID 0009-0002-7815-7967
Matthew M RuppertDepartment of Medicine, University of Florida, Gainesville, Florida, United States.ORCID 0000-0001-9757-4454
Michelle LiuDepartment of Medicine, University of Florida, Gainesville, Florida, United States.ORCID 0009-0000-2938-9900
Ramin ShekouhiDepartment of Medicine, University of Florida, Gainesville, Florida, United States.ORCID 0000-0002-3784-5280
Ziyuan GuanDepartment of Medicine, University of Florida, Gainesville, Florida, United States.ORCID 0009-0009-4824-6927
Jeremy BalchDepartment of Surgery, University of Florida, Gainesville, Florida, United States.ORCID 0000-0002-1826-7884
Tezcan Ozrazgat-BaslantiDepartment of Medicine, University of Florida, Gainesville, Florida, United States.ORCID 0000-0002-1158-9928
Benjamin ShickelDepartment of Medicine, University of Florida, Gainesville, Florida, United States.ORCID 0000-0002-5304-7027
Tyler J LoftusIntelligent Clinical Care Center, University of Florida, Gainesville, Florida, United States.ORCID 0000-0001-5354-443X
Azra BihoracIntelligent Clinical Care Center, University of Florida, Gainesville, Florida, United States.ORCID 0000-0002-5745-2863

Funding

Using social networks to map and evaluate team science across CTSA hubsUL1TR001427 · NCATS · UNIVERSITY OF FLORIDA · PI MITCHELL, DUANE A. · 2015 to 2024
$37.2M
Bridge2AI: Patient-Focused Collaborative Hospital Repository Uniting Standards (CHoRUS) for Equitable AIOT2OD032701 · OD · MASSACHUSETTS GENERAL HOSPITAL · PI BIHORAC, AZRA, CLERMONT, GILLES · 2022 to 2025
$24.6M
Integrating data, algorithms and clinical reasoning for surgical risk assessmentR01GM110240 · NIGMS · UNIVERSITY OF FLORIDA · PI BIHORAC, AZRA, RASHIDI, PARISA · 2016 to 2025
$5.1M
Molecular Biology in Burns and TraumaT32GM008721 · NIGMS · UNIVERSITY OF FLORIDA · PI Philip A Efron · 1999 to 2026
$5.0M
15/24- Healthy Brain and Child Development National ConsortiumU01DA055358 · NIDA · UNIVERSITY OF FLORIDA · PI GURKA, KELLY K., SCOTT, LISA S. · 2021 to 2023
$3.7M
(MEnD-AKI) Multicenter Implementation of an Electronic Decision Support System for Drug-associated AKIR01DK121730 · NIDDK · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI BIHORAC, AZRA, KANE-GILL, SANDRA L · 2021 to 2025
$3.2M
ADAPT: Autonomous Delirium Monitoring and Adaptive PreventionR01NS120924 · NINDS · UNIVERSITY OF FLORIDA · PI BIHORAC, AZRA, RASHIDI, PARISA · 2021 to 2025
$2.9M
Intelligent Intensive Care Unit (I2CU): Pervasive Sensing and Artificial Intelligence for Augmented Clinical Decision-makingR01EB029699 · NIBIB · UNIVERSITY OF FLORIDA · PI BIHORAC, AZRA, RASHIDI, PARISA · 2021 to 2024
$2.4M
Aligning Patient Acuity with Resource Intensity after Major SurgeryR01GM149657 · NIGMS · UNIVERSITY OF FLORIDA · PI Tyler J Loftus · 2023 to 2026
$1.3M
Development and Validation of Computational Algorithms to Assess Kidney Health in Electronic Health RecordsK01DK120784 · NIDDK · UNIVERSITY OF FLORIDA · PI OZRAZGAT BASLANTI, TEZCAN · 2020 to 2023
$580k
NCATS NIH HHS UL1 TR001427NIBIB NIH HHS R01 EB029699NIDA NIH HHS U01 DA055358NIDDK NIH HHS K01 DK120784NIDDK NIH HHS R01 DK121730NIGMS NIH HHS R01 GM110240NIGMS NIH HHS R01 GM149657NIGMS NIH HHS T32 GM008721NIH HHS OT2 OD032701NINDS NIH HHS R01 NS120924
6 · The paper itself

Abstract

Background: Electronic health records (EHRs) have an enormous potential to advance medical research and practice through easily accessible and interpretable EHR-derived databases. Attainability of this potential is limited by issues with data quality (DQ) and performance assessment. Objective: This review aims to streamline the current best practices on EHR DQ and performance assessments as a replicable standard for researchers in the field. Methods: PubMed was systematically searched for original research articles assessing EHR DQ and performance from inception until May 7, 2023. Results: Our search yielded 26 original research articles. Most articles had 1 or more significant limitations, including incomplete or inconsistent reporting (n=6, 30%), poor replicability (n=5, 25%), and limited generalizability of results (n=5, 25%). Completeness (n=21, 81%), conformance (n=18, 69%), and plausibility (n=16, 62%) were the most cited indicators of DQ, while correctness or accuracy (n=14, 54%) was most cited for data performance, with context-specific supplementation by recency (n=7, 27%), fairness (n=6, 23%), stability (n=4, 15%), and shareability (n=2, 8%) assessments. Artificial intelligence-based techniques, including natural language data extraction, data imputation, and fairness algorithms, were demonstrated to play a rising role in improving both dataset quality and performance. Conclusions: This review highlights the need for incentivizing DQ and performance assessments and their standardization. The results suggest the usefulness of artificial intelligence-based techniques for enhancing DQ and performance to unlock the full potential of EHRs to improve medical research and practice.

Indexed as

Data AccuracyElectronic Health Recordsclinical informaticsdata performancedata qualitydata scienceEHRelectronic health recordperformancerecordreview methodologyreview methodsscopingsearchsynthesis

Identifiers

PMID39504136
PMCPMC11559435

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.