Evidence map›Paper›PMID 32228556›Full record

ArticleBMC medical informatics and decision making2020

Assessment of the impact of EHR heterogeneity for clinical research through a case study of silent brain infarction.

Sunyang Fu, Lester Y Leung, Anne-Olivia Raulli, David F Kallmes, Kristin A Kinsman, Kristoff B Nelson, Michael S Clark, Patrick H Luetmer, Paul R Kingsbury, David M Kent and 1 more

Open access · goldAbstract read
In one paragraph

Article in BMC medical informatics and decision making, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
33citing papers in PubMed, 1 pooled it
10.0field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

33 citing papers in PubMed, 1 synthesis or guideline pooled it, 52 citations in OpenAlex.

  1. Digital Health Data Quality Issues: Systematic Review.Journal of medical Internet research · 2023
    Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Observational
  10. A framework for understanding selection bias in real-world healthcare data.Journal of the Royal Statistical Society. Series A, (Statistics in Society) · 2024
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Review
  17. Article
  18. Article
  19. Article
  20. Gender-based Language Differences in Letters of Recommendation.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 3 institutions in 1 country.

Sunyang FuDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA.
Lester Y LeungDepartment of Neurology, Tufts Medical Center, Boston, MA, USA.
Anne-Olivia RaulliDepartment of Neurology, Tufts Medical Center, Boston, MA, USA.
David F KallmesDepartment of Radiology, Mayo Clinic, Rochester, MN, USA.
Kristin A KinsmanDepartment of Radiology, Mayo Clinic, Rochester, MN, USA.
Kristoff B NelsonDepartment of Neurology, Tufts Medical Center, Boston, MA, USA.
Michael S ClarkDepartment of Radiology, Mayo Clinic, Rochester, MN, USA.
Patrick H LuetmerDepartment of Radiology, Mayo Clinic, Rochester, MN, USA.
Paul R KingsburyDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA.
David M KentInstitute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, MA, USA.
Hongfang LiuDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, USA. liu.hongfang@mayo.edu.ORCID 0000-0003-2570-3741
Mayo Clinic in Arizona · USTufts Medical Center · USMayo Clinic in Florida · US

Funding

Open Health Natural Language Processing CollaboratoryU01TR002062 · NCATS · MAYO CLINIC ROCHESTER · PI JIANG, XIAOQIAN, LIU, HONGFANG · 2017 to 2021
$7.6M
Enabling Comparative Effectiveness Research in Silent Brain Infarction Through Natural Language Processing and Big DataR01NS102233 · NINDS · TUFTS MEDICAL CENTER · PI DAVID M KENT · 2017 to 2026
$3.4M
NCATS NIH HHS U01 TR002062NINDS NIH HHS R01 NS102233
6 · The paper itself

Abstract

backgroundThe rapid adoption of electronic health records (EHRs) holds great promise for advancing medicine through practice-based knowledge discovery. However, the validity of EHR-based clinical research is questionable due to poor research reproducibility caused by the heterogeneity and complexity of healthcare institutions and EHR systems, the cross-disciplinary nature of the research team, and the lack of standard processes and best practices for conducting EHR-based clinical research.

methodWe developed a data abstraction framework to standardize the process for multi-site EHR-based clinical studies aiming to enhance research reproducibility. The framework was implemented for a multi-site EHR-based research project, the ESPRESSO project, with the goal to identify individuals with silent brain infarctions (SBI) at Tufts Medical Center (TMC) and Mayo Clinic. The heterogeneity of healthcare institutions, EHR systems, documentation, and process variation in case identification was assessed quantitatively and qualitatively.

resultWe discovered a significant variation in the patient populations, neuroimaging reporting, EHR systems, and abstraction processes across the two sites. The prevalence of SBI for patients over age 50 for TMC and Mayo is 7.4 and 12.5% respectively. There is a variation regarding neuroimaging reporting where TMC are lengthy, standardized and descriptive while Mayo's reports are short and definitive with more textual variations. Furthermore, differences in the EHR system, technology infrastructure, and data collection process were identified.

conclusionThe implementation of the framework identified the institutional and process variations and the heterogeneity of EHRs across the sites participating in the case study. The experiment demonstrates the necessity to have a standardized process for data abstraction when conducting EHR-based clinical studies.

Indexed as

Brain InfarctionDelivery of Health CareAgedAged, 80 and overElectronic Health RecordsFemaleHumansMaleMiddle AgedReproducibility of ResultsResearchClinical research informaticsData qualityElectronic health recordsLearning health systemMulti-site studiesReproducibility

Identifiers

PMID32228556
PMCPMC7106829
OpenAlexW3013721505

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.