Evidence map›Paper›PMID 25848606›Full record

ArticleEGEMS (Washington, DC)2014

Achieving and sustaining automated health data linkages for learning systems: barriers and solutions.

Erik G Van Eaton, Allison B Devlin, Emily Beth Devine, David R Flum, Peter Tarczy-Hornoch

Abstract read
In one paragraph

Article in EGEMS (Washington, DC), 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Observational
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Pragmatic (trial) informatics: a perspective from the NIH Health Care Systems Research Collaboratory.Journal of the American Medical Informatics Association : JAMIA · 2017
    Article
  9. Characterizing Secondary Use of Clinical Data.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2015
    Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Erik G Van EatonUniversity of Washington.
Allison B DevlinUniversity of Washington.
Emily Beth DevineUniversity of Washington.
David R FlumUniversity of Washington.
Peter Tarczy-HornochUniversity of Washington.

Funding

Transform Dissemination and Implementation Science in CTSA ProgramsUL1TR002319 · NCATS · UNIVERSITY OF WASHINGTON · PI John K. Amory · 2017 to 2026
$100.0M
Institute of Translational Health SciencesUL1TR000423 · NCATS · UNIVERSITY OF WASHINGTON · PI DISIS, MARY L. · 2012 to 2016
$49.4M
Surgical Care and Outcomes Assessment Program Comparative Effectiveness ResearchR01HS020025 · AHRQ · UNIVERSITY OF WASHINGTON · PI FLUM, DAVID R · 2010 to 2010
$10.8M
AHRQ HHS R01 HS020025NCATS NIH HHS UL1 TR000423NCATS NIH HHS UL1 TR002319
6 · The paper itself

Abstract

introductionDelivering more appropriate, safer, and highly effective health care is the goal of a learning health care system. The Agency for Healthcare Research and Quality (AHRQ) funded enhanced registry projects: (1) to create and analyze valid data for comparative effectiveness research (CER); and (2) to enhance the ability to monitor and advance clinical quality improvement (QI). This case report describes barriers and solutions from one state-wide enhanced registry project.

methodsThe Comparative Effectiveness Research and Translation Network (CERTAIN) deployed the commercially available Amalga Unified Intelligence System™ (Amalga) as a central data repository to enhance an existing QI registry (the Automation Project). An eight-step implementation process included hospital recruitment, technical electronic health record (EHR) review, hospital-specific interface planning, data ingestion, and validation. Data ownership and security protocols were established, along with formal methods to separate data management for QI purposes and research purposes. Sustainability would come from lowered chart review costs and the hospital's desire to invest in the infrastructure after trying it.

findingsCERTAIN approached 19 hospitals in Washington State operating within 12 unaffiliated health care systems for the Automation Project. Five of the 19 completed all implementation steps. Four hospitals did not participate due to lack of perceived institutional value. Ten hospitals did not participate because their information technology (IT) departments were oversubscribed (e.g., too busy with Meaningful Use upgrades). One organization representing 22 additional hospitals expressed interest, but was unable to overcome data governance barriers in time. Questions about data use for QI versus research were resolved in a widely adopted project framework. Hospitals restricted data delivery to a subset of patients, introducing substantial technical challenges. Overcoming challenges of idiosyncratic EHR implementations required each hospital to devote more IT resources than were predicted. Cost savings did not meet projections because of the increased IT resource requirements and a different source of lowered chart review costs. DISCUSSION: CERTAIN succeeded in recruiting unaffiliated hospitals into the Automation Project to create an enhanced registry to achieve AHRQ goals. This case report describes several distinct barriers to central data aggregation for QI and CER across unaffiliated hospitals: (1) competition for limited on-site IT expertise, (2) concerns about data use for QI versus research, (3) restrictions on data automation to a defined subset of patients, and (4) unpredictable resource needs because of idiosyncrasies among unaffiliated hospitals in how EHR data are coded, stored, and made available for transmission-even between hospitals using the same vendor's EHR. Therefore, even a fully optimized automation infrastructure would still not achieve complete automation. The Automation Project was unable to align sufficiently with internal hospital objectives, so it could not show a compelling case for sustainability.

Indexed as

CERTAINInformaticsQuality ImprovementResearch NetworksSustainability

Identifiers

PMID25848606
PMCPMC4371442

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.