Evidence map›Paper›PMID 30925587›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2019

A federated EHR network data completeness tracking system.

Hossein Estiri, Jeffrey G Klann, Sarah R Weiler, Ernest Alema-Mensah, R Joseph Applegate, Galina Lozinski, Nandan Patibandla, Kun Wei, William G Adams, Marc D Natter and 7 more

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors.

Hossein EstiriLaboratory of Computer Science, Massachusetts General Hospital, Boston, Massachusetts, USA.
Jeffrey G KlannLaboratory of Computer Science, Massachusetts General Hospital, Boston, Massachusetts, USA.
Sarah R WeilerHarvard Medical School, Boston, Massachusetts, USA.
Ernest Alema-MensahMorehouse School of Medicine, Atlanta, Georgia, USA.
R Joseph ApplegateSchool of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, Texas, USA.
Galina LozinskiBoston University School of Medicine/Boston Medical Center, Boston, Massachusetts, USA.
Nandan PatibandlaInformation Services Department, Boston Children's Hospital, Boston, Massachusetts, USA.
Kun WeiWake Forest School of Medicine, Winston-Salem, North Carolina, USA.
William G AdamsDepartment of Pediatrics, Boston University School of Medicine/Boston Medical Center, Boston, Massachusetts, USA.
Marc D NatterComputational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts, USA.
Elizabeth O OfiliMorehouse School of Medicine, Atlanta, Georgia, USA.
Brian OstasiewskiWake Forest School of Medicine, Winston-Salem, North Carolina, USA.
Alexander QuarshieMorehouse School of Medicine, Atlanta, Georgia, USA.
Gary E RosenthalDepartment of Internal Medicine, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA.
Elmer V BernstamSchool of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, Texas, USA.
Kenneth D MandlComputational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts, USA.
Shawn N MurphyLaboratory of Computer Science, Massachusetts General Hospital, Boston, Massachusetts, USA.

Funding

University of Pittsburgh Clinical and Translational Science InstituteUL1TR001857 · NCATS · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI REIS, STEVEN E · 2016 to 2025
$129.3M
Implementing a Maternal health and PRegnancy Outcomes Vision for Everyone (IMPROVE)UL1TR002378 · NCATS · EMORY UNIVERSITY · PI Andres J Garcia, Elizabeth O. Ofili · 2017 to 2026
$92.1M
Research Desogn and Biostatistics CoreU54MD007588 · NIMHD · MOREHOUSE SCHOOL OF MEDICINE · PI MONTGOMERY-RICE, VALERIE C. · 2012 to 2018
$24.8M
UT Southwestern Center for Translational Medicine (UL1/KL2/TL1)UL1TR001105 · NCATS · UT SOUTHWESTERN MEDICAL CENTER · PI TOTO, ROBERT DANIEL · 2013 to 2017
$24.5M
STEERING COMMITTEEU54MD008149 · NIMHD · MOREHOUSE SCHOOL OF MEDICINE · PI OFILI, ELIZABETH O. · 2012 to 2018
$21.1M
Finding Genomic Profiles of COVID-19 Phenotypes from the EHRU01HG008685 · NHGRI · BRIGHAM AND WOMEN'S HOSPITAL · PI ELIZABETH W KARLSON, Matthew S Lebo · 2015 to 2026
$13.6M
TCC for Health Disparties: Informing & Influencing Health Policy and PracticeU54MD008173 · NIMHD · MOREHOUSE SCHOOL OF MEDICINE · PI SATCHER, DAVID · 2012 to 2016
$13.4M
Center for Clinical and Translational Sciences (CCTS)UL1TR000371 · NCATS · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI MCPHERSON, DAVID D · 2012 to 2016
$13.4M
Renewal Application for Clinical Research Education and Career Development (CRECDR25MD007589 · NIMHD · MOREHOUSE SCHOOL OF MEDICINE · PI PRISCILLA E PEMU, Alexander Quarshie · 2012 to 2026
$5.4M
Harnessing the power of CTSA-CDRN data networks: Using social determinants of health, frailty and functional status to identify at-risk patients and improve risk adjustmentU01TR002393 · NCATS · UNIVERSITY OF TEXAS HLTH SCIENCE CENTER · PI SHIREMAN, PAULA K · 2018 to 2021
$3.1M
Developing i2b2 into a Health Innovation Platform for Clinical Decision Support in the Genomics EraR01HG009174 · NHGRI · MASSACHUSETTS GENERAL HOSPITAL · PI ARONSON, SAMUEL JEFFREY, MACRAE, CALUM A. · 2016 to 2019
$2.9M
Patient Medical History Representation, Extraction, and Inference from EHR DataR01LM011829 · NLM · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI TAO, CUI · 2014 to 2018
$1.7M
NCATS NIH HHS U01 TR002393NCATS NIH HHS UL1 TR000371NCATS NIH HHS UL1 TR001105NCATS NIH HHS UL1 TR001857NCATS NIH HHS UL1 TR002378NHGRI NIH HHS R01 HG009174NHGRI NIH HHS U01 HG008685NIMHD NIH HHS R25 MD007589NIMHD NIH HHS U54 MD007588NIMHD NIH HHS U54 MD008149NIMHD NIH HHS U54 MD008173NLM NIH HHS R01 LM011829
6 · The paper itself

Abstract

objectiveThe study sought to design, pilot, and evaluate a federated data completeness tracking system (CTX) for assessing completeness in research data extracted from electronic health record data across the Accessible Research Commons for Health (ARCH) Clinical Data Research Network. MATERIALS AND

methodsThe CTX applies a systems-based approach to design workflow and technology for assessing completeness across distributed electronic health record data repositories participating in a queryable, federated network. The CTX invokes 2 positive feedback loops that utilize open source tools (DQe-c and Vue) to integrate technology and human actors in a system geared for increasing capacity and taking action. A pilot implementation of the system involved 6 ARCH partner sites between January 2017 and May 2018.

resultsThe ARCH CTX has enabled the network to monitor and, if needed, adjust its data management processes to maintain complete datasets for secondary use. The system allows the network and its partner sites to profile data completeness both at the network and partner site levels. Interactive visualizations presenting the current state of completeness in the context of the entire network as well as changes in completeness across time were valued among the CTX user base. DISCUSSION: Distributed clinical data networks are complex systems. Top-down approaches that solely rely on technology to report data completeness may be necessary but not sufficient for improving completeness (and quality) of data in large-scale clinical data networks. Improving and maintaining complete (high-quality) data in such complex environments entails sociotechnical systems that exploit technology and empower human actors to engage in the process of high-quality data curating.

conclusionsThe CTX has increased the network's capacity to rapidly identify data completeness issues and empowered ARCH partner sites to get involved in improving the completeness of respective data in their repositories.

Indexed as

Data AccuracyData ManagementElectronic Health RecordsComputer Communication NetworksHumansdata completenessdata qualityelectronic health recordssystems thinking

Identifiers

PMID30925587
PMCPMC6586954

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.