Evidence map›Paper›PMID 25821838›Full record

ArticleEGEMS (Washington, DC)2014

How the provenance of electronic health record data matters for research: a case example using system mapping.

Karin E Johnson, Aruna Kamineni, Sharon Fuller, Danielle Olmstead, Karen J Wernli

Abstract read
In one paragraph

Article in EGEMS (Washington, DC), 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Population-Based Registry Linkages to Improve Validity of Electronic Health Record-Based Cancer Research.Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology · 2020
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. A conceptual framework for evaluating data suitability for observational studies.Journal of the American Medical Informatics Association : JAMIA · 2018
    Article
  16. Article
  17. Finding "truth" across different data sources.Israel journal of health policy research · 2017
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Karin E JohnsonGroup Health Research Institute.
Aruna KamineniGroup Health Research Institute.
Sharon FullerGroup Health Research Institute.
Danielle OlmsteadGroup Health Research Institute.
Karen J WernliGroup Health Research Institute.

Funding

Studying Colorectal Cancer Effectiveness of Screening Strategies (SuCCESS)U54CA163261 · NCI · KAISER FOUNDATION RESEARCH INSTITUTE · PI CHUBAK, JESSICA · 2011 to 2017
$7.3M
AcademyHealth Electronic Data Methods (EDM) Forum for Comparative Effectiveness RU13HS019564 · AHRQ · ACADEMYHEALTH · PI HOLVE, ERIN C · 2010 to 2010
$3.9M
AHRQ HHS U13 HS019564NCI NIH HHS U54 CA163261
6 · The paper itself

Abstract

introductionThe use of electronic health records (EHRs) for research is proceeding rapidly, driven by computational power, analytical techniques, and policy. However, EHR-based research is limited by the complexity of EHR data and a lack of understanding about data provenance, meaning the context under which the data were collected. This paper presents system flow mapping as a method to help researchers more fully understand the provenance of their EHR data as it relates to local workflow. We provide two specific examples of how this method can improve data identification, documentation, and processing.

backgroundEHRs store clinical and administrative data, often in unstructured fields. Each clinical system has a unique and dynamic workflow, as well as an EHR customized for local use. The EHR customization may be influenced by a broader context such as documentation required for billing.

methodsWe present a case study with two examples of using system flow mapping to characterize EHR data for a local colorectal cancer screening process.

findingsSystem flow mapping demonstrated that information entered into the EHR during clinical practice required interpretation and transformation before it could be accurately applied to research. We illustrate how system flow mapping shaped our knowledge of the quality and completeness of data in two examples: (1) determining colonoscopy indication as recorded in the EHR, and (2) discovering a specific EHR form that captured family history. DISCUSSION: Researchers who do not consider data provenance risk compiling data that are systematically incomplete or incorrect. For example, researchers who are not familiar with the clinical workflow under which data were entered might miss or misunderstand patient information or procedure and diagnostic codes.

conclusionsData provenance is a fundamental characteristic of research data from EHRs. Given the diversity of EHR platforms and system workflows, researchers need tools for evaluating and reporting data availability, quality, and transformations. Our case study illustrates how system mapping can inform researchers about the provenance of their data as it pertains to local workflows.

Indexed as

ContextData Use and QualityHealth Information Technology

Identifiers

PMID25821838
PMCPMC4371416

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.