Evidence map›Paper›PMID 23774517›Full record

ArticleMedical care2013

Caveats for the use of operational electronic health record data in comparative effectiveness research.

William R Hersh, Mark G Weiner, Peter J Embi, Judith R Logan, Philip R O Payne, Elmer V Bernstam, Harold P Lehmann, George Hripcsak, Timothy H Hartzog, James J Cimino and 1 more

Abstract read
In one paragraph

Article in Medical care, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 337 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
337citing papers in PubMed, 7 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

337 citing papers in PubMed, 7 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Artificial Intelligence and Suicide Prevention: A Systematic Review of Machine Learning Investigations.International journal of environmental research and public health · 2020
    Pooled it
  6. Pooled it
  7. Pooled it
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

277 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

William R HershDepartment of Medical Informatics & Clinical Epidemiology, Oregon Health & Science University, Portland, OR 97239, USA. hersh@ohsu.edu
Mark G Weiner
Peter J Embi
Judith R Logan
Philip R O Payne
Elmer V Bernstam
Harold P Lehmann
George Hripcsak
Timothy H Hartzog
James J Cimino
Joel H Saltz

Funding

Institute for Clinical and Translational Research (UL1)UL1RR025005 · NCRR · JOHNS HOPKINS UNIVERSITY · PI FORD, DANIEL ERNEST · 2007 to 2011
$75.8M
OREGON CLINICAL AND TRANSLATIONAL SCIENCE INSTITUTEUL1RR024140 · NCRR · OREGON HEALTH & SCIENCE UNIVERSITY · PI ORWOLL, ERIC S. · 2006 to 2011
$61.1M
CTSA INFRASTRUCTURE FOR PEDIATRIC RESEARCHUL1RR024156 · NCRR · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI GINSBERG, HENRY N · 2006 to 2011
$53.0M
CTSA INFRASTRUCTURE FOR PEDIATRIC RESEARCHUL1RR025008 · NCRR · EMORY UNIVERSITY · PI STEPHENS, DAVID S · 2007 to 2011
$29.0M
U OF TEXAS HLTH SCI CTR HOUSTON CENTER FOR CLINICAL AND TRANSLATIONAL SCIENCESUL1RR024148 · NCRR · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI MCPHERSON, DAVID D · 2006 to 2010
$27.9M
Atlanta Clinical and Translational Science Institute (ACTSI) RenewalUL1TR000454 · NCATS · EMORY UNIVERSITY · PI STEPHENS, DAVID S · 2012 to 2016
$25.8M
The Ohio State University Center for Clinical and Translational Science (UL1)UL1TR000090 · NCATS · OHIO STATE UNIVERSITY · PI JACKSON, REBECCA D · 2012 to 2013
$7.9M
Biomedical Translational Research Information System (BTRIS) Data Reuse ProtocolZIACL000904 · CLC · CLINICAL CENTER · PI CIMINO, JAMES · 2009 to 2014
$0k
Intramural NIH HHSNCATS NIH HHS 8UL1TR000090NCATS NIH HHS UL1 TR000090NCATS NIH HHS UL1 TR000454NCRR NIH HHS 1UL1RR024148NCRR NIH HHS 2UL1RR024156NCRR NIH HHS 5UL1RR024140NCRR NIH HHS 5UL1RR025005NCRR NIH HHS 5UL1RR025008NCRR NIH HHS UL1 RR024140NCRR NIH HHS UL1 RR024148NCRR NIH HHS UL1 RR024156NCRR NIH HHS UL1 RR025005NCRR NIH HHS UL1 RR025008
6 · The paper itself

Abstract

The growing amount of data in operational electronic health record systems provides unprecedented opportunity for its reuse for many tasks, including comparative effectiveness research. However, there are many caveats to the use of such data. Electronic health record data from clinical settings may be inaccurate, incomplete, transformed in ways that undermine their meaning, unrecoverable for research, of unknown provenance, of insufficient granularity, and incompatible with research protocols. However, the quantity and real-world nature of these data provide impetus for their use, and we develop a list of caveats to inform would-be users of such data as well as provide an informatics roadmap that aims to insure this opportunity to augment comparative effectiveness research can be best leveraged.

Indexed as

Comparative Effectiveness ResearchData CollectionData Interpretation, StatisticalElectronic Health RecordsHumansInsurance Claim ReviewResearch Design

Identifiers

PMID23774517
PMCPMC3748381

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.