Evidence map›Paper›PMID 27107450›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2017

Testing electronic health records in the "production" environment: an essential step in the journey to a safe and effective health care system.

Adam Wright, Skye Aaron, Dean F Sittig

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Five Strategies for a Safer EHR Modernization Journey.Journal of general internal medicine · 2023
    Article
  6. Applying requisite imagination to safeguard electronic health record transitions.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Smashing the strict hierarchy: three cases of clinical decision support malfunctions involving carvedilol.Journal of the American Medical Informatics Association : JAMIA · 2018
    Article
  16. Article
  17. Development and evaluation of a novel user interface for reviewing clinical microbiology results.Journal of the American Medical Informatics Association : JAMIA · 2018
    Article
  18. Article
  19. Clinical decision support alert malfunctions: analysis and empirically derived taxonomy.Journal of the American Medical Informatics Association : JAMIA · 2018
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Adam WrightBrigham and Women's Hospital, Boston, MA, USA awright@bwh.harvard.edu.
Skye AaronBrigham and Women's Hospital, Boston, MA, USA.
Dean F SittigUniversity of Texas Health Science Center, University of Texas, Houston, TX, USA.

Funding

Improving clinical decision support reliability using anomaly detection methodsR01LM011966 · NLM · VANDERBILT UNIVERSITY MEDICAL CENTER · PI WRIGHT, ADAM T · 2014 to 2017
$2.4M
NLM NIH HHS R01 LM011966
6 · The paper itself

Abstract

Thorough and ongoing testing of electronic health records (EHRs) is key to ensuring their safety and effectiveness. Many health care organizations limit testing to test environments separate from, and often different than, the production environment used by clinicians. Because EHRs are complex hardware and software systems that often interact with other hardware and software systems, no test environment can exactly mimic how the production environment will behave. An effective testing process must integrate safely conducted testing in the production environment itself, using test patients. We propose recommendations for how to safely incorporate testing in production into current EHR testing practices, with suggestions regarding the incremental release of upgrades, test patients, tester accounts, downstream personnel, and reporting.

Indexed as

Software ValidationElectronic Health RecordsHumansPatient SafetySoftwareelectronic health recordsqualitysafetysoftware testingtesting in production

Identifiers

PMID27107450
PMCPMC5201179

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.