Evidence map›Paper›PMID 30208496›Full record

ArticleApplied clinical informatics2018

A Heuristic Evaluation to Assess Use of After Visit Summaries for Supporting Continuity of Care.

Patrice Tremoulet, Ramya Krishnan, Dean Karavite, Naveen Muthu, Susan Harkness Regli, Amy Will, Jeremy Michel

Open access · bronzeAbstract read
In one paragraph

Article in Applied clinical informatics, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
2.1field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 11 citations in OpenAlex.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 5 institutions in 1 country.

Patrice TremouletHealth Devices Department, ECRI Institute, Plymouth Meeting, Pennsylvania, United States.
Ramya KrishnanHealth Devices Department, ECRI Institute, Plymouth Meeting, Pennsylvania, United States.
Dean KaraviteDepartment of Biomedical and Health Informatics, The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, United States.
Naveen MuthuDepartment of Biomedical and Health Informatics, The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, United States.
Susan Harkness RegliDepartment of Clinical Effectiveness and Quality Improvement, University of Pennsylvania Health System, Philadelphia, Pennsylvania, United States.
Amy WillNational Center for Human Factors in Healthcare, MedStar Health, Washington, District of Columbia, United States.
Jeremy MichelDepartment of Biomedical and Health Informatics, The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, United States.
ECRI Institute · USUniversity of Pennsylvania · USChildren's Hospital of Philadelphia · USMedStar Health · USUniversity of Pennsylvania Health System · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundOutpatient providers often do not receive discharge summaries from acute care providers prior to follow-up visits. These outpatient providers may use the after-visit summaries (AVS) that are given to patients to obtain clinical information. It is unclear how effectively AVS support care coordination between clinicians.

objectivesGoals for this effort include: (1) developing usability heuristics that may be applied both for assessment and to guide generation of medical documents in general, (2) conducting a heuristic evaluation to assess the use of AVS for communication between clinicians, and (3) providing recommendations for generating AVS that effectively support both patient/caregiver use and care coordination.

methodsWe created a 17-item heuristic evaluation instrument for assessing usability of medical documents. Eight experts used the instrument to assess each of four simulated AVS. The simulations were created using examples from two hospitals and two pediatric patient cases developed by the National Institute of Standards and Technology.

resultsExperts identified 224 unique usability problems ranging in severity from mild to catastrophic. Content issues (e.g., missing medical history, marital status of a 2-year-old) were rated as most severe, but widespread formatting and structural problems (e.g., inconsistent indentation, fonts, and headings; confusing ordering of information) were so distracting that they significantly reduced readers' ability to efficiently use the documents. Overall, issues in the AVS from Hospital 2 were more severe than those in the AVS from Hospital 1.

conclusionThe new instrument allowed for quick, inexpensive evaluations of AVS. Usability issues such as unnecessary information, poor organization, missing information, and inconsistent formatting make it hard for patients, caregivers, and clinicians to use the AVS. The heuristics in the new instrument may be used as guidance to adapt electronic health record systems so that they generate more useful and usable medical documents.

Indexed as

Continuity of Patient CareElectronic Health RecordsHeuristicsAmbulatory CareDocumentationHumansOutpatients

Identifiers

PMID30208496
PMCPMC6135642
OpenAlexW2891194425

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.