Evidence map›Paper›PMID 31964414›Full record

ArticleImplementation science : IS2020

Designing clinical practice feedback reports: three steps illustrated in Veterans Health Affairs long-term care facilities and programs.

Zach Landis-Lewis, Jennifer Kononowech, Winifred J Scott, Robert V Hogikyan, Joan G Carpenter, V S Periyakoil, Susan C Miller, Cari Levy, Mary Ersek, Anne Sales

Registry-linked trialAbstract read
In one paragraph

Article in Implementation science : IS, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06027593 (Using Electronically Derived AutoMated RePOrts of Appropriate Antibiotic Use to Inform SteWardship IntERventions), which is not on this map. Cited by 20 papers.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06027593 nacompletednot on this mapstarted 2022, after this paper: background citation

Using Electronically Derived AutoMated RePOrts of Appropriate Antibiotic Use to Inform SteWardship IntERventions

TypeinterventionalSponsorChildren's Hospital of PhiladelphiaRan2022 to 2024Enrolled26,139ConditionsCommunity-acquired Pneumonia, Acute Otitis Media, PharyngitisArmsQuasi experimental intervention
3 · Its place in the literature

Who cites it

20 citing papers in PubMed.

  1. Trial
  2. Article
  3. Article
  4. Impact of Clinician Feedback Reports on Antibiotic Use in Children Hospitalized With Community-acquired Pneumonia.Clinical infectious diseases : an official publication of the Infectious Diseases Society of America · 2025
    Article
  5. Article
  6. Precision feedback: A conceptual model.Learning health systems · 2024
    Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Partnered innovation to implement timely and personalized care: A case study.Journal of clinical and translational science · 2021
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Zach Landis-LewisDepartment of Learning Health Sciences, University of Michigan Medical School, 1161 J NIB, 300 N. Ingalls Street, SPC 5403, Ann Arbor, Michigan, 48109-5403, USA. zachll@umich.edu.ORCID 0000-0002-9117-9338
Jennifer KononowechVA Ann Arbor Healthcare System, Ann Arbor, Michigan, USA.
Winifred J ScottVA Palo Alto Health Care System, Palo Alto, California, USA.
Robert V HogikyanVA Ann Arbor Healthcare System, Ann Arbor, Michigan, USA.
Joan G CarpenterCorporal Michael J. Crescenz VAMC, Philadelphia, Pennsylvania, USA.
V S PeriyakoilVA Palo Alto Health Care System, Palo Alto, California, USA.
Susan C MillerBrown University School of Public Health, Providence, Rhode Island, USA.
Cari LevyEastern Colorado Health Care System, Aurora, Colorado, USA.
Mary ErsekCorporal Michael J. Crescenz VAMC, Philadelphia, Pennsylvania, USA.
Anne SalesDepartment of Learning Health Sciences, University of Michigan Medical School, 1161 J NIB, 300 N. Ingalls Street, SPC 5403, Ann Arbor, Michigan, 48109-5403, USA.

Funding

Stanford Medicine Center for Longevity and Healthy Aging Research Education CoreP30AG059307 · NIA · STANFORD UNIVERSITY · PI PERIYAKOIL, VYJEYANTHI S, YESAVAGE, JEROME A · 2018 to 2025
$4.9M
Palliative care needs and outcomes for dementia patientsR01AG062239 · NIA · STANFORD UNIVERSITY · PI PERIYAKOIL, VYJEYANTHI S · 2018 to 2023
$3.7M
A knowledge-based message tailoring systemK01LM012528 · NLM · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI LANDIS-LEWIS, ZACHARY · 2017 to 2019
$523k
NIA NIH HHS P30 AG059307NIA NIH HHS R01 AG062239NLM NIH HHS K01 LM012528
6 · The paper itself

Abstract

backgroundUser-centered design (UCD) methods are well-established techniques for creating useful artifacts, but few studies illustrate their application to clinical feedback reports. When used as an implementation strategy, the content of feedback reports depends on a foundational audit process involving performance measures and data, but these important relationships have not been adequately described. Better guidance on UCD methods for designing feedback reports is needed. Our objective is to describe the feedback report design method for refining the content of prototype reports.

methodsWe propose a three-step feedback report design method (refinement of measures, data, and display). The three steps follow dependencies such that refinement of measures can require changes to data, which in turn may require changes to the display. We believe this method can be used effectively with a broad range of UCD techniques.

resultsWe illustrate the three-step method as used in implementation of goals of care conversations in long-term care settings in the U.S. Veterans Health Administration. Using iterative usability testing, feedback report content evolved over cycles of the three steps. Following the steps in the proposed method through 12 iterations with 13 participants, we improved the usability of the feedback reports.

conclusionsUCD methods can improve feedback report content through an iterative process. When designing feedback reports, refining measures, data, and display may enable report designers to improve the user centeredness of feedback reports.

Indexed as

FeedbackClinical AuditHumansImplementation SciencePatient Care PlanningQuality ImprovementResidential FacilitiesUnited StatesUnited States Department of Veterans AffairsAudit and feedbackClinical quality improvementGoals of careLong-term careUser-centered design

Identifiers

PMID31964414
PMCPMC6975062

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.