Evidence map›Paper›PMID 29790072›Full record

Trial reportJournal of general internal medicine2018

Effect of Social Comparison Feedback on Laboratory Test Ordering for Hospitalized Patients: A Randomized Controlled Trial.

Kira Ryskina, C Jessica Dine, Yevgeniy Gitelman, Damien Leri, Mitesh Patel, Gregory Kurtzman, Lisa Y Lin, Andrew J Epstein

Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of general internal medicine, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT02330289 (The Effect of Norms on Laboratory and Imaging Testing), which is not on this map. Cited by 9 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT02330289 nacompletednot on this map

The Effect of Norms on Laboratory and Imaging Testing (ENLITen): a Pragmatic Randomized Controlled Trial

TypeinterventionalSponsorUniversity of PennsylvaniaRan2015 to 2016Enrolled154ConditionsUtilization, Laboratory, HospitalArmsNormative report card
3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Audit and feedback: effects on professional practice.The Cochrane database of systematic reviews · 2025
    Pooled it
  2. Pooled it
  3. Systematic review and narrative synthesis of computerized audit and feedback systems in healthcare.Journal of the American Medical Informatics Association : JAMIA · 2022
    Pooled it
  4. Pooled it
  5. Pooled it
  6. Article
  7. Article
  8. Article
  9. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors.

Kira RyskinaDivision of General Internal Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA. ryskina@mail.med.upenn.edu.
C Jessica DineLeonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA.
Yevgeniy GitelmanPenn Medicine Center for Health Care Innovation, Philadelphia, PA, USA.
Damien LeriPenn Medicine Center for Health Care Innovation, Philadelphia, PA, USA.
Mitesh PatelDivision of General Internal Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
Gregory KurtzmanDivision of General Internal Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
Lisa Y LinDivision of General Internal Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
Andrew J EpsteinDivision of General Internal Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.

Funding

UNDERSTANDING THE ROLE OF PHYSICIAN INTEGRATION WITHIN NURSING HOMES IN POST-ACUTE CARE OUTCOMESK08AG052572 · NIA · UNIVERSITY OF PENNSYLVANIA · PI RYSKINA, KIRA L · 2016 to 2020
$821k
NIA NIH HHS K08 AG052572
6 · The paper itself

Abstract

backgroundSocial comparison feedback is an increasingly popular strategy that uses performance report cards to modify physician behavior. Our objective was to test the effect of such feedback on the ordering of routine laboratory tests for hospitalized patients, a practice considered overused.

methodsThis was a single-blinded randomized controlled trial. Between January and June 2016, physicians on six general medicine teams at the Hospital of the University of Pennsylvania were cluster randomized with equal allocation to two arms: (1) those e-mailed a summary of their routine laboratory test ordering vs. the service average for the prior week, linked to a continuously updated personalized dashboard containing patient-level details, and snapshot of the dashboard and (2) those who did not receive the intervention. The primary outcome was the count of routine laboratory test orders placed by a physician per patient-day. We modeled the count of orders by each physician per patient-day after the intervention as a function of trial arm and the physician's order count before the intervention. The count outcome was modeled using negative binomial models with adjustment for clustering within teams.

resultsOne hundred and fourteen interns and residents participated. We did not observe a statistically significant difference in adjusted reduction in routine laboratory ordering between the intervention and control physicians (physicians in the intervention group ordered 0.14 fewer tests per patient-day than physicians in the control group, 95% CI - 0.56 to 0.27, p = 0.50). Physicians whose absolute ordering rate deviated from the peer rate by more than 1.0 laboratory test per patient-day reduced their laboratory ordering by 0.80 orders per patient-day (95% CI - 1.58 to - 0.02, p = 0.04).

conclusionsPersonalized social comparison feedback on routine laboratory ordering did not change targeted behavior among physicians, although there was a significant decrease in orders among participants who deviated more from the peer rate.

trial registrationClinicaltrials.gov registration: #NCT02330289.

Indexed as

Knowledge of Results, PsychologicalDiagnostic Tests, RoutineFemaleHospitalizationHumansMaleMedical OveruseMedical Staff, HospitalPeer GroupPennsylvaniaPractice Patterns, Physicians'Single-Blind Method

Identifiers

PMID29790072
PMCPMC6153251

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.