Evidence map›Paper›PMID 24665068›Full record

ArticleJournal of hospital medicine2014

Using standardized videos to validate a measure of handoff quality: the handoff mini-clinical examination exercise.

Vineet M Arora, Saba Berhie, Leora I Horwitz, Mark Saathoff, Paul Staisiunas, Jeanne M Farnan

Abstract readMulticenter Study
In one paragraph

Article in Journal of hospital medicine, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Feedback and Assessment Tools for Handoffs: A Systematic Review.Journal of graduate medical education · 2017
    Pooled it
  2. Article
  3. Article
  4. Leveraging Telemedicine Infrastructure to Monitor Quality of Operating Room to Intensive Care Unit Handoffs.Academic medicine : journal of the Association of American Medical Colleges · 2017
    Article
  5. Review
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Vineet M AroraDepartment of Medicine, University of Chicago, Chicago, Illinois; Pritzker School of Medicine, University of Chicago, Chicago, Illinois.
Saba Berhie
Leora I Horwitz
Mark Saathoff
Paul Staisiunas
Jeanne M Farnan

Funding

Short Term Aging-Related Research ProgramT35AG029795 · NIA · UNIVERSITY OF CHICAGO · PI Vineet Arora, DAVID O MELTZER · 2008 to 2026
$1.4M
Environment and Perceived Control: Improving Sleep in Hospitalized Older PatientsK23AG033763 · NIA · UNIVERSITY OF CHICAGO · PI ARORA, VINEET · 2009 to 2013
$762k
Heart Failure Readmissions in Older Adults: A Systems PerspectiveK08AG038336 · NIA · YALE UNIVERSITY · PI HORWITZ, LEORA · 2010 to 2013
$648k
Development and Validation of a Tool to Evaluate Hand-off QualityR03HS018278 · AHRQ · UNIVERSITY OF CHICAGO · PI ARORA, VINEET · 2009 to 2010
$98k
AHRQ HHS 1 R03HS018278-01AHRQ HHS R03 HS018278NIA NIH HHS 5T35AG029795NIA NIH HHS K08 AG038336NIA NIH HHS K23 AG033763NIA NIH HHS K23AG033763NIA NIH HHS T35 AG029795
6 · The paper itself

Abstract

backgroundThe most recent iteration of the Accreditation Council for Graduate Medical Education duty-hour regulations includes language mandating handoff education for trainees and assessments of handoff quality by residency training programs. However, there is a lack of validated tools for the assessment of handoff quality and for use in trainee education.

methodsFaculty at 2 sites (University of Chicago and Yale University) were recruited to participate in a workshop on handoff education. Video-based scenarios were developed to represent varying levels of performance in the domains of communication, professionalism, and setting. Videos were shown in a random order, and faculty were instructed to use the Handoff Mini-Clinical Examination Exercise (CEX), a paper-based instrument with qualitative anchors defining each level of performance, to rate the handoffs.

resultsForty-seven faculty members (14 at site 1; 33 at site 2) participated in the validation workshops, providing a total of 172 observations (of a possible 191 [96%]). Reliability testing revealed a Cronbach α of 0.81 and Kendall coefficient of concordance of 0.59 (>0.6 = high reliability). Faculty were able to reliably distinguish the different levels of performance in each domain in a statistically significant fashion (ie, unsatisfactory professionalism mean 2.42 vs satisfactory professionalism 4.81 vs superior professionalism 6.01, P < 0.001 trend test). Two-way analysis of variance revealed no evidence of rater bias.

conclusionsUsing standardized video-based scenarios highlighting differing levels of performance, we were able to demonstrate evidence that the Handoff Mini-CEX can draw reliable and valid conclusions regarding handoff performance. Future work to validate the tool in clinical settings is warranted.

Indexed as

Clinical CompetenceEducationFaculty, MedicalHumansInternship and ResidencyPatient HandoffPilot ProjectsReproducibility of ResultsVideo Recording

Identifiers

PMID24665068
PMCPMC4079746

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.