Evidence map›Paper›PMID 34600497›Full record

ArticleBMC medical education2021

Improving handover competency in preclinical medical and health professions students: establishing the reliability and construct validity of an assessment instrument.

Meghan Michael, Andrew C Griggs, Ian H Shields, Mozhdeh Sadighi, Jessica Hernandez, Chrissy Chan, Mary McHugh, Blake E Nichols, Kavita Joshi, Daniel Testa and 4 more

Open access · goldAbstract read
In one paragraph

Article in BMC medical education, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 1 pooled it
1.0field-weighted citation impact, top 24% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 1 synthesis or guideline pooled it, 5 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors at 3 institutions in 1 country.

Meghan MichaelDepartment of Anesthesiology and Pain Management, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Mail Code 9068, Dallas, TX, 75390, USA. Meghan.Michael@utsouthwestern.edu.ORCID http://orcid.org/0000-0002-0673-9194
Andrew C GriggsDepartment of Human Factors and Behavioral Neurobiology, Embry-Riddle Aeronautical University, 1 Aerospace Blvd, Daytona Beach, FL, 32114, USA.
Ian H ShieldsOffice of Quality, Safety, and Outcomes Education, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX, 75390, USA.
Mozhdeh SadighiDepartment of Undergraduate Medical Education, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX, 75390, USA.
Jessica HernandezDepartment of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX, 75390, USA.
Chrissy ChanDepartment of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX, 75390, USA.
Mary McHughDepartment of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX, 75390, USA.
Blake E NicholsDepartment of Pediatrics, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Mail Code 9063, Dallas, TX, 75390, USA.
Kavita JoshiDepartment of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX, 75390, USA.
Daniel TestaDepartment of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX, 75390, USA.
Sonika RajDepartment of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX, 75390, USA.
Richard PrebleOffice of Quality, Safety, and Outcomes Education, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX, 75390, USA.
Elizabeth H LazzaraDepartment of Human Factors and Behavioral Neurobiology, Embry-Riddle Aeronautical University, 1 Aerospace Blvd, Daytona Beach, FL, 32114, USA.
Philip E GreilichDepartment of Anesthesiology and Pain Management, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Mail Code 9068, Dallas, TX, 75390, USA.
The University of Texas Southwestern Medical Center · USEmbry–Riddle Aeronautical University · USSouthwestern Medical Center · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAs part of the worldwide call to enhance the safety of patient handovers of care, the Association of American Medical Colleges (AAMC) requires that all graduating students "give or receive a patient handover to transition care responsibly" as one of its Core Entrustable Professional Activities (EPAs) for Entering Residency. Students therefore require educational activities that build the necessary teamwork skills to perform structured handovers. To date, a reliable instrument designed to assess teamwork competencies, like structured communication, throughout their preclinical and clinical years does not exist.

methodOur team developed an assessment instrument that evaluates both the use of structured communication and two additional teamwork competencies necessary to perform safe patient handovers. This instrument was utilized to assess 192 handovers that were recorded from a sample of 229 preclinical medical students and 25 health professions students who participated in a virtual course on safe patient handovers. Five raters were trained on utilization of the assessment instrument, and consensus was established. Each handover was reviewed independently by two separate raters.

resultsThe raters achieved 72.22 % agreement across items in the reviewed handovers. Krippendorff's alpha coefficient to assess inter-rater reliability was 0.6245, indicating substantial agreement among the raters. A confirmatory factor analysis (CFA) demonstrated the orthogonal characteristics of items in this instrument with rotated item loadings onto three distinct factors providing preliminary evidence of construct validity.

conclusionsWe present an assessment instrument with substantial reliability and preliminary evidence of construct validity designed to evaluate both use of structured handover format as well as two team competencies necessary for safe patient handovers. Our assessment instrument can be used by educators to evaluate learners' handoff performance as early as their preclinical years and is broadly applicable in the clinical context in which it is utilized. In the journey to optimize safe patient care through improved teamwork during handovers, our instrument achieves a critical step in the process of developing a validated assessment instrument to evaluate learners as they seek to accomplish this goal.

Indexed as

Patient HandoffStudents, Health OccupationsStudents, MedicalHealth OccupationsHumansReproducibility of ResultsHandoversMeasurementReliabilityTeamworkValidity

Identifiers

PMID34600497
PMCPMC8487478
OpenAlexW3201949163

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.