Evidence map›Paper›PMID 35989331›Full record

ArticleBMC medical education2022

Pilot study of the DART tool - an objective healthcare simulation debriefing assessment instrument.

Kaushik Baliga, Andrew Coggins, Sandra Warburton, Divya Mathias, Nicole K Yamada, Janene H Fuerch, Louis P Halamek

Abstract read
In one paragraph

Article in BMC medical education, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Video-assisted team debriefing for real-life management of major postpartum hemorrhage (DBRIEF trial): An interrupted time series analysis.International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics · 2026
    Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Kaushik BaligaSydney Medical School, Westmead Hospital, Block K, Level 6, Sydney, NSW, 2145, Australia.
Andrew CogginsSimulated Learning Environment for Clinical Training (SiLECT), Westmead Hospital, Sydney, NSW, 2145, Australia. andrew.coggins@health.nsw.gov.au.
Sandra WarburtonSimulated Learning Environment for Clinical Training (SiLECT), Westmead Hospital, Sydney, NSW, 2145, Australia.
Divya MathiasThe Australian Institute of Medical Simulation and Innovation (AIMSi), Blacktown Hospital, Sydney, NSW, 2148, Australia.
Nicole K YamadaDepartment of Pediatrics, Division of Neonatal and Developmental Medicine, Stanford University School of Medicine, Palo Alto, CA, USA.
Janene H FuerchDepartment of Pediatrics, Division of Neonatal and Developmental Medicine, Stanford University School of Medicine, Palo Alto, CA, USA.
Louis P HalamekDepartment of Pediatrics, Division of Neonatal and Developmental Medicine, Stanford University School of Medicine, Palo Alto, CA, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundVarious rating tools aim to assess simulation debriefing quality, but their use may be limited by complexity and subjectivity. The Debriefing Assessment in Real Time (DART) tool represents an alternative debriefing aid that uses quantitative measures to estimate quality and requires minimal training to use. The DART is uses a cumulative tally of instructor questions (IQ), instructor statements (IS) and trainee responses (TR). Ratios for IQ:IS and TR:[IQ + IS] may estimate the level of debriefer inclusivity and participant engagement.

methodsExperienced faculty from four geographically disparate university-affiliated simulation centers rated video-based debriefings and a transcript using the DART. The primary endpoint was an assessment of the estimated reliability of the tool. The small sample size confined analysis to descriptive statistics and coefficient of variations (CV%) as an estimate of reliability.

resultsRatings for Video A (n = 7), Video B (n = 6), and Transcript A (n = 6) demonstrated mean CV% for IQ (27.8%), IS (39.5%), TR (34.8%), IQ:IS (40.8%), and TR:[IQ + IS] (28.0%). Higher CV% observed in IS and TR may be attributable to rater characterizations of longer contributions as either lumped or split. Lower variances in IQ and TR:[IQ + IS] suggest overall consistency regardless of scores being lumped or split.

conclusionThe DART tool appears to be reliable for the recording of data which may be useful for informing feedback to debriefers. Future studies should assess reliability in a wider pool of debriefings and examine potential uses in faculty development.

Indexed as

Clinical CompetenceSimulation TrainingComputer SimulationDelivery of Health CareHumansPilot ProjectsReproducibility of ResultsEducational measurementFeedbackHumansReproducibility of resultsSimulation trainingStaff development

Identifiers

PMID35989331
PMCPMC9394081

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.