ArticleAEM education and training2021
Direct Observation Tools in Emergency Medicine: A Systematic Review of the Literature.
Article in AEM education and training, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
11 citing papers in PubMed.
- [Professionalization of medical education: Axes and strategies for excellence].Revista medica del Instituto Mexicano del Seguro Social · 2026Article
- Public-private partnerships for UAV-assisted emergency medical services in aging communities: an evolutionary game approach.Frontiers in public health · 2026Article
- Assessment of Emergency Medicine Residents' Situational Awareness and Perception of Patient Safety Culture in the Emergency Department.AEM education and training · 2025Article
- Telehealth in emergency medicine residency training: A model curriculum.Journal of the American College of Emergency Physicians open · 2024Article
- Nontechnically speaking: A review of tools and methods in the teaching and assessment of nontechnical skills in emergency medicine training.AEM education and training · 2023Article
- The integrative feedback tool: assessing a novel feedback tool among emergency medicine residents.Clinical and experimental emergency medicine · 2023Article
- Feedback in Medical Education: An Evidence-based Guide to Best Practices from the Council of Residency Directors in Emergency Medicine.The western journal of emergency medicine · 2023Review
- Trends in emergency medicine resident procedural reporting over a 10-year period.AEM education and training · 2023Article
- More Than Meets the Eye: Addressing the Role of Telemedicine in Resident Education.Annals of emergency medicine · 2021Review
- The standardized letter of evaluation in emergency medicine: Are the qualifications useful?AEM education and training · 2021Article
- Workplace-based Assessment Data in Emergency Medicine: A Scoping Review of the Literature.AEM education and training · 2021Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
6 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
objectivesDirect observation is important for assessing the competency of medical learners. Multiple tools have been described in other fields, although the degree of emergency medicine-specific literature is unclear. This review sought to summarize the current literature on direct observation tools in the emergency department (ED) setting.
methodsWe searched PubMed, Scopus, CINAHL, the Cochrane Central Register of Clinical Trials, the Cochrane Database of Systematic Reviews, ERIC, PsycINFO, and Google Scholar from 2012 to 2020 for publications on direct observation tools in the ED setting. Data were dual extracted into a predefined worksheet, and quality analysis was performed using the Medical Education Research Study Quality Instrument.
resultsWe identified 38 publications, comprising 2,977 learners. Fifteen different tools were described. The most commonly assessed tools included the Milestones (nine studies), Observed Structured Clinical Exercises (seven studies), the McMaster Modular Assessment Program (six studies), Queen's Simulation Assessment Test (five studies), and the mini-Clinical Evaluation Exercise (four studies). Most of the studies were performed in a single institution, and there were limited validity or reliability assessments reported.
conclusionsThe number of publications on direct observation tools for the ED setting has markedly increased. However, there remains a need for stronger internal and external validity data.
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.