ArticleScandinavian journal of trauma, resuscitation and emergency medicine2019
Rating the quality of teamwork-a comparison of novice and expert ratings using the Team Emergency Assessment Measure (TEAM) in simulated emergencies.
Article in Scandinavian journal of trauma, resuscitation and emergency medicine, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
21 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Instruments to evaluate non-technical skills during high fidelity simulation: A systematic review.Frontiers in medicine · 2022Pooled it
- Effect of an app-guided advanced cardiac life support algorithm on teamwork, non-technical skills, and workload in simulated in-hospital cardiac arrest: a randomized controlled feasibility trial.Scandinavian journal of trauma, resuscitation and emergency medicine · 2026Trial
- Improve Cardiac Emergency Preparedness by Building a Team-Based Cardiopulmonary Resuscitation Educational Plan.Frontiers in public health · 2022Trial
- Translation, cross-cultural adaptation, and psychometric validation of the Team Emergency Assessment Measure (TEAM) into European Spanish: a multi-perspective study including peer-assessment.Advances in simulation (London, England) · 2026Article
- Improving preparedness for mass casualty incidents in hospitals: insights from a large-scale simulation exercise with geotracking and validated questionnaires.BMC emergency medicine · 2026Observational
- Impact of collective orientation on the quality of teamwork of emergency medical personnel in simulated prehospital emergency medical care - a prospective observational study.BMC emergency medicine · 2025Observational
- Assessing healthcare simulation facilitation using a competency-based tool derived from practice in low-resource settings.Anaesthesia · 2025Article
- TEAMs go VR-validating the TEAM in a virtual reality (VR) medical team training.Advances in simulation (London, England) · 2024Article
- "Trust people you've never worked with" - A social network visualization of teamwork, cohesion, social support, and mental health in NHS Covid personnel.Frontiers in psychology · 2024Article
- Simulation in healthcare during COVID-19: An experience with residents in Anaesthesiology.Revista espanola de anestesiologia y reanimacion · 2023Article
- [Simulation in healthcare during COVID-19: An experience with residents in Anaesthesiology].Revista espanola de anestesiologia y reanimacion · 2023Article
- Reliability and validity testing of team emergency assessment measure in a distributed team context.Frontiers in psychology · 2023Article
- Successful implementation of a rater training program for medical students to evaluate simulated pediatric emergencies.GMS journal for medical education · 2023Article
- Application of the Team Emergency Assessment Measure Scale in undergraduate medical students and interprofessional clinical teams: validity evidence of a Spanish version applied in Chile.Frontiers in medicine · 2023Article
- Elements of Teamwork in Resuscitation: An Integrative Review.Bulletin of emergency and trauma · 2022Review
- Non-technical skills in pre-hospital care in the Czech Republic: a prospective multicentric observational study (NTS study).BMC emergency medicine · 2022Observational
- The TEAM instrument for measuring emergency team performance: validation of the Swedish version at two emergency departments.Scandinavian journal of trauma, resuscitation and emergency medicine · 2021Article
- Long-term effects of perioperative briefing and debriefing on team climate: A mixed-method evaluation study.International journal of clinical practice · 2021Article
- Effects of using a cognitive aid on content and feasibility of debriefings of simulated emergencies.GMS journal for medical education · 2021Article
- Practice structure and quality improvement activities among emergency departments in the Emergency Quality (E-QUAL) Network.Journal of the American College of Emergency Physicians open · 2020Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors.
Funding
Abstract
backgroundTraining in teamwork behaviour improves technical resuscitation performance. However, its effect on patient outcome is less clear, partly because teamwork behaviour is difficult to measure. Furthermore, it is unknown who should evaluate it. In clinical practice, experts are obliged to participate in resuscitation efforts and are thus unavailable to assess teamwork quality. Consequently, we sought to determine if raters with little clinical experience and experts provide comparable evaluations of teamwork behaviour.
methodsNovice and expert raters judged teamwork behaviour during 6 emergency medicine simulations using the Teamwork Emergency Assessment Measure (TEAM). Ratings of both groups were analysed descriptively and compared with U and t tests. We used a mixed effects model to identify the proportion of variance in TEAM scores attributable to rater status and other sources.
resultsTwelve raters evaluated 7 teams rotating through 6 cases, for a total of 84 observations. We found no significant difference between expert and novice ratings for 7 of the 11 items of the TEAM or in the sums of all item scores. Novices rated teamwork behaviour higher on 4 items and overall. Rater status accounted for 11.1% of the total variance in scores.
conclusionsExperts' and novices' ratings were similarly distributed, implying that raters with limited experience can provide reliable data on teamwork behaviour. Novices show a consistent, but slightly more lenient rating behaviour. Clinical studies and real-life teams may thus employ novices using a structured observational tool such as TEAM to inform their performance review and improvement.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.