Validity evidence for a team-leading assessment tool in pediatric emergency resuscitations using video review.

Background: Effective leadership of health care action teams has demonstrated positive influence on team performance and patient care, but there is no consensus on how to assess these skills. We developed a novel team leadership assessment tool for leaders of interprofessional pediatric resuscitation teams and collected validity evidence for this tool using video review. Methods: This was a prospective cohort study from November 2021 to October 2022. A novel team leadership assessment tool was developed using literature review and local expertise and then piloted and refined using medical simulation. Pediatric emergency medicine (PEM) fellows from a single tertiary care pediatric medical center were enrolled, and videos of one medical resuscitation and one trauma resuscitation were collected per fellow each month. Three reviewers underwent reviewer training and then scored the videos using the assessment tool. Raters provided feedback on feasibility and ease of use using a 5-point Likert scale. Inter-rater reliability for the assessment tool using Gwet's agreement coefficient and the association between performance and clinical level of training using generalized linear mixed model were calculated. Results: Twelve PEM fellows enrolled and 146 videos were reviewed. The inter-rater reliability for each domain ranged from 0.45 ( Conclusions: We developed a novel team leadership assessment tool for pediatric resuscitation team leaders that demonstrated moderate inter-rater reliability. The tool was easy to use and feasible for educators to assess the performance of PEM trainees in complex high-stakes clinical situations.