Measuring situation awareness and team effectiveness in pediatric acute care by using the situation global assessment technique.

Situation awareness (SA) is an important human factor and necessary for effective teamwork and patient safety. Human patient simulation (HPS) with video feedback allows for a safe environment where health care professionals can develop both technical and teamwork skills. It is, however, very difficult to observe and measure SA directly. The Situation Global Assessment Technique (SAGAT) was developed by Endsley to measure SA during real-time simulation. Our objective was to measure SA among team members during simulation of acute pediatric care scenarios on the medical ward and its relationship with team effectiveness. Twenty-four pediatric teams, consisting of two nurses, one resident, and one consultant, participated in three acute care scenarios, using high-fidelity simulation. Individual SAGAT scores contained shared and complimentary knowledge questions on different levels of SA. Within each scenario, two "freezes" were incorporated to assess SA of each team members' clinical assessment and decision-making. SA overlap within the team (team SA) was computed and compared to indicators of team effectiveness (time to goal achievement, consensus on primary problem, diagnosis, task prioritization, leadership, and teamwork satisfaction). In 13 scenarios (18%), the team failed to reach the primary goals within the prescribed time of 1200 s. There was no significant difference in failure of goal completion between the scripted scenarios; however, there was a significant difference between scenario 3 and the other scenarios in time to goal completion. In all three scenarios, SA overlap level 2 (consensus on primary problem during the first freeze and consensus on diagnosis during the second freeze) leads to significantly faster achievement of the predefined goals. There was a strong relationship between team SA on the primary problem and diagnosis and team SA on task prioritization. Consensus on leadership within the team was low. Teamwork satisfaction was more influenced by knowledge about the importance of the assigned task than outcome of the scenario.Conclusion: The use of SAGAT enables us to measure SA of team members during real-time simulation of acute care scenarios. Although there is no direct connection between team SA and goal achievement, SAGAT provides insight in differences in SA among team members, and the process of shared mental model formation. By measuring SA, issues that may improve team effectiveness (prioritizing tasks, enhancing shared mental models, and providing leadership) can be trained and assessed during medical team simulation, enhancing teamwork in health care settings. What is known? • Teamwork skills such as communication, leadership, and situational awareness have become increasingly recognized as essential for good performance in pediatric resuscitation. However, the assessment of pediatric team performance in these clinical situations has been traditionally difficult. • The Situation Awareness Global Assessment Technique (SAGAT) is a method of objectively and directly measuring SA during a team simulation using "freezes" at predetermined points in time with participants reporting on "what is going on" from their perspective on the situation. What is new? • We assessed SA, and its relationship with team effectiveness, in multidisciplinary pediatric teams performing simulated critical events in critically ill children on the medical ward using the SAGAT model, outside the emergency room setting. • In all three scenarios, consensus on the primary problem (shared mental model) leads to faster achievement of predefined goals. Consensus on leadership was overall low, without a significant impact on goal achievement.