Evidence map›Paper›PMID 41620311›Full record

Observational studyBritish journal of anaesthesia2026

Validity and reliability of simulation-based assessment tools for European Training Requirement-defined competencies in anaesthesiology: a two-centre observational pilot study.

Gerard S Angeles-Fite, Sara García-Ballester, Federico Migliorelli, Lidia Gómez-López, Beatriz Tena, Marina Vendrell, Manuel López-Baamonde, Juan M Perdomo, Cristina Ibañez, Raquel Bergé and 6 more

Abstract readObservational StudyMulticenter Study
In one paragraph

Observational study in British journal of anaesthesia, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Gerard S Angeles-FiteMedical Faculty Heidelberg, Department of Anesthesiology, Heidelberg University, Heidelberg, Germany; Departament de Cirurgia i Especialitats Medicoquirúrgiques, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona (UB), Barcelona, Spain; Heidelberg Anaesthesia and Emergency Simulation Centre (HANS), Heidelberg University Hospital, Heidelberg, Germany; Anaesthesiology Clinical Simulation Group (SIMCLÍNIC), Hospital Clínic de Barcelona, Barcelona, Spain.
Sara García-BallesterDepartment of Anaesthesiology and Critical Care, Bellvitge University Hospital, University of Barcelona, Hospitalet de Llobregat, Barcelona, Spain.
Federico MigliorelliBCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Déu), Institut Clínic de Ginecologia, Obstetrícia i Neonatologia, Fetal i+D Fetal Medicine Research Center, Barcelona, Spain; Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain.
Lidia Gómez-LópezAnaesthesiology Clinical Simulation Group (SIMCLÍNIC), Hospital Clínic de Barcelona, Barcelona, Spain; Department of Anaesthesiology and Critical Care, Hospital Clínic de Barcelona, Barcelona, Spain.
Beatriz TenaDepartament de Cirurgia i Especialitats Medicoquirúrgiques, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona (UB), Barcelona, Spain; Anaesthesiology Clinical Simulation Group (SIMCLÍNIC), Hospital Clínic de Barcelona, Barcelona, Spain; Department of Anaesthesiology and Critical Care, Hospital Clínic de Barcelona, Barcelona, Spain. Electronic address: btena@clinic.cat.
Marina VendrellDepartament de Cirurgia i Especialitats Medicoquirúrgiques, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona (UB), Barcelona, Spain; Anaesthesiology Clinical Simulation Group (SIMCLÍNIC), Hospital Clínic de Barcelona, Barcelona, Spain; Department of Anaesthesiology and Critical Care, Hospital Clínic de Barcelona, Barcelona, Spain.
Manuel López-BaamondeAnaesthesiology Clinical Simulation Group (SIMCLÍNIC), Hospital Clínic de Barcelona, Barcelona, Spain; Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain; Department of Anaesthesiology and Critical Care, Hospital Clínic de Barcelona, Barcelona, Spain.
Juan M PerdomoDepartament de Cirurgia i Especialitats Medicoquirúrgiques, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona (UB), Barcelona, Spain; Anaesthesiology Clinical Simulation Group (SIMCLÍNIC), Hospital Clínic de Barcelona, Barcelona, Spain; Department of Anaesthesiology and Critical Care, Hospital Clínic de Barcelona, Barcelona, Spain.
Cristina IbañezAnaesthesiology Clinical Simulation Group (SIMCLÍNIC), Hospital Clínic de Barcelona, Barcelona, Spain; Department of Anaesthesiology and Critical Care, Hospital Clínic de Barcelona, Barcelona, Spain.
Raquel BergéAnaesthesiology Clinical Simulation Group (SIMCLÍNIC), Hospital Clínic de Barcelona, Barcelona, Spain; Department of Anaesthesiology and Critical Care, Hospital Clínic de Barcelona, Barcelona, Spain.
Tomás CuñatAnaesthesiology Clinical Simulation Group (SIMCLÍNIC), Hospital Clínic de Barcelona, Barcelona, Spain; Department of Anaesthesiology and Critical Care, Hospital Clínic de Barcelona, Barcelona, Spain.
Johannes SchäferMedical Faculty Heidelberg, Department of Anesthesiology, Heidelberg University, Heidelberg, Germany; Heidelberg Anaesthesia and Emergency Simulation Centre (HANS), Heidelberg University Hospital, Heidelberg, Germany.
Albert CarramiñanaAnaesthesiology Clinical Simulation Group (SIMCLÍNIC), Hospital Clínic de Barcelona, Barcelona, Spain; Department of Anaesthesiology and Critical Care, Hospital Clínic de Barcelona, Barcelona, Spain.
Miriam F PanzeriAnaesthesiology Clinical Simulation Group (SIMCLÍNIC), Hospital Clínic de Barcelona, Barcelona, Spain; Department of Anaesthesiology and Critical Care, Hospital Clínic de Barcelona, Barcelona, Spain.
Ricard ValeroDepartament de Cirurgia i Especialitats Medicoquirúrgiques, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona (UB), Barcelona, Spain; Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain; Department of Anaesthesiology and Critical Care, Hospital Clínic de Barcelona, Barcelona, Spain; Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Instituto de Salud Carlos III (ISCIII), Spain.
Christopher NeuhausMedical Faculty Heidelberg, Department of Anesthesiology, Heidelberg University, Heidelberg, Germany; Heidelberg Anaesthesia and Emergency Simulation Centre (HANS), Heidelberg University Hospital, Heidelberg, Germany.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Despite ongoing efforts to harmonise postgraduate anaesthesiology training across Europe, significant variability persists among national programmes, and a unified certification process is lacking. Simulation is widely used in postgraduate anaesthesiology training, and several validated tools are available to assess both technical and nontechnical skills. However, use of such tools for summative assessments in specialist certification has not yet been established. This prospective, observational pilot study aimed to evaluate the validity and inter-rater reliability of two scenario-specific checklists, a global rating scale (GRS), and the Anaesthetists' Non-Technical Skills (ANTS) tool in assessing competencies defined by the European postgraduate anaesthesiology curriculum. The study was conducted between May and September 2022 at two university hospitals in Germany and Spain. A total of 43 (23 third-year and 20 fourth-year) anaesthesiology trainees completed a knowledge test and managed two simulated perioperative emergencies. Performances were video-recorded and independently assessed by two blinded raters. Fourth-year trainees scored significantly higher than third-year trainees across all tools, providing validity evidence. Inter-rater reliability was moderate for Scenario 1 (intraclass correlation coefficient [ICC] range: 0.50 to 0.67) and moderate-to-good for Scenario 2 (ICC range: 0.67 to 0.76). These findings suggest that simulation-based assessments using structured tools can validly and reliably evaluate technical and nontechnical competencies outlined in the European anaesthesiology training curriculum. The results support the integration of such assessments into standardised summative evaluation frameworks in European postgraduate education.

Indexed as

AnesthesiologyClinical CompetenceEducational MeasurementEducation, Medical, GraduateSimulation TrainingChecklistCurriculumEuropeGermanyHumansPilot ProjectsProspective StudiesReproducibility of ResultsSpainanaesthesiology trainingEuropean Union of Medical Specialistsnontechnical skillspostgraduate medical educationreliabilitysimulation-based assessmenttechnical skills

Identifiers

PMID41620311
PMCPMC13197913

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.