Evidence map›Paper›PMID 42301447›Full record

ArticleSurgical endoscopy2026

External validity of task-specific metrics for performance assessment in laparoscopic crural repair.

Sofia Garces-Palacios, Alexis Desir, Apoorva Pise, Carla Holcomb, Daniel J Scott, Ganesh Sankaranarayanan

Abstract readValidation Study
In one paragraph

Article in Surgical endoscopy, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Sofia Garces-PalaciosDepartment of Surgery, The University of Texas Southwestern Medical Center, Dallas, TX, USA.
Alexis DesirDepartment of Surgery, The University of Texas Southwestern Medical Center, Dallas, TX, USA.
Apoorva PiseDepartment of Surgery, The University of Texas Southwestern Medical Center, Dallas, TX, USA.
Carla HolcombDepartment of Surgery, University of Utah Health Science Center, Salt Lake City, UT, USA.
Daniel J ScottDepartment of Surgery, The University of Texas Southwestern Medical Center, Dallas, TX, USA.
Ganesh SankaranarayananDepartment of Surgery, The University of Texas Southwestern Medical Center, Dallas, TX, USA. ganesh.sankaranarayanan@utsouthwestern.edu.ORCID http://orcid.org/0000-0003-1556-2797

Funding

R01EB025247: Development and Validation of a Virtual Laparoscopic Hiatal Hernia Simulator (VLaHHS)R01EB025247 · NIBIB · UT SOUTHWESTERN MEDICAL CENTER · PI SANKARANARAYANAN, GANESH · 2019 to 2023
$2.4M
National Institute for Health Care Management Foundation EB025247NIBIB NIH HHS R01 EB025247
6 · The paper itself

Abstract

backgroundLaparoscopic hiatal hernia repair is a common foregut procedure, yet high-fidelity simulation tools for training and assessment remain limited. Previously, task-specific metrics (TSMs) were developed and validated at a single institution to evaluate performance during simulated laparoscopic crural repair. This study assessed the external validity and reliability of these TSMs using a broader, international cohort.

methodsParticipants at the 2024 SAGES Education and Innovation Center performed a simulated laparoscopic crural repair using an inanimate silicone model housed in a standard laparoscopic trainer box. Demographic data and surgical experience were collected via pre-survey. Performances were video-recorded and independently assessed by three blinded raters using both the Objective Structured Assessment of Technical Skills (OSATS) and TSMs. Participants were stratified into novice (PGY1-2) or experienced (PGY3-5, fellows, attendings). Inter-rater reliability was evaluated using intraclass correlation coefficient (ICC). Performance comparisons were analyzed using the Wilcoxon-Mann-Whitney test. Linear regression modeled training level as an ordered predictor, adjusting for simulation exposure. Correlation between OSATS and TSM scores was measured using Spearman's rank correlation.

resultsThirty-three participants were enrolled; 30 completed the task (attendings: 9; fellows: 3; PGY1-5: 18). 22 were U.S.-trained and 8 internationally trained. Inter-rater reliability was high for both scoring methods (ICC = 0.85; p < 0.001). Experienced participants scored significantly higher than novices on both OSATS (20 vs. 14; p = 0.039) and TSMs (39 vs. 18.5; p = 0.02). In adjusted models, robotic simulation training was independently associated with higher OSATS (β = 4.67, p = 0.021) and TSM scores (β = 15.01, p = 0.024). TSM and OSATS scores were strongly correlated (R = 0.88; p < 0.001).

conclusionsTSMs demonstrated strong external validity and reliability, effectively discriminating between experience levels and supporting their use as standardized assessment tool in surgical education and global training programs.

Indexed as

Clinical CompetenceHernia, HiatalHerniorrhaphyLaparoscopySimulation TrainingFemaleHumansMaleReproducibility of ResultsTask Performance and AnalysisLaparoscopic crural repairSkill assessmentSurgical simulationTask-specific metrics

Identifiers

PMID42301447
PMCPMC13369737

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.