Evidence map›Paper›PMID 39026007›Full record

ArticleSurgical endoscopy2024

Validity of task-specific metrics for assessment in perineal proctectomy.

Alexis Desir, Poya Pourghaderi, Shruti R Hegde, Doga Demirel, Javier Salgado Pogacnik, Suvranu De, James W Fleshman, Ganesh Sankaranarayanan

Abstract readValidation Study
In one paragraph

Article in Surgical endoscopy, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Alexis DesirDepartment of Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA.
Poya PourghaderiDepartment of Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA.
Shruti R HegdeDepartment of Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA.
Doga DemirelFlorida Polytechnic University, Lakeland, FL, USA.
Javier Salgado PogacnikDepartment of Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA.
Suvranu DeFlorida A&M University-Florida State University College of Engineering, Tallahassee, FL, USA.
James W FleshmanBaylor University Medical Center, Dallas, TX, USA.
Ganesh SankaranarayananDepartment of Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA. Ganesh.Sankaranarayanan@utsouthwestern.edu.ORCID 0000-0003-1556-2797

Funding

Development and validation of a Virtual Colorectal Surgical Trainer (VCoST)R01EB025241 · NIBIB · RENSSELAER POLYTECHNIC INSTITUTE · PI DE, SUVRANU · 2018 to 2022
$2.7M
National Institute of Biomedical Innovation NIH/NIBIB R01: EB025241NIBIB NIH HHS R01 EB025241
6 · The paper itself

Abstract

backgroundPerineal proctectomy is a complex procedure that requires advanced skills. Currently, there are no simulators for training in this procedure. As part of our objective of developing a virtual reality simulator, our goal was to develop and validate task-specific metrics for the assessment of performance for this procedure. We conducted a three-phase study to establish task-specific metrics, obtain expert consensus on the appropriateness of the developed metrics, and establish the discriminant validity of the developed metrics.

methodsIn phase I, we utilized hierarchical task analysis to formulate the metrics. In phase II, a survey involving expert colorectal surgeons determined the significance of the developed metrics. Phase III was aimed at establishing the discriminant validity for novices (PGY1-3) and experts (PGY4-5 and faculty). They performed a perineal proctectomy on a rectal prolapse model. Video recordings were independently assessed by two raters using global ratings and task-specific metrics for the procedure. Total scores for both metrics were computed and analyzed using the Kruskal-Wallis test. A Mann-Whitney U test with Benjamini-Hochberg correction was used to evaluate between-group differences. Spearman's rank correlation coefficient was computed to assess the correlation between global and task-specific scores.

resultsIn phase II, a total of 23 colorectal surgeons were recruited and consensus was obtained on all the task-specific metrics. In phase III, participants (n = 22) included novices (n = 15) and experts (n = 7). There was a strong positive correlation between the global and task-specific scores (rs = 0.86; P < 0.001). Significant between-group differences were detected for both global (χ

conclusionsUsing a biotissue rectal prolapse model, this study documented high IRR and significant discriminant validity evidence in support of video-based assessment using task-specific metrics.

Indexed as

Clinical CompetencePerineumProctectomyFemaleHumansRectal ProlapseReproducibility of ResultsSimulation TrainingTask Performance and AnalysisVideo RecordingVirtual RealityPerineal proctectomySimulationTask-specific metrics

Identifiers

PMID39026007
PMCPMC11365785

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.