ArticleSurgical endoscopy2020
Direct observation of procedural skills (DOPS) assessment in diagnostic gastroscopy: nationwide evidence of validity and competency development during training.
Article in Surgical endoscopy, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 20 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
20 citing papers in PubMed.
- An exploratory pilot study of integrated mini-CEX and DOPS assessments in general medicine residency: feasibility and longitudinal outcomes.Clinics (Sao Paulo, Brazil) · 2026Article
- A Novel ex vivo Snare Tip Soft Coagulation Model for Deliberate Self-Practice and Assessing Endoscopic Tip-Control Competency: The HAM-2 Study.Endoscopy international open · 2026Article
- The Effect of Direct Observation of Procedural Skills on Learning and Satisfaction of Students in Community Dentistry Course.Journal of advances in medical education & professionalism · 2024Article
- Improving assessment of procedural skills in health sciences education: a validation study of a rubrics system in neurophysiotherapy.BMC psychology · 2024Article
- Exploring Endoscopic Competence in Gastroenterology Training: A Simulation-Based Comparative Analysis of GAGES, DOPS, and ACE Assessment Tools.Advances in medical education and practice · 2024Article
- Review of the validity of DOPS as an assessment tool for the procedural skills of surgical trainees.Annals of the Royal College of Surgeons of England · 2023Review
- A portrait of Endoscopic retrograde cholangiopancreatography and endoscopic ultrasound training programs in Europe: Current practices and opportunities for improvement.United European gastroenterology journal · 2023Article
- Article
- A journey towards pediatric gastrointestinal endoscopy and its training: a narrative review.Frontiers in pediatrics · 2023Review
- Simulator-based training method in gastrointestinal endoscopy training and currently available simulators.Clinical endoscopy · 2023Review
- Face validity of a virtual reality simulation platform to improve competency in endoscopy: a prospective observational cohort study.Endoscopy international open · 2022Article
- JAG consensus statements for training and certification in oesophagogastroduodenoscopy.Frontline gastroenterology · 2022Article
- Association Between Formative Assessment and Academic Performance for Undergraduate Medical Students in a Chinese Clinical Skills Training Course.Medical science monitor : international medical journal of experimental and clinical research · 2021Article
- Delayed Bleeding After Endoscopic Resection of Colorectal Polyps: Identifying High-Risk Patients.Clinical and experimental gastroenterology · 2021Review
- The SAFE-T upper endoscopy tool: a web-based application for the point-of-care evaluation of gastroenterology fellow performance in upper endoscopy.Gastroenterology report · 2020Article
- The status of training in new technologies in advanced endoscopy: from defining competence to credentialing and privileging.Gastrointestinal endoscopy · 2020Review
- Impact of COVID-19 on endoscopy trainees: an international survey.Gastrointestinal endoscopy · 2020Article
- A standardized technique for gastroscopy: Still missing?Endoscopy international open · 2020Article
- Simulation-based mastery learning (SBML) for rapid acquisition of upper endoscopy knowledge and skills-initial observation.VideoGIE : an official video journal of the American Society for Gastrointestinal Endoscopy · 2020Article
- Impact of a simulation-based induction programme in gastroscopy on trainee outcomes and learning curves.World journal of gastrointestinal endoscopy · 2020Article
Corrections and comments
- Erratum issued
Authors and funding
8 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundValidated competency assessment tools and the data supporting milestone development during gastroscopy training are lacking. We aimed to assess the validity of the formative direct observation of procedural skills (DOPS) assessment tool in diagnostic gastroscopy and study competency development using DOPS.
methodsThis was a prospective multicentre (N = 275) analysis of formative gastroscopy DOPS assessments. Internal structure validity was tested using exploratory factor analysis and reliability estimated using generalisability theory. Item and global DOPS scores were stratified by lifetime procedure count to define learning curves, using a threshold determined from receiver operator characteristics (ROC) analysis. Multivariable binary logistic regression analysis was performed to identify independent predictors of DOPS competence.
resultsIn total, 10086 DOPS were submitted for 987 trainees. Exploratory factor analysis identified three distinct item groupings, representing 'pre-procedure', 'technical', and 'post-procedure non-technical' skills. From generalisability analyses, sources of variance in overall DOPS scores included trainee ability (31%), assessor stringency (8%), assessor subjectivity (18%), and trainee case-to-case variation (43%). The combination of three assessments from three assessors was sufficient to achieve the reliability threshold of 0.70. On ROC analysis, a mean score of 3.9 provided optimal sensitivity and specificity for determining competency. This threshold was attained in the order of 'pre-procedure' (100-124 procedures), 'technical' (150-174 procedures), 'post-procedure non-technical' skills (200-224 procedures), and global competency (225-249 procedures). Higher lifetime procedure count, DOPS count, surgical trainees and assessors, higher trainee seniority, and lower case difficulty were significant multivariable predictors of DOPS competence.
conclusionThis study establishes milestones for competency acquisition during gastroscopy training and provides validity and reliability evidence to support gastroscopy DOPS as a competency assessment tool.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.