Evidence map›Paper›PMID 30587187›Full record

ArticleBMC medical education2018

Development and validation of an objective assessment scale for chest tube insertion under 'direct' and 'indirect' rating.

Julian Ober, Patrick Haubruck, Felix Nickel, Tilman Walker, Mirco Friedrich, Beat-Peter Müller-Stich, Gerhard Schmidmaier, Michael C Tanner

Erratum issuedOpen access · goldAbstract readValidation Study
PubMed Full text at PMC Publisher
In one paragraph

Article in BMC medical education, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
1.1field-weighted citation impact, top 19% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 8 citations in OpenAlex.

  1. Article
  2. Development and validation of the first performance assessment scale for interdisciplinary chest tube insertion: a prospective multicenter study.European journal of trauma and emergency surgery : official publication of the European Trauma Society · 2022
    Article
  3. Review
  4. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors at 1 institution in 1 country.

Julian OberHTRG - Heidelberg Trauma Research Group, Center for Orthopedics, Trauma Surgery and Spinal Cord Injury, Trauma and Reconstructive Surgery, Heidelberg University Hospital, Schlierbacher Landstrasse 200a, D-69118, Heidelberg, Germany.
Patrick HaubruckHTRG - Heidelberg Trauma Research Group, Center for Orthopedics, Trauma Surgery and Spinal Cord Injury, Trauma and Reconstructive Surgery, Heidelberg University Hospital, Schlierbacher Landstrasse 200a, D-69118, Heidelberg, Germany.
Felix NickelDepartment of General, Visceral and Transplantation Surgery Heidelberg University Hospital, D-69120, Heidelberg, Germany.
Tilman WalkerHTRG - Heidelberg Trauma Research Group, Center for Orthopedics, Trauma Surgery and Spinal Cord Injury, Trauma and Reconstructive Surgery, Heidelberg University Hospital, Schlierbacher Landstrasse 200a, D-69118, Heidelberg, Germany.
Mirco FriedrichDepartment of General, Visceral and Transplantation Surgery Heidelberg University Hospital, D-69120, Heidelberg, Germany.
Beat-Peter Müller-StichDepartment of General, Visceral and Transplantation Surgery Heidelberg University Hospital, D-69120, Heidelberg, Germany.
Gerhard SchmidmaierHTRG - Heidelberg Trauma Research Group, Center for Orthopedics, Trauma Surgery and Spinal Cord Injury, Trauma and Reconstructive Surgery, Heidelberg University Hospital, Schlierbacher Landstrasse 200a, D-69118, Heidelberg, Germany.
Michael C TannerHTRG - Heidelberg Trauma Research Group, Center for Orthopedics, Trauma Surgery and Spinal Cord Injury, Trauma and Reconstructive Surgery, Heidelberg University Hospital, Schlierbacher Landstrasse 200a, D-69118, Heidelberg, Germany. michael.tanner@med.uni-heidelberg.de.ORCID http://orcid.org/0000-0003-0243-8113
Heidelberg University · DE

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThere is an increasing need for objective and validated educational concepts. This holds especially true for surgical procedures like chest tube insertion (CTI). Thus, we developed an instrument for objectification of learning successes: the assessment scale based on Objective Structured Assessment of Technical Skill (OSATS) for chest tube insertion, which is evaluated in this study. Primary endpoint was the evaluation of intermethod reliability (IM). Secondary endpoints are 'indirect' interrater reliability (IR) and construct validity of the scale (CV).

methodsEvery participant (N = 59) performed a CTI on a porcine thorax. Participants received three ratings (one 'direct' on site, two 'indirect' via video rating). IM compares 'direct' with 'indirect' ratings. IR was assessed between 'indirect' ratings. CV was investigated by subgroup analysis based on prior experience in CTI for 'direct' and 'indirect' rating.

resultsWe included 59 medical students to our study. IM showed moderate conformity ('direct' vs. 'indirect 1' ICC = 0.735, 95% CI: 0.554-0.843; 'direct' vs. 'indirect 2' ICC = 0.722, 95% CI 0.533-0.835) and good conformity between 'direct' vs. 'average indirect' rating (ICC = 0.764, 95% CI: 0.6-0.86). IR showed good conformity (ICC = 0.84, 95% CI: 0.707-0.91). CV was proven between subgroups in 'direct' (p = 0.037) and 'indirect' rating (p = 0.013).

conclusionResults for IM suggest equivalence for 'direct' and 'indirect' ratings, while both IR and CV was demonstrated in both rating methods. Thus, the assessment scale seems a reliable method for rating trainees' performances 'directly' as well as 'indirectly'. It may help to objectify and facilitate the assessment of training of chest tube insertion.

Indexed as

Chest TubesClinical CompetenceStudents, MedicalEducational MeasurementGermanyHumansReproducibility of ResultsThoracostomyChest tube insertionConstruct validityDirect ratingEducationIndirect ratingIntermethod reliabilityInterrater reliabilityOSATSTrainingVideo rating

Identifiers

PMID30587187
PMCPMC6307220
OpenAlexW2906500067

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.