Evidence map›Paper›PMID 30149939›Full record

ArticleSurgery2018

Eye of the beholder: Risk calculators and barriers to adoption in surgical trainees.

Ira L Leeds, Andrew J Rosenblum, Paul E Wise, Anthony C Watkins, Matthew I Goldblatt, Elliott R Haut, Jonathan E Efron, Fabian M Johnston

Abstract read
In one paragraph

Article in Surgery, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Ira L LeedsDepartment of Surgery, Johns Hopkins University School of Medicine, Baltimore, MD.
Andrew J RosenblumJohns Hopkins University Bloomberg School of Public Health, Baltimore, MD.
Paul E WiseDepartment of Surgery, Washington University School of Medicine in St. Louis, MO.
Anthony C WatkinsDepartment of Surgery, Weill Cornell Medical College, New York, NY.
Matthew I GoldblattDepartment of Surgery, Medical College of Wisconsin, Milwaukee, WI.
Elliott R HautDepartment of Surgery, Johns Hopkins University School of Medicine, Baltimore, MD; Johns Hopkins University Bloomberg School of Public Health, Baltimore, MD.
Jonathan E EfronDepartment of Surgery, Johns Hopkins University School of Medicine, Baltimore, MD.
Fabian M JohnstonDepartment of Surgery, Johns Hopkins University School of Medicine, Baltimore, MD. Electronic address: fjohnst4@jhmi.edu.

Funding

Clinical and Laboratory Research Training for Surgical OncologistsT32CA126607 · NCI · JOHNS HOPKINS UNIVERSITY · PI CAMERON, ANDREW M. · 2008 to 2024
$6.0M
Promoting Early Utilization of Palliative Care for African Americans Using Culturally Informed Patient NavigationK08HS024736 · AHRQ · JOHNS HOPKINS UNIVERSITY · PI JOHNSTON, FABIAN M · 2016 to 2020
$738k
AHRQ HHS K08 HS024736NCI NIH HHS T32 CA126607
6 · The paper itself

Abstract

backgroundAccurate risk assessment before surgery is complex and hampered by behavioral factors. Underutilized risk-based decision-support tools may counteract these barriers. The purpose of this study was to identify perceptions of and barriers to the use of surgical risk-assessment tools and assess the importance of data framing as a barrier to adoption in surgical trainees.

methodsWe distributed a survey and risk assessment activity to surgical trainees at four training institutions. The primary outcomes of this study were descriptive risk assessment practices currently performed by residents, identifiable influences and obstacles to adoption, and the variability of preference sets when comparing modified System Usability Scores of a current risk calculator to a purpose-built calculator revision. Risk calculator comparison responses were compared with simple and multivariable regression to identify predictors for preferentiality.

resultsWe collected responses from 124 surgical residents (39% response rate). Participants endorsed familiarity with direct verbal communication (100%), sketch diagrams (87%), and brochures (59%). The most contemporary risk communication frameworks, such as best-worst case scenario framing (38%), case-specific risk calculators (43%), and all-procedure calculators (52%) were the least familiar. Usage favored traditional models of communication with only 26% of residents regularly using a strategy other than direct verbal discussion or anatomic sketch diagrams. Barriers limiting routine use included lack of electronic and clinical workflow integration. The mean modified System Usability Scores domain scores were widely dispersed for all domains, and no domain demonstrated one calculator's superiority over another.

conclusionRisk assessment tools are underutilized by trainees. Of importance, preference sets of clinicians appear to be unpredictable and may benefit more from a customizable, bespoke approach.

Indexed as

Decision Support TechniquesAdultClinical CompetenceClinical Decision-MakingFemaleGeneral SurgeryHumansInternship and ResidencyMalePostoperative ComplicationsPreoperative CareRisk AssessmentRisk FactorsSurgical Procedures, OperativeSurveys and Questionnaires

Identifiers

PMID30149939
PMCPMC8383120

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.