Evidence map›Paper›PMID 24055383›Full record

ArticleJournal of the American College of Surgeons2013

Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons.

Karl Y Bilimoria, Yaoming Liu, Jennifer L Paruch, Lynn Zhou, Thomas E Kmiecik, Clifford Y Ko, Mark E Cohen

7 registry-linked trialsAbstract read
In one paragraph

Article in Journal of the American College of Surgeons, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 7 registered trials, which are not on this map. Cited by 705 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
705citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03501927 naterminatednot on this mapstarted 2018, after this paper: background citation

The Effects of Pre-operative Point-of-Care Focused Cardiac Ultrasound on Patient Outcome - a Prospective, Randomized, Clinical Study (PreOPFOCUS)

TypeinterventionalSponsorAarhus University HospitalRan2018 to 2020Enrolled337ConditionsCardiopulmonary Disease, Surgery, Morality, ComplicationArmsFOCUS (focused cardiac ultrasound)
NCT04041076 unknown statusnot on this mapstarted 2019, after this paper: background citation

Validation of Postoperative Mortality Prediction for Elective Major Surgical Operation With Existing Risk Calculators Based on Preoperative Parameters

TypeobservationalSponsorChinese University of Hong KongRan2019 to 2020Enrolled5,000ConditionsSurgery, DeathArmsMajor surgical operation
NCT04211532 unknown statusnot on this mapstarted 2019, after this paper: background citation

Evaluation of the ACS-NSQIP Risk Calculator for Emergent Surgery in a Spanish Population

TypeobservationalSponsorCorporacion Parc TauliRan2019 to 2020Enrolled400ConditionsPostoperative ComplicationsArmsSurgery
NCT05517278 nawithdrawnnot on this mapstarted 2024, after this paper: background citation

Clinical Evaluation of the Next Science SurgX Antimicrobial Wound Gel Impact on Surgical Site Complications

TypeinterventionalSponsorNorthwell HealthRan2024 to 2024Enrolled0ConditionsTotal Hip Arthroplasty, Total Knee ArthroplastyArmsSurgX Antimicrobial Wound Gel, Standard of Care
NCT05519007 narecruitingnot on this mapstarted 2023, after this paper: background citation

Clinical Evaluation of the Rate of Total Joint Infection 90-day After Surgery Following Irrigation With Next Science No-Rinse Solution vs SOC Alone

TypeinterventionalSponsorNorthwell HealthRan2023 to 2026Enrolled936ConditionsJoint InfectionArmsNo-Rinse Solution (NS), Saline irrigation
NCT07248527 active not recruitingnot on this mapstarted 2025, after this paper: background citation

PAN-ICIS: Prospective Observational Study Evaluating the Intensive Care Infection Score for Early Detection of Infectious Complications After Pancreatic Resections

TypeobservationalSponsorCharles University, Czech RepublicRan2025 to 2028Enrolled400ConditionsPancreatectomy, Pancreatic Surgery, Intensive Care (ICU), Inflamatory Markers
NCT07539532 recruitingnot on this mapstarted 2026, after this paper: background citation

Value of Some Risk Scores in Predicting Cardiovascular Events After Gastrointestinal Surgery

Typeobservational_patient_registrySponsorBach Mai HospitalRan2026 to 2026Enrolled5,000ConditionsPostoperative Complications, Cardiovascular Diseases, Digestive System Surgical Procedures
3 · Its place in the literature

Who cites it

705 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Trial
  6. Trial
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article

645 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Karl Y BilimoriaDivision of Research and Optimal Patient Care, American College of Surgeons, Chicago, IL; Surgical Outcomes and Quality Improvement Center, Department of Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL. Electronic address: kbilimoria@facs.org.
Yaoming Liu
Jennifer L Paruch
Lynn Zhou
Thomas E Kmiecik
Clifford Y Ko
Mark E Cohen

Funding

NCATS NIH HHS L30 TR000300
6 · The paper itself

Abstract

backgroundAccurately estimating surgical risks is critical for shared decision making and informed consent. The Centers for Medicare and Medicaid Services may soon put forth a measure requiring surgeons to provide patients with patient-specific, empirically derived estimates of postoperative complications. Our objectives were to develop a universal surgical risk estimation tool, to compare performance of the universal vs previous procedure-specific surgical risk calculators, and to allow surgeons to empirically adjust the estimates of risk. STUDY

designUsing standardized clinical data from 393 ACS NSQIP hospitals, a web-based tool was developed to allow surgeons to easily enter 21 preoperative factors (demographics, comorbidities, procedure). Regression models were developed to predict 8 outcomes based on the preoperative risk factors. The universal model was compared with procedure-specific models. To incorporate surgeon input, a subjective surgeon adjustment score, allowing risk estimates to vary within the estimate's confidence interval, was introduced and tested with 80 surgeons using 10 case scenarios.

resultsBased on 1,414,006 patients encompassing 1,557 unique CPT codes, a universal surgical risk calculator model was developed that had excellent performance for mortality (c-statistic = 0.944; Brier score = 0.011 [where scores approaching 0 are better]), morbidity (c-statistic = 0.816, Brier score = 0.069), and 6 additional complications (c-statistics > 0.8). Predictions were similarly robust for the universal calculator vs procedure-specific calculators (eg, colorectal). Surgeons demonstrated considerable agreement on the case scenario scoring (80% to 100% agreement), suggesting reliable score assignment between surgeons.

conclusionsThe ACS NSQIP surgical risk calculator is a decision-support tool based on reliable multi-institutional clinical data, which can be used to estimate the risks of most operations. The ACS NSQIP surgical risk calculator will allow clinicians and patients to make decisions using empirically derived, patient-specific postoperative risks.

Indexed as

Decision Support TechniquesGeneral SurgeryInformed ConsentPatient Education as TopicRisk AdjustmentAgedAged, 80 and overFemaleHumansMaleMiddle AgedPostoperative ComplicationsRisk AssessmentSocieties, MedicalUnited States

Identifiers

PMID24055383
PMCPMC3805776

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

and 1 more above

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.