Evidence map›Paper›PMID 36942574›Full record

ArticleAnnals of surgery2023

Artificial Intelligence-enabled Decision Support in Surgery: State-of-the-art and Future Directions.

Tyler J Loftus, Maria S Altieri, Jeremy A Balch, Kenneth L Abbott, Jeff Choi, Jayson S Marwaha, Daniel A Hashimoto, Gabriel A Brat, Yannis Raftopoulos, Heather L Evans and 3 more

Abstract read
In one paragraph

Article in Annals of surgery, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 36 papers.

0numbers the graph read from it
0cells of the map it votes in
36citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

36 citing papers in PubMed.

  1. Effects of explainable artificial intelligence in neurology decision support.Annals of clinical and translational neurology · 2024
    Trial
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Review
  9. Review
  10. Review
  11. Review
  12. Review
  13. Article
  14. Article
  15. Review
  16. Review
  17. Article
  18. Implementation of artificial intelligence (AI) in ASD treatment.North American Spine Society journal · 2025
    Article
  19. Review
  20. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

13 authors.

Tyler J LoftusDepartment of Surgery, University of Florida Health, Gainesville, FL.
Maria S AltieriAmerican College of Surgeons Health Information Technology Committee and Artificial Intelligence Subcommittee, Chicago, IL.
Jeremy A BalchDepartment of Surgery, University of Florida Health, Gainesville, FL.
Kenneth L AbbottDepartment of Surgery, University of Florida Health, Gainesville, FL.
Jeff ChoiAmerican College of Surgeons Health Information Technology Committee and Artificial Intelligence Subcommittee, Chicago, IL.
Jayson S MarwahaAmerican College of Surgeons Health Information Technology Committee and Artificial Intelligence Subcommittee, Chicago, IL.
Daniel A HashimotoAmerican College of Surgeons Health Information Technology Committee and Artificial Intelligence Subcommittee, Chicago, IL.
Gabriel A BratAmerican College of Surgeons Health Information Technology Committee and Artificial Intelligence Subcommittee, Chicago, IL.
Yannis RaftopoulosAmerican College of Surgeons Health Information Technology Committee and Artificial Intelligence Subcommittee, Chicago, IL.
Heather L EvansAmerican College of Surgeons Health Information Technology Committee and Artificial Intelligence Subcommittee, Chicago, IL.
Gretchen P JacksonAmerican College of Surgeons Health Information Technology Committee and Artificial Intelligence Subcommittee, Chicago, IL.
Danielle S WalshAmerican College of Surgeons Health Information Technology Committee and Artificial Intelligence Subcommittee, Chicago, IL.
Christopher J TignanelliAmerican College of Surgeons Health Information Technology Committee and Artificial Intelligence Subcommittee, Chicago, IL.

Funding

Molecular Biology in Burns and TraumaT32GM008721 · NIGMS · UNIVERSITY OF FLORIDA · PI Philip A Efron · 1999 to 2026
$5.0M
Aligning Patient Acuity with Resource Intensity after Major SurgeryR01GM149657 · NIGMS · UNIVERSITY OF FLORIDA · PI Tyler J Loftus · 2023 to 2026
$1.3M
Aligning Patient Acuity with Intensity of Care after SurgeryK23GM140268 · NIGMS · UNIVERSITY OF FLORIDA · PI LOFTUS, TYLER J · 2020 to 2023
$619k
NIGMS NIH HHS K23 GM140268NIGMS NIH HHS R01 GM149657NIGMS NIH HHS T32 GM008721
6 · The paper itself

Abstract

objectiveTo summarize state-of-the-art artificial intelligence-enabled decision support in surgery and to quantify deficiencies in scientific rigor and reporting.

backgroundTo positively affect surgical care, decision-support models must exceed current reporting guideline requirements by performing external and real-time validation, enrolling adequate sample sizes, reporting model precision, assessing performance across vulnerable populations, and achieving clinical implementation; the degree to which published models meet these criteria is unknown.

methodsEmbase, PubMed, and MEDLINE databases were searched from their inception to September 21, 2022 for articles describing artificial intelligence-enabled decision support in surgery that uses preoperative or intraoperative data elements to predict complications within 90 days of surgery. Scientific rigor and reporting criteria were assessed and reported according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines.

resultsSample size ranged from 163-2,882,526, with 8/36 articles (22.2%) featuring sample sizes of less than 2000; 7 of these 8 articles (87.5%) had below-average (<0.83) area under the receiver operating characteristic or accuracy. Overall, 29 articles (80.6%) performed internal validation only, 5 (13.8%) performed external validation, and 2 (5.6%) performed real-time validation. Twenty-three articles (63.9%) reported precision. No articles reported performance across sociodemographic categories. Thirteen articles (36.1%) presented a framework that could be used for clinical implementation; none assessed clinical implementation efficacy.

conclusionsArtificial intelligence-enabled decision support in surgery is limited by reliance on internal validation, small sample sizes that risk overfitting and sacrifice predictive performance, and failure to report confidence intervals, precision, equity analyses, and clinical implementation. Researchers should strive to improve scientific quality.

Indexed as

Artificial IntelligenceHumansROC Curve

Identifiers

PMID36942574
PMCPMC12292512

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.