Evidence map›Paper›PMID 40036750›Full record

ArticleBJS open2024

Inter-rater variability for the American Society of Anesthesiologists classification in patients undergoing hepato-pancreato-biliary surgery (MILESTONE-2): international survey among surgeons and anaesthesiologists.

Simone Augustinus, Jasper P Sijberden, Matthanja Bieze, Vandana Agarwal, Luca A Aldrighetti, Adnan Alseidi, Francisco C Bonofiglio, Kevin C P Conlon, Katia Donadello, Joris Erdmann and 30 more

Abstract read
In one paragraph

Article in BJS open, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Fibrosis-4 Score and Postoperative Outcomes in Metabolic Dysfunction-Associated Steatotic Liver Disease.The Turkish journal of gastroenterology : the official journal of Turkish Society of Gastroenterology · 2026
    Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

40 authors.

Simone AugustinusDepartment of Surgery, Amsterdam UMC, Location University of Amsterdam, Amsterdam, The Netherlands.ORCID 0000-0002-0625-4349
Jasper P SijberdenDepartment of Surgery, Amsterdam UMC, Location University of Amsterdam, Amsterdam, The Netherlands.
Matthanja BiezeDepartment of Anesthesiology, Amsterdam UMC, Location University of Amsterdam, Amsterdam, The Netherlands.
Vandana AgarwalDepartment of Anesthesia, Critical Care and Pain, Tata Memorial Hospital, Homi Bhabha National Institute, Mumbai, Maharashtra, India.
Luca A AldrighettiHepatobiliary Surgery Division, Ospedale San Raffaele, Milano, Italy.ORCID 0000-0001-7729-2468
Adnan AlseidiDivision of Hepatopancreatobiliary and Endocrine Surgery, University of California, San Francisco, California, USA.
Francisco C BonofiglioDepartment of Anesthesiology, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina.
Kevin C P ConlonDepartment of Surgery, Trinity College Dublin, Tallaght University Hospital, Dublin, Ireland.
Katia DonadelloDepartment of Anesthesia and Intensive Care B, DSCOMI, University of Verona, University Hospital Integrated Trust of Verona, Verona, Italy.
Joris ErdmannDepartment of Surgery, Amsterdam UMC, Location University of Amsterdam, Amsterdam, The Netherlands.ORCID 0000-0001-8233-1505
Cristina FerroneDepartment of Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Michael GuertinDepartment of Anesthesiology, The Ohio State University Wexner Medical Center & College of Medicine, Columbus, Ohio, USA.
Ronald HarterDepartment of Anesthesiology, The Ohio State University Wexner Medical Center & College of Medicine, Columbus, Ohio, USA.
Maria E FranceschettiDepartment of Anesthesia and Intensive Care, Istituto Fondazione Poliambulanza, Brescia, Italy.
Guiseppe K FusaiHepatobiliary Surgery and Liver Transplantation Unit, Royal Free Hospital, London, UK.
Bas Groot KoerkampDepartment of Surgery, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands.ORCID 0000-0003-1917-6973
Thilo HackertDepartment of General, Visceral and Thoracic Surgery, University Hospital Hamburg-Eppendorf, Germany.ORCID 0000-0002-7012-1196
Jin-Young JangDepartment of Surgery and Cancer Research Institute, Seoul National University College of Medicine, Seoul, South Korea.
Thomas KanderDepartment of Intensive and Perioperative Care, Skåne University Hospital, Lund and Lund University, Lund, Sweden.
Tobias KeckDGAV StuDoQ|Pancreas and Clinic of Surgery, UKSH Campus Lübeck, Lübeck, Germany.
Dominik KrzanickiDepartment of Anaesthesia, Royal Free Hospital, London, UK.
Ho-Jin LeeDepartment of Anesthesiology and Pain Medicine, Seoul National University Hospital, Seoul, South Korea.
Keith LewisDepartment of Anesthesiology and Perioperative Medicine, Rutgers Robert Wood Johnson Medical School, New Brunswick, New Jersey, USA.
Giuseppe NataliniDepartment of Anesthesia and Intensive Care, Istituto Fondazione Poliambulanza, Brescia, Italy.
Carla NauDepartment of Anaesthesiology and Intensive Care, University Medical Centre Schleswig-Holstein, Lübeck, Germany.
Timothy M PawlikDepartment of Surgery, The Ohio State University Wexner Medical Center, Columbus, Ohio, USA.ORCID 0000-0002-7994-9870
Henry A PittDepartment of Surgery, Rutgers Cancer Institute of New Jersey, New Brunswick, New Jersey, USA.
Rafaella ReinekeDepartment of Anesthesiology and Intensive Care, IRCCS San Raffaele Scientific Institute, Milan, Italy.
Roberto SalviaGeneral and Pancreatic Surgery Department, Pancreas Institute, University and Hospital Trust of Verona, Verona, Italy.
Eduardo de SantibanesDepartment of Surgery, Hospital Italiano, University of Buenos Aires, Buenos Aires, Argentina.
Shailesh V ShrikhandeDepartment of GI and HPB Surgery, Tata Memorial Centre, Homi Bhabha National Institute, Mumbai, India.
Martin SmithDepartment of Surgery, Faculty of Health Sciences, School of Clinical Medicine, University of the Witwatersrand, Johannesburg, South Africa.
Attila SzijartoDepartment of Anesthesiology, I. sz. Sebészeti Klinika, Semmelweis Egyetem, Budapest, Hungary.
Bobby TingstedtDepartment of Surgery, Clinical Sciences Lund, Lund University, Skåne University Hospital, Lund, Sweden.ORCID 0000-0002-5940-8276
Alice C WeiHepatopancreatobiliary Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, New York, USA.ORCID 0000-0002-2505-959X
John WindsorHBP/Upper GI Unit, Auckland City Hospital/Department of Surgery, University of Auckland, New Zealand.ORCID 0000-0001-5995-5432
Mohammed Abu HilalDepartment of Surgery, Fondazione Poliambulanza Istituto Ospedaliero, Brescia, Italy.
Manuel PardoDepartment of Anesthesia and Perioperative Care, University of California, San Francisco, California, USA.
Markus W HollmannDepartment of Anesthesiology, Amsterdam UMC, Location University of Amsterdam, Amsterdam, The Netherlands.
Marc G BesselinkDepartment of Surgery, Amsterdam UMC, Location University of Amsterdam, Amsterdam, The Netherlands.ORCID 0000-0003-2650-9350

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Hongbiao Carl Lekaye · 1985 to 2026
$347.4M
NCI NIH HHS P30 CA008748
6 · The paper itself

Abstract

backgroundPatients undergoing hepato-pancreato-biliary surgery are typically preoperatively assessed using the American Society of Anesthesiologists (ASA) classification, which is also used for case-mix adjustment when comparing centre outcomes. Studies determining the inter-rater variability of the ASA classification within hepato-pancreato-biliary surgery are currently lacking.

methodsAn international survey was collected and a case-vignette study was performed (November 2022-April 2023) regarding the ASA classification in patients undergoing hepato-pancreato-biliary surgery among anaesthesiologists and surgeons from (inter)national societies. The survey consisted of 23 questions and eight case-vignettes. Primary analysis included descriptive statistics and the inter-rater variability was calculated using Light's Kappa.

resultsOverall, 1283 participants from 55 countries responded: 1073 (84%) anaesthesiologists and 210 (16%) surgeons. The ASA classification was commonly used, both clinically 1003/1283 (78%) and for research 728/762 (96%). The majority of respondents (n = 1019, 79%) declared that ASA score impacted their perioperative strategy. There inter-rater variability was fair-moderate (Kappa 0.26-0.42) in all case-vignettes. Inter-rater variability differed within and among geographic regions for each case. Over 80% (n = 1138) of respondents stated that they would take the underlying disease (for example cancer) into account, but this changed the preferred ASA score within the case-vignettes by only 1%. Type of surgery changed the preferred score in the case-vignettes (13% difference). The most common suggestions to improve the ASA classification were to clarify whether type of operation should be considered, create a more extensive definition, and provide more examples.

conclusionsInter-rater variability was present within the ASA classification of patients undergoing hepato-pancreato-biliary surgery, which may impact perioperative strategy and hamper research results. Additional guidance to classify patients according to ASA is urgently needed. Until then, more objective measurements should be considered for case-mix adjustment within research.

Indexed as

AnesthesiologistsBiliary Tract Surgical ProceduresSurgeonsFemaleHumansMaleMiddle AgedObserver VariationSocieties, MedicalSurveys and QuestionnairesUnited States

Identifiers

PMID40036750
PMCPMC11879015

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.