Evidence map›Paper›PMID 30907757›Full record

ArticleAnnals of surgery2020

Recalibration and External Validation of the Risk Analysis Index: A Surgical Frailty Assessment Tool.

Shipra Arya, Patrick Varley, Ada Youk, Jeffrey D Borrebach, Sebastian Perez, Nader N Massarweh, Jason M Johanning, Daniel E Hall

Abstract readValidation Study
In one paragraph

Article in Annals of surgery, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 103 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
103citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

103 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Frailty Screening Using the Risk Analysis Index: A User Guide.Joint Commission journal on quality and patient safety · 2025
    Pooled it
  3. Trial
  4. Article
  5. Article
  6. Superior predictive performance of the Risk Analysis Index over the modified Frailty Index-5 in patients undergoing elective anterior cervical procedures among octogenarians.European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society · 2026
    Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Predictive value of the risk analysis index for 30-day mortality following surgical management of thoracolumbar vertebral body fractures.European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society · 2026
    Article
  12. Article
  13. Article
  14. Risk Analysis Index Outperforms the Modified Frailty Index in Predicting Outcomes in Thyroidectomy and Parathyroidectomy.Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery · 2026
    Article
  15. Observational
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article

43 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Shipra AryaDivision of Vascular Surgery, Stanford University School of Medicine, Stanford, CA.
Patrick VarleyDepartment of Surgery, University of Pittsburgh, Pittsburgh, PA.
Ada YoukCenter for Health Equity Research and Promotion, VA Pittsburgh Healthcare System, Pittsburgh, PA.
Jeffrey D BorrebachWolff Center at UPMC, University of Pittsburgh Medical Center, Pittsburgh, PA.
Sebastian PerezDepartment of Surgery, Emory University, Atlanta, GA.
Nader N MassarwehCenter for Innovations in Quality, Effectiveness and Safety, Michael E DeBakey VA Medical Center; Michael E DeBakey Department of Surgery, Baylor College of Medicine, Houston, TX.
Jason M JohanningDepartment of Surgery, University of Nebraska Medical Center and Nebraska Western Iowa VA. Health System, Omaha, NE.
Daniel E HallDepartment of Surgery, University of Pittsburgh, Pittsburgh, PA.

Funding

Failure to rescue in frail surgical patientsR03AG050930 · NIA · STANFORD UNIVERSITY · PI ARYA, SHIPRA · 2016 to 2017
$234k
Pilot Testing Prehabilitation Services Aimed at Improving Outcomes of Frail Veterans Following Major Abdominal SurgeryI21HX002345 · VA · VETERANS HEALTH ADMINISTRATION · PI HALL, DANIEL E · 2019 to 2019
–
HSRD VA I21 HX002345NIA NIH HHS R03 AG050930
6 · The paper itself

Abstract

OBJECTIVE AND

backgroundThe Risk Analysis Index (RAI) predicts 30-, 180-, and 365-day mortality based on variables constitutive of frailty. Initially validated, in a single-center Veteran hospital, we sought to improve model performance by recalibrating the RAI in a large, veteran surgical registry, and to externally validate it in both a national surgical registry and a cohort of surgical patients for whom RAI was measured prospectively before surgery.

methodsThe RAI was recalibrated among development and confirmation samples within the Veterans Affairs Surgical Quality Improvement Program (VASQIP; 2010-2014; N = 480,731) including major, elective noncardiac surgery patients to create the revised RAI (RAI-rev), comparing discrimination and calibration. The model was tested externally in the American College of Surgeons National Surgical Quality Improvement Program dataset (NSQIP; 2005-2014; N = 1,391,785), and in a prospectively collected cohort from the Nebraska Western Iowa Health Care System VA (NWIHCS; N = 6,856).

resultsRecalibrating the RAI significantly improved discrimination for 30-day [c = 0.84-0.86], 180-day [c = 0.81-0.84], and 365-day mortality [c = 0.78-0.82] (P < 0.001 for all) in VASQIP. The RAI-rev also had markedly better calibration (median absolute difference between observed and predicted 180-day mortality: decreased from 8.45% to 1.23%). RAI-rev was highly predictive of 30-day mortality (c = 0.87) in external validation with excellent calibration (median absolute difference between observed and predicted 30-day mortality: 0.6%). The discrimination was highly robust in men (c = 0.85) and women (c = 0.89). Discrimination also improved in the prospectively measured cohort from NWIHCS for 180-day mortality [c = 0.77 to 0.80] (P < 0.001).

conclusionsThe RAI-rev has improved discrimination and calibration as a frailty-screening tool in surgical patients. It has robust external validity in men and women across a wide range of surgical settings and available for immediate implementation for risk assessment and counseling in preoperative patients.

Indexed as

AdolescentAdultAgedAged, 80 and overFemaleFrailtyHumansMaleMiddle AgedPostoperative ComplicationsProspective StudiesRisk AssessmentTime FactorsYoung Adult

Identifiers

PMID30907757
PMCPMC8785437

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.