Evidence map›Paper›PMID 30319014›Full record

ReviewMedical decision making : an international journal of the Society for Medical Decision Making2018

A Tutorial on Evaluating the Time-Varying Discrimination Accuracy of Survival Models Used in Dynamic Decision Making.

Aasthaa Bansal, Patrick J Heagerty

Open access · bronzeAbstract readReview
In one paragraph

Review in Medical decision making : an international journal of the Society for Medical Decision Making, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 34 papers.

0numbers the graph read from it
0cells of the map it votes in
34citing papers in PubMed
4.9field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

34 citing papers in PubMed, 70 citations in OpenAlex.

  1. Trial
  2. Review
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Association of nonstandardized model for end-stage liver disease score exceptions with waitlist mortality in adult liver transplant candidates.American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons · 2025
    Article
  12. Article
  13. Article
  14. Development and Standardization of an Osteoradionecrosis Classification System in Head and Neck Cancer: Implementation of a Risk-Based Model.Journal of clinical oncology : official journal of the American Society of Clinical Oncology · 2024
    Article
  15. Observational
  16. Article
  17. Evaluation of Plasma Biomarkers to Predict Major Adverse Kidney Events in Hospitalized Patients With COVID-19.American journal of kidney diseases : the official journal of the National Kidney Foundation · 2023
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors at 1 institution in 1 country.

Aasthaa BansalThe Comparative Health Outcomes, Policy, and Economics (CHOICE) Institute, School of Pharmacy, University of Washington, Seattle, WA (AB).
Patrick J HeagertyThe Comparative Health Outcomes, Policy, and Economics (CHOICE) Institute, School of Pharmacy, University of Washington, Seattle, WA (AB).
University of Washington · US

Funding

Transform Dissemination and Implementation Science in CTSA ProgramsUL1TR002319 · NCATS · UNIVERSITY OF WASHINGTON · PI John K. Amory · 2017 to 2026
$100.0M
Institute of Translational Health SciencesUL1TR000423 · NCATS · UNIVERSITY OF WASHINGTON · PI DISIS, MARY L. · 2012 to 2016
$49.4M
Personalized Risk-AdaptIve Surveillance strategies in cancEr -- PRAISER37CA218413 · NCI · UNIVERSITY OF WASHINGTON · PI BANSAL, AASTHAA · 2018 to 2024
$3.0M
Statistical Methods for Longitudinal StudiesR01HL072966 · NHLBI · UNIVERSITY OF WASHINGTON · PI HEAGERTY, PATRICK J · 2003 to 2014
$1.9M
NCATS NIH HHS UL1 TR000423NCATS NIH HHS UL1 TR002319NCI NIH HHS R37 CA218413NHLBI NIH HHS R01 HL072966
6 · The paper itself

Abstract

Many medical decisions involve the use of dynamic information collected on individual patients toward predicting likely transitions in their future health status. If accurate predictions are developed, then a prognostic model can identify patients at greatest risk for future adverse events and may be used clinically to define populations appropriate for targeted intervention. In practice, a prognostic model is often used to guide decisions at multiple time points over the course of disease, and classification performance (i.e., sensitivity and specificity) for distinguishing high-risk v. low-risk individuals may vary over time as an individual's disease status and prognostic information change. In this tutorial, we detail contemporary statistical methods that can characterize the time-varying accuracy of prognostic survival models when used for dynamic decision making. Although statistical methods for evaluating prognostic models with simple binary outcomes are well established, methods appropriate for survival outcomes are less well known and require time-dependent extensions of sensitivity and specificity to fully characterize longitudinal biomarkers or models. The methods we review are particularly important in that they allow for appropriate handling of censored outcomes commonly encountered with event time data. We highlight the importance of determining whether clinical interest is in predicting cumulative (or prevalent) cases over a fixed future time interval v. predicting incident cases over a range of follow-up times and whether patient information is static or updated over time. We discuss implementation of time-dependent receiver operating characteristic approaches using relevant R statistical software packages. The statistical summaries are illustrated using a liver prognostic model to guide transplantation in primary biliary cirrhosis.

Indexed as

Decision Support TechniquesModels, StatisticalPrognosisSurvival AnalysisBiomarkersClinical Decision-MakingHumansLiver Cirrhosis, BiliaryLiver TransplantationReproducibility of ResultsRisk FactorsROC CurveSensitivity and SpecificityTime FactorsBiomarkersdynamic informationprognosisrisk predictionsensitivityspecificity

Identifiers

PMID30319014
PMCPMC6584037
OpenAlexW2796406551

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.