Evidence map›Paper›PMID 40613383›Full record

Trial reportMedical decision making : an international journal of the Society for Medical Decision Making2025

The Impact of Machine Learning Mortality Risk Prediction on Clinician Prognostic Accuracy and Decision Support: A Randomized Vignette Study.

Ravi B Parikh, William J Ferrell, Anthony Girard, Jenna White, Sophia Fang, Justin E Bekelman, Marilyn M Schapira

Abstract readRandomized Controlled Trial
In one paragraph

Trial report in Medical decision making : an international journal of the Society for Medical Decision Making, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Ravi B ParikhDepartment of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.ORCID 0000-0003-2692-6306
William J FerrellDepartment of Medical Ethics and Health Policy, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.ORCID 0000-0001-9966-1973
Anthony GirardDepartment of Medical Ethics and Health Policy, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Jenna WhiteDepartment of Medical Ethics and Health Policy, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Sophia FangDepartment of Operations Research and Financial Engineering, Princeton University, Princeton, NJ, USA.
Justin E BekelmanDepartment of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Marilyn M SchapiraDepartment of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.ORCID 0000-0002-3775-9462

Funding

Human-Machine Collaborations to Improve Prognosis and Clinical Decision-Making in Advanced CancerK08CA263541 · NCI · UNIVERSITY OF PENNSYLVANIA · PI PARIKH, RAVI BHARAT · 2021 to 2025
$1.2M
NCI NIH HHS K08 CA263541
6 · The paper itself

Abstract

BackgroundMachine learning (ML) algorithms may improve the prognosis for serious illnesses such as cancer, identifying patients who may benefit from earlier palliative care (PC) or advance care planning (ACP). We evaluated the impact of various presentation strategies of a hypothetical ML algorithm on clinician prognostic accuracy and decision making.MethodsThis was a randomized clinical vignette survey study among medical oncologists who treat metastatic non-small-cell lung cancer (mNSCLC). Between March and June 2023, clinicians were shown 3 vignettes of patients presenting with mNSCLC. The vignettes varied by prognostic risk, as defined from the Lung Cancer Prognostic Index (LCPI). Clinicians estimated life expectancy in months and made recommendations about PC and ACP. Clinicians were then shown the same vignette with a hypothetical survival estimate from a black-box ML algorithm; clinicians were randomized to receive the ML prediction using absolute and/or reference-dependent prognostic estimates. The primary outcome was prognostic accuracy relative to the LCPI.ResultsAmong 51 clinicians with complete responses, the median years in practice was 7 (interquartile range 3.5-19), 14 (27.5%) were female, 23 (45.1%) practiced in a community oncology setting, and baseline accuracy was 54.9% (95% confidence interval [CI] 47.0-62.8) across all vignettes. ML presentation improved accuracy (mean change relative to baseline 20.9%, 95% CI 13.9-27.9,

Indexed as

Carcinoma, Non-Small-Cell LungLung NeoplasmsMachine LearningAdultAdvance Care PlanningAlgorithmsDecision Support TechniquesFemaleHumansMaleMiddle AgedPrognosisRisk AssessmentSurveys and Questionnairesartificial intelligencemachine learningnon-small cell lung cancerpalliative careprognosis

Identifiers

PMID40613383
PMCPMC12233153

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.