Evidence map›Paper›PMID 33831724›Full record

ArticleComputer methods and programs in biomedicine2021

A Novel Method for Identifying a Parsimonious and Accurate Predictive Model for Multiple Clinical Outcomes.

L Grisell Diaz-Ramirez, Sei J Lee, Alexander K Smith, Siqi Gan, W John Boscardin

Abstract read
In one paragraph

Article in Computer methods and programs in biomedicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. External validation and comparison of five prediction models for lymph node metastasis after noncurative endoscopic submucosal dissection for early gastric cancer.Gastric cancer : official journal of the International Gastric Cancer Association and the Japanese Gastric Cancer Association · 2026
    Article
  3. Article
  4. Uncertainty quantification of the pressure waveform using a Windkessel model.International journal for numerical methods in biomedical engineering · 2024
    Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

L Grisell Diaz-RamirezDivision of Geriatrics, University of California, San Francisco, 490 Illinois Street, Floor 08, Box 1265, San Francisco, CA 94143, United States; San Francisco Veterans Affairs (VA) Medical Center, 4150 Clement Street, 181G, San Francisco, CA 94121, United States. Electronic address: grisell.diaz-ramirez@ucsf.edu.
Sei J LeeDivision of Geriatrics, University of California, San Francisco, 490 Illinois Street, Floor 08, Box 1265, San Francisco, CA 94143, United States; San Francisco Veterans Affairs (VA) Medical Center, 4150 Clement Street, 181G, San Francisco, CA 94121, United States. Electronic address: sei.lee@ucsf.edu.
Alexander K SmithDivision of Geriatrics, University of California, San Francisco, 490 Illinois Street, Floor 08, Box 1265, San Francisco, CA 94143, United States; San Francisco Veterans Affairs (VA) Medical Center, 4150 Clement Street, 181G, San Francisco, CA 94121, United States. Electronic address: alexander.Smith@ucsf.edu.
Siqi GanDivision of Geriatrics, University of California, San Francisco, 490 Illinois Street, Floor 08, Box 1265, San Francisco, CA 94143, United States; San Francisco Veterans Affairs (VA) Medical Center, 4150 Clement Street, 181G, San Francisco, CA 94121, United States. Electronic address: siqi.gan@ncire.org.
W John BoscardinDivision of Geriatrics, University of California, San Francisco, 490 Illinois Street, Floor 08, Box 1265, San Francisco, CA 94143, United States; San Francisco Veterans Affairs (VA) Medical Center, 4150 Clement Street, 181G, San Francisco, CA 94121, United States. Electronic address: john.boscardin@ucsf.edu.

Funding

Residing in the Community with Dementia at the End of Life: Understanding Hospice Use and Residential SettingP30AG028741 · NIA · ICAHN SCHOOL OF MEDICINE AT MOUNT SINAI · PI ORNA INTRATOR · 2010 to 2026
$21.9M
VARC CoreP30AG044281 · NIA · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Louise C. Walter · 2013 to 2026
$19.9M
Unnecessary and Harmful Medication Use in Older Adults with DementiaP01AG066605 · NIA · ICAHN SCHOOL OF MEDICINE AT MOUNT SINAI · PI R. Sean Morrison · 2020 to 2026
$17.7M
Developing prognostic models for life expectancy and geriatric outcomesR01AG047897 · NIA · NORTHERN CALIFORNIA INSTITUTE/RES/EDU · PI LEE, SEI, SMITH, ALEXANDER KELIIMOEANU · 2015 to 2018
$1.7M
Prognostic calculators for patients with Alzheimers disease and related dementiasR01AG057751 · NIA · NORTHERN CALIFORNIA INSTITUTE/RES/EDU · PI LEE, SEI, SMITH, ALEXANDER KELIIMOEANU · 2018 to 2021
$1.5M
Mentoring Researchers in Prognosis Research in Alzheimer’s Disease and Related DementiasK24AG068312 · NIA · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Alexander Keliimoeanu Smith · 2020 to 2026
$1.2M
Mentoring Patient-Oriented Research to Individualize Care for Hospitalized Older Adults with and without Alzheimer's Disease and Related DementiasK24AG066998 · NIA · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Sei Lee · 2021 to 2026
$1.1M
NIA NIH HHS K24 AG066998NIA NIH HHS K24 AG068312NIA NIH HHS P01 AG066605NIA NIH HHS P30 AG028741NIA NIH HHS P30 AG044281NIA NIH HHS R01 AG047897NIA NIH HHS R01 AG057751
6 · The paper itself

Abstract

BACKGROUND AND

objectiveMost methods for developing clinical prognostic models focus on identifying parsimonious and accurate models to predict a single outcome; however, patients and providers often want to predict multiple outcomes simultaneously. As an example, for older adults one is often interested in predicting nursing home admission as well as mortality. We propose and evaluate a novel predictor-selection computing method for multiple outcomes and provide the code for its implementation.

methodsOur proposed algorithm selected the best subset of common predictors based on the minimum average normalized Bayesian Information Criterion (BIC) across outcomes: the Best Average BIC (baBIC) method. We compared the predictive accuracy (Harrell's C-statistic) and parsimony (number of predictors) of the model obtained using the baBIC method with: 1) a subset of common predictors obtained from the union of optimal models for each outcome (Union method), 2) a subset obtained from the intersection of optimal models for each outcome (Intersection method), and 3) a model with no variable selection (Full method). We used a case-study data from the Health and Retirement Study (HRS) to demonstrate our method and conducted a simulation study to investigate performance.

resultsIn the case-study data and simulations, the average Harrell's C-statistics across outcomes of the models obtained with the baBIC and Union methods were comparable. Despite the similar discrimination, the baBIC method produced more parsimonious models than the Union method. In contrast, the models selected with the Intersection method were the most parsimonious, but with worst predictive accuracy, and the opposite was true in the Full method. In the simulations, the baBIC method performed well by identifying many of the predictors selected in the baBIC model of the case-study data most of the time and excluding those not selected in the majority of the simulations.

conclusionsOur method identified a common subset of variables to predict multiple clinical outcomes with superior balance between parsimony and predictive accuracy to current methods.

Indexed as

AlgorithmsAgedBayes TheoremHumansPrognosisbackward eliminationBayesian Information Criterionprognostic modelssurvival analysisvariable selection

Identifiers

PMID33831724
PMCPMC8098121

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.