Evidence map›Paper›PMID 30248276›Full record

ArticleMedical decision making : an international journal of the Society for Medical Decision Making2018

Nonidentifiability in Model Calibration and Implications for Medical Decision Making.

Fernando Alarid-Escudero, Richard F MacLehose, Yadira Peralta, Karen M Kuntz, Eva A Enns

Abstract read
In one paragraph

Article in Medical decision making : an international journal of the Society for Medical Decision Making, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Microsimulation Estimates of Decision Uncertainty and Value of Information Are Biased but Consistent.Medical decision making : an international journal of the Society for Medical Decision Making · 2025
    Article
  10. Emulator-Based Bayesian Calibration of the CISNET Colorectal Cancer Models.Medical decision making : an international journal of the Society for Medical Decision Making · 2024
    Article
  11. Emulator-based Bayesian calibration of the CISNET colorectal cancer models.medRxiv : the preprint server for health sciences · 2024
    Article
  12. Article
  13. Calibration and Validation of the Colorectal Cancer and Adenoma Incidence and Mortality (CRC-AIM) Microsimulation Model Using Deep Neural Networks.Medical decision making : an international journal of the Society for Medical Decision Making · 2023
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. CDX2 Biomarker Testing and Adjuvant Therapy for Stage II Colon Cancer: An Exploratory Cost-Effectiveness Analysis.Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research · 2022
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Fernando Alarid-EscuderoDivision of Health Policy and Management, University of Minnesota School of Public Health, Minneapolis, MN.ORCID 0000-0001-5076-1172
Richard F MacLehoseDivision of Epidemiology and Community Health, University of Minnesota School of Public Health, Minneapolis, MN.
Yadira PeraltaDepartment of Educational Psychology, University of Minnesota, Minneapolis, MN.
Karen M KuntzDivision of Health Policy and Management, University of Minnesota School of Public Health, Minneapolis, MN.
Eva A EnnsDivision of Health Policy and Management, University of Minnesota School of Public Health, Minneapolis, MN.

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Nicholas D Socci · 1985 to 2026
$347.4M
Comparative Modeling of Colorectal Cancer: Informing Health Policies and Prioritizing Future ResearchU01CA199335 · NCI · SLOAN-KETTERING INST CAN RESEARCH · PI KUNTZ, KAREN M, LANSDORP-VOGELAAR, IRIS · 2015 to 2019
$5.5M
Mathematical modeling and analysis of HIV care trajectories and retention in care challengesK25AI118476 · NIAID · UNIVERSITY OF MINNESOTA · PI ENNS, EVA A · 2015 to 2019
$649k
NCI NIH HHS P30 CA008748NCI NIH HHS U01 CA199335NIAID NIH HHS K25 AI118476
6 · The paper itself

Abstract

backgroundCalibration is the process of estimating parameters of a mathematical model by matching model outputs to calibration targets. In the presence of nonidentifiability, multiple parameter sets solve the calibration problem, which may have important implications for decision making. We evaluate the implications of nonidentifiability on the optimal strategy and provide methods to check for nonidentifiability.

methodsWe illustrate nonidentifiability by calibrating a 3-state Markov model of cancer relative survival (RS). We performed 2 different calibration exercises: 1) only including RS as a calibration target and 2) adding the ratio between the 2 nondeath states over time as an additional target. We used the Nelder-Mead (NM) algorithm to identify parameter sets that best matched the calibration targets. We used collinearity and likelihood profile analyses to check for nonidentifiability. We then estimated the benefit of a hypothetical treatment in terms of life expectancy gains using different, but equally good-fitting, parameter sets. We also applied collinearity analysis to a realistic model of the natural history of colorectal cancer.

resultsWhen only RS is used as the calibration target, 2 different parameter sets yield similar maximum likelihood values. The high collinearity index and the bimodal likelihood profile on both parameters demonstrated the presence of nonidentifiability. These different, equally good-fitting parameter sets produce different estimates of the treatment effectiveness (0.67 v. 0.31 years), which could influence the optimal decision. By incorporating the additional target, the model becomes identifiable with a collinearity index of 3.5 and a unimodal likelihood profile.

conclusionsIn the presence of nonidentifiability, equally likely parameter estimates might yield different conclusions. Checking for the existence of nonidentifiability and its implications should be incorporated into standard model calibration procedures.

Indexed as

CalibrationClinical Decision-MakingMarkov ChainsModels, StatisticalLikelihood Functionscalibrationdecision-analytic modelsestimationlikelihood functionnonidentifiability

Identifiers

PMID30248276
PMCPMC6156799

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.